-- Logs begin at Tue 2022-09-13 19:14:28 UTC, end at Tue 2022-09-13 20:46:58 UTC. -- Sep 13 19:49:10.599114 dv-cinder-854274-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 19:49:10.607998 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 19:49:10.610012 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 19:49:10 2022] *** Sep 13 19:49:10.610012 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 19:49:10.610012 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 19:49:10.610012 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: nodename: dv-cinder-854274-5-iscsi Sep 13 19:49:10.610012 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: machine: x86_64 Sep 13 19:49:10.610012 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: clock source: unix Sep 13 19:49:10.610012 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: pcre jit disabled Sep 13 19:49:10.610012 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: detected number of CPU cores: 4 Sep 13 19:49:10.610012 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: current working directory: / Sep 13 19:49:10.610012 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: detected binary path: /usr/bin/uwsgi-core Sep 13 19:49:10.610012 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: your processes number limit is 47680 Sep 13 19:49:10.610012 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: your memory page size is 4096 bytes Sep 13 19:49:10.610776 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: detected max file descriptor number: 2048 Sep 13 19:49:10.610776 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: lock engine: pthread robust mutexes Sep 13 19:49:10.610776 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: thunder lock: enabled Sep 13 19:49:10.610776 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 19:49:10.610776 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 19:49:10.653699 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: Python main interpreter initialized at 0x55bd730e29c0 Sep 13 19:49:10.653699 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: python threads support enabled Sep 13 19:49:10.653699 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: your server socket listen backlog is limited to 100 connections Sep 13 19:49:10.653699 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: your mercy for graceful operations on workers is 90 seconds Sep 13 19:49:10.654126 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 19:49:10.654126 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: *** Operational MODE: preforking *** Sep 13 19:49:10.656595 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: *** uWSGI is running in multiple interpreter mode *** Sep 13 19:49:10.656595 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: spawned uWSGI master process (pid: 105591) Sep 13 19:49:10.656818 dv-cinder-854274-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 19:49:10.657708 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: spawned uWSGI worker 1 (pid: 105592, cores: 1) Sep 13 19:49:10.657708 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: spawned uWSGI worker 2 (pid: 105593, cores: 1) Sep 13 19:49:10.657893 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 19:49:11.314107 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 19:49:11.337120 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 19:49:12.395654 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:49:12.395654 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: from cryptography.utils import int_from_bytes Sep 13 19:49:12.396333 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:49:12.396333 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: from cryptography.utils import int_from_bytes Sep 13 19:49:12.402932 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:49:12.402932 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: from cryptography.utils import int_from_bytes Sep 13 19:49:12.403414 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:49:12.403414 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: from cryptography.utils import int_from_bytes Sep 13 19:49:14.851240 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:49:14.851789 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:49:14.852124 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:49:14.852217 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:49:14.852297 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:49:14.852363 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:49:14.852441 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:49:14.852514 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:49:14.852586 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:49:14.852658 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:49:14.852887 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.852994 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.853213 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.853353 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.853532 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.853660 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.853850 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.853944 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.854172 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.854322 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.854458 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.854547 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.854811 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.854940 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.855126 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.855252 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.855449 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.855586 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.855671 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.855758 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.856006 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.856162 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.856303 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-5-iscsi {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.856465 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-5-iscsi {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.856616 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.856703 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.856921 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.857021 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.857232 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.857331 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.857602 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.857700 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.857913 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.858004 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.858235 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.858319 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.858568 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.858668 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.859074 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.859193 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.860447 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.860569 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.860668 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.860750 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.860827 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.860904 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.860981 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.861064 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.861153 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.861232 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.861308 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.861390 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.861475 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.861567 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.861664 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.861749 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.861929 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.862025 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.862233 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.862469 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.862652 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-5-iscsi {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.862735 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-5-iscsi {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.863061 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.863159 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.863280 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.863371 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.863592 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.863686 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.864096 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.864213 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.864406 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.864498 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.864741 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.864836 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.865056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.865138 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.865375 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.865466 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.865680 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.865770 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.866002 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.866085 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.866322 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.866442 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.866664 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.866754 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.866988 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.867078 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.867290 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.867374 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.867596 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.867685 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.867903 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.867986 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.868219 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.868302 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.868522 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.868612 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.868823 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.868912 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.869072 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.869160 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.869377 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.869469 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.869697 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.869789 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.870014 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.870098 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.870334 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.870486 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.870615 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.870706 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.870845 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.870930 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.871162 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.871246 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.871479 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.871564 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.871788 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.871879 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.872093 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.872176 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.872399 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.872483 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.872702 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.872784 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.873007 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.873166 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.873393 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.873482 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.873705 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.873789 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.874014 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.874120 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.874333 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.874439 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.874674 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.874757 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.874996 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.875091 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.875303 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.875385 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.875622 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.875704 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.876018 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.876109 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.876269 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.876364 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.876578 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.876706 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.876916 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.877010 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.877233 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.877316 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.877539 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.877681 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.877858 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.877942 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.878184 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.878278 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.878516 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.878605 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.878824 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.878908 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.879130 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.879213 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.879447 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.879537 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.879780 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.879870 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.880086 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.880181 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.880335 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.880418 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.880637 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.880722 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.880942 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.881037 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.881259 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.881350 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.881563 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.881648 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.881868 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.881965 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.882175 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.882280 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.882494 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.882579 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.882802 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.882898 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.883106 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.883202 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.883411 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.883495 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.883717 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.883801 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.884020 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.884130 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.884326 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.884415 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.884631 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.884714 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.884938 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.885034 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.885241 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.885324 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.885544 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.885627 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.885861 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.885952 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.886177 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.886260 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.886511 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.886616 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.886820 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.886912 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.887126 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.887291 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.887429 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.887514 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.887752 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.887844 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.888061 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.888146 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.888365 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.888448 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.888686 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.888771 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.889031 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.889116 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.889336 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.889419 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.889652 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.889788 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.889996 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.890124 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.890300 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.890397 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.890717 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.890810 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.891018 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.891102 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.891325 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.891407 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.891642 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.891738 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.891947 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.892030 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.892251 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.892348 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.892553 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.892636 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.892854 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.892937 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.893156 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.893250 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.893459 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.893543 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.893760 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.893844 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.894062 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.894156 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.894357 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.894495 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.894695 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.894791 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.895013 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.895105 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.895320 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.895412 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.895632 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.895724 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.895930 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.896021 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.896248 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.896333 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:14.896587 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.896672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.896918 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.897002 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.897258 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.897353 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.897572 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.897655 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.897902 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.897998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.898232 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.898316 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.898575 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.898660 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.898889 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.898974 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.899205 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.899289 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.899528 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.899695 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.899840 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.899932 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.900152 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.900243 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.900465 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.900558 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.900787 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.900933 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.901104 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.901189 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.901435 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.901526 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.901753 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.901837 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.902071 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.902163 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.902409 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.902510 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.902729 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.902822 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.903049 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.903133 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.903377 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.903469 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.903696 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.903780 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.904007 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.904098 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.904347 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.904481 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.904749 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.904835 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.905062 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.905145 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.905386 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.905470 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.905707 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.905791 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.906017 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.906100 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.906329 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.906460 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.906664 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.906748 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.907007 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.907092 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.907319 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.907410 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.907631 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.907715 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.907949 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.908044 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.908262 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.908346 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.908580 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.908665 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.908893 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.908991 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.909205 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.909290 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.909514 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.909599 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.909828 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.910005 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.910134 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.910219 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.910491 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.910593 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.910807 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.910900 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.911129 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.911216 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.911443 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.911526 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.911752 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.911843 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.912066 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.912163 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.912376 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.912460 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.912685 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.912778 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.912996 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.913085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.913299 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.913383 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.913603 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.913689 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.913903 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.913987 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.914211 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.914294 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.914535 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.914633 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.914854 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.914937 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.915178 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.915269 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.915484 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.915569 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.915812 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.915895 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.916114 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.916198 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.916426 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.916510 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.916733 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.916817 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.917041 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.917133 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.917343 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.917427 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.917652 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.917736 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.917961 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.918053 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.918265 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.918349 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.918611 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.918698 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.918920 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.919012 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.919223 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.919308 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.919548 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.919642 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.919852 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.919944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.920186 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.920269 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.920500 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.920592 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.920808 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.920900 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.921118 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.921201 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.921428 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.921510 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.921739 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.921823 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.922059 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.922143 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.922487 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.922590 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.922681 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.922761 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.923022 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.923107 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.923350 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.923434 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.923654 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.923738 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.923976 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.924059 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.924301 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.924398 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.924618 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.924704 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.924916 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.925020 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.925225 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.925322 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.925527 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.925612 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.925830 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.925914 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.926129 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.926221 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.926462 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.926549 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.926768 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.926852 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.927071 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.927172 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.927372 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.927471 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.927673 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.927757 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.927973 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.928057 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.928294 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.928377 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.928602 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.928684 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.928904 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.928999 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.929207 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.929291 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.929508 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.929592 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.929848 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.929971 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.930150 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.930235 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.930515 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.930602 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.930851 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.930941 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.931169 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.931295 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.931491 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.931584 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.931803 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.931887 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.932117 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.932201 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.932424 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.932517 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.932736 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.932820 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.933046 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.933130 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.933356 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.933451 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.933699 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.933784 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.933983 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.934066 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.934301 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.934415 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.934641 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.934770 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.934960 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.935048 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.935268 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.935371 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.935587 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.935671 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.935947 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.936031 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.936265 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.936359 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.936603 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.936699 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.936934 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.937017 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.937253 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.937353 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.937570 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.937655 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.937878 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.937961 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.938191 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.938274 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.938528 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.938632 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.938836 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.938920 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.939146 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.939232 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.939453 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.939543 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.939770 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.939874 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.940080 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.940172 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.940395 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.940487 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.940701 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.940801 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.941022 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.941112 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.941327 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.941410 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.941652 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.943393 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.943393 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.943577 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.943658 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.943852 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.943937 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.944026 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.944105 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.944183 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.944259 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.944336 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.944421 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.944631 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.944725 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.944804 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.945272 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.945354 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.945447 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.945527 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.945604 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.945789 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.945870 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.945947 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.946106 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.946190 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.946267 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.946345 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.946440 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.946535 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.946624 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.946711 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.946789 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.946866 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.946969 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.947060 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.947147 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.947232 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.947507 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.947603 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.948228 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.948542 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.948626 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949102 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949192 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949261 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949410 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949478 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949550 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949623 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949695 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949760 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949832 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949911 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.949977 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.950041 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.950144 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.950347 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.950462 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.950715 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.950852 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.951000 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.951096 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.951371 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.951541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.951636 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.951703 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.952026 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.952237 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.952413 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.952543 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.952682 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.952810 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.952958 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.953087 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.953222 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.953358 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.953493 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.953619 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.953816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.953969 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.954138 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.954284 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.954443 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.954546 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.954761 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.954892 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.955057 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.955173 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.955367 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.955482 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.955721 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.955863 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.955939 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.956018 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.956283 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.956413 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.956591 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.956740 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.956894 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.956994 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.957199 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.957288 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.957529 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.957675 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.957810 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.957933 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.958123 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.958252 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.958464 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.958592 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.958773 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.958929 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.959346 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.959438 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.959681 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.959780 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.959995 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.960083 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.960308 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.960394 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.960654 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.960750 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.960961 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.961139 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.961271 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.961400 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.961601 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.961738 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.961912 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.962041 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.962217 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.962348 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.962550 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.962688 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.962919 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.963086 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.963222 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.963354 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.963507 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.963657 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.963797 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.963924 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.964051 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.964189 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.964320 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.964449 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.964607 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.964698 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.964982 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.965090 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.965271 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.965364 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.965486 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.965667 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.965788 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.965873 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.966101 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.966194 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.966421 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.966509 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.966734 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.966828 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.967119 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.967255 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.967620 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.967756 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.967756 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.967899 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.968447 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.968567 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.968567 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.968709 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.968777 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.968841 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.968971 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.969066 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.969273 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.969368 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.969609 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.969693 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.969936 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.970020 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.974028 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.974299 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.974299 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.974625 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.974793 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.975024 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.975173 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.975321 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.975444 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.975601 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.975752 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.975890 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.976028 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.976175 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.976315 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.976468 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.976621 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.976764 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.976891 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.977032 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.977157 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.977245 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.977245 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.977379 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.977485 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.977597 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.977668 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.977749 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.977824 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.977898 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.977987 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.978113 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.978238 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.978325 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.978429 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.978635 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.978724 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.978813 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.978923 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.979010 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.979085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.979158 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.979237 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.979312 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.979387 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.979453 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.979516 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.979711 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.979783 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.979871 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.979978 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.980048 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.980127 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.980204 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.980269 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.980380 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.980465 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.980532 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.980616 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.980753 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.980892 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.981044 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.981199 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.981335 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.981472 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.981618 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.981771 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.981976 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.982121 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.982432 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.982577 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.982717 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.983064 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.983240 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.983399 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.983554 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.983700 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.983848 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.984061 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.984226 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.984378 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.984507 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.984630 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.984712 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.984800 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.984880 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.984957 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.985101 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.985184 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.985261 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.985347 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.985425 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.985512 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.985592 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.985667 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.985732 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.985807 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.985885 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.985950 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.986027 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.986092 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.986163 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.986249 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.986327 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.986486 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.986583 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.986663 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.986742 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.986822 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.987058 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.987191 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.987372 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.987540 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.987646 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.987729 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.987970 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.988150 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.988274 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.988423 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.988607 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.988740 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.988934 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.989036 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.989266 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.989410 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.989546 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.989650 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.989890 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.990040 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.990205 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.990348 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.990509 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.990595 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.990835 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.990984 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.991145 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.991365 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.991443 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.991517 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.991727 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.991859 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.992056 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.992185 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.992357 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.992502 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.992633 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.992722 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.992993 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.993099 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.993260 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.993348 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.993753 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.993852 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.994155 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.994244 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.994310 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.994409 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.994508 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.994588 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.994818 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.994910 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.995162 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.995267 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.995428 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.995516 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.995740 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.995831 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.996040 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.996133 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.996346 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.996432 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.996652 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.996741 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.996962 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.997058 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.997281 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.997376 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.997576 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.997663 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.997884 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.997970 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.998249 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.998432 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.998579 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.998667 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.998893 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.998986 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.999196 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.999294 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.999499 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.999583 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.999820 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:14.999904 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.000127 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.000225 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.000430 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.000513 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.000734 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.000816 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.001037 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.001133 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.001341 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.001460 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.001645 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.001783 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.002086 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.002176 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.002405 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.002499 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.002712 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.002795 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.003015 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.003105 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.003325 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.003408 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.003633 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.003715 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.003946 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.004035 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.004251 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.004354 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.004550 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.004667 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.004967 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.005060 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.005280 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.005376 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.005589 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.005684 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.005892 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.005982 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.006197 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.006280 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.006524 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.006623 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.006837 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.006929 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.007143 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.007225 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.007448 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.007540 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.007748 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.007830 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.008051 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.008134 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.008364 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.008458 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.008664 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.008747 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.008982 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.009073 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.009387 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.009469 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.009694 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.009785 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.010007 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.010178 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.010430 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.010516 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.010744 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.010847 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.011056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.011157 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.011377 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.011481 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.011698 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.011788 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.012002 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.012093 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.012312 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.012402 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.012620 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.012717 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.012930 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.013028 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.013250 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.013341 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.013560 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.013673 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.013897 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.013991 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.014201 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.014315 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.014531 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.014622 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.014852 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.014947 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.015165 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.015256 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.015477 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.015576 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.015800 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.015885 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.016202 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.016299 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.016514 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.016599 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.016831 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.016943 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.017151 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.017301 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.017469 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.017564 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.017765 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.017912 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.018069 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.018157 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.018408 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.018509 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.018705 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.018834 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.019004 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.019116 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.019315 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.019436 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.019617 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.019730 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.019928 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.020021 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.020237 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.020321 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.020540 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.020632 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.020843 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.020935 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.021151 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.021236 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.021453 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.021545 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.021771 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.021879 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.022083 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.022174 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.022414 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.022567 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.022736 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.022821 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.023042 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.023135 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.023344 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.023438 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.023661 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.023746 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.023965 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.024050 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.024267 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.024361 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.024572 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.024671 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.024938 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.025024 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.025203 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.025298 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.025509 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.025602 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.025832 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.025936 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.026164 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.026300 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.026493 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.026598 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.026813 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.026957 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.027141 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.027250 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.027463 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.027559 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.027774 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.027876 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.028082 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.028173 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.028401 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.028552 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.028703 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.028834 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.029010 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.029096 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.029338 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.029441 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.029696 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.029795 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.030001 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.030089 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.030313 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.030420 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.030646 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.030786 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.030938 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.031032 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.031239 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.031339 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.031539 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.031622 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.031843 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.031934 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.032147 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.032229 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.032455 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.032538 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.032761 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.032852 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.033064 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.033154 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.033365 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.033448 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.033662 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.033744 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.033963 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.034052 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.034294 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.034398 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.034648 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.034775 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.034957 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.035054 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.035281 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.035373 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.035601 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.035691 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.035942 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.036036 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.036259 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.036343 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.036576 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.036660 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.036893 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.036991 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.037203 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.037286 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.037516 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.037599 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.037825 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.038000 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.038134 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.038218 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.038533 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.038628 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.038785 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.038970 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.039172 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.039353 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.039653 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.039755 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.039984 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.040081 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.040293 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.040377 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.040603 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.040733 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.040913 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.041001 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.041223 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.041309 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.041533 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.041616 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.041841 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.041932 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.042152 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.042238 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.042486 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.042623 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.042801 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.042889 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.043121 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.043212 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.043440 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.043532 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.043764 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.043856 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.044081 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.044170 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.044395 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.044491 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.044707 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.044797 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.045056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.045151 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.045369 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.045457 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.045711 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.045794 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.046021 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.046152 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.046327 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.046460 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.046664 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.046762 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.046979 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.047073 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.047288 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.047381 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.047598 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.047682 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.047911 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.048020 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.048221 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.048305 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.048526 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.048618 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.048872 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.049008 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.049252 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.049384 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.049566 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.049708 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.049892 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.050029 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.050226 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.050358 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.050571 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.050885 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.050994 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.051076 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.051194 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.051354 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.051509 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.051673 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.051992 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.052082 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.052331 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.052516 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.052664 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.052831 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.052989 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.053274 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.053364 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.053505 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.053691 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.053865 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.053993 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.054130 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.054219 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.054465 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.054554 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.054798 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.054987 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.055110 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.055196 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.055417 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.055511 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.055719 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.055812 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.056034 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.056119 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.056340 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.056440 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.056660 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.056754 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.056963 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.057056 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.057268 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.057487 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.057587 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.057797 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.057883 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.058152 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.058440 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.058543 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.058799 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.058893 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.059118 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.059244 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.059435 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.059522 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.059745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.059830 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.060067 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.060160 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.060372 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.060457 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.060753 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.060841 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.061064 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.061150 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.061372 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.061459 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.061676 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.061760 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.061983 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.062079 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.062289 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.062410 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.062618 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.062706 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.062924 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.063023 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.063233 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.063316 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.063534 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.063628 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.063842 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.063941 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.064148 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.064234 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.064453 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.064536 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.064758 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.064859 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.065064 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.065160 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.065365 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.065512 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.065667 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.065821 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.065969 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.066053 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.066269 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.066353 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.066599 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.066685 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.066902 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.066985 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.067211 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.067294 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.067553 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.067733 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.067821 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.067914 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.068119 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.068253 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.068545 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.068631 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.068857 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.069184 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.069290 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.069495 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.069740 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.069828 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.070058 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.070144 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.070423 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.070529 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.070730 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.070825 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.071041 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.071129 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.071359 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.071484 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.071670 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.071756 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.071998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.072085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.072328 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.072555 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.072646 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.072888 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.073037 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.073214 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.073300 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.073554 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.073828 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.073915 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.074171 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.074267 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.074503 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.074694 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.074878 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.074965 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.075127 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.075247 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.075645 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.075750 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.075853 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.075921 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.076039 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.076148 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.076378 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.076480 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.076698 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.076782 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.077008 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.077178 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.077319 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.077395 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.078092 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.078176 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.078176 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.078304 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.078397 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.078467 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.078555 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.078634 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.079115 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.079233 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.079233 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.079371 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.079532 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.079618 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.079780 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.079856 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.080093 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.080177 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.080407 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.080482 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.080721 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.080806 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.081035 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.081115 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.081659 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.081770 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.081972 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.082537 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.082665 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.082748 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.082827 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.083293 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.083401 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.083471 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.083549 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.083626 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.083701 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.083788 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.083867 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.083944 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.084020 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.084098 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.084098 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.084432 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.084517 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.084750 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.084843 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.085058 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.085150 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.085433 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.085759 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.085941 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.086070 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.086157 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.086432 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.086521 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.086966 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.087056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.087124 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.087201 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.087336 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.087423 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.087911 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.088007 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.088007 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.088160 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.088289 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.088385 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.088602 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.088694 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.088936 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.089075 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.089226 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.089337 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.089527 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.089636 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.089841 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.089948 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.090158 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.090244 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.090492 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.090580 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.091161 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.091265 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.091343 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.091431 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.091510 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.091598 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.091685 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.092181 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.092181 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.092319 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.092384 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.092546 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.092673 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.092864 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.093056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.093212 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.093338 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.093459 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.093601 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.093758 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.093962 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.094101 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.094231 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.094355 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.094558 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.094706 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.094834 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.094966 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.095097 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.095245 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.095427 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.095632 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.095774 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.095911 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.096127 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.096277 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.096408 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.096534 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.096650 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.096773 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.096913 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.097053 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.097192 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.097317 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.097451 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.097624 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.097765 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.097947 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.098085 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.098254 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.098760 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.098969 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.099105 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.099280 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.099403 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.099592 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.099715 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.099916 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.100070 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.100226 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.100363 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.100535 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.100648 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.100855 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.101005 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.101164 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.101348 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.101491 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.101606 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.101775 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.101911 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.102087 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.102220 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.102455 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.102605 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.102784 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.102951 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.103086 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.103194 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.103309 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.103436 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.103620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.103732 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.103950 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.104078 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.104267 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.104386 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.104615 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.104732 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.104889 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.105019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.105197 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.105333 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.105520 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.105688 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.105812 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.105922 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.106126 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.106270 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.106461 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.106602 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.106774 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.106897 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.107088 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.107207 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.107436 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.107558 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.107751 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.107888 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.108061 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.108180 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.108379 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.108505 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.108686 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.108810 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.109002 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.109120 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.109317 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.109440 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.109629 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.109746 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.109955 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.110139 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.110260 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.110455 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.110584 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.110717 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.110917 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.111050 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.111246 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.111373 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.111596 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.111735 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.111908 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.112033 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.112223 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.112362 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.112532 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.112673 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.112795 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:49:15.112905 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.113167 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.113475 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:15.113720 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:49:15.269055 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO dbcounter [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Registered counter for database nova_api Sep 13 19:49:15.271276 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO dbcounter [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Registered counter for database nova_api Sep 13 19:49:15.290628 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_db.sqlalchemy.engines [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:15.297683 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writer thread running {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:15.300145 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG oslo_db.sqlalchemy.engines [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:15.306789 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG dbcounter [-] [105592] Writer thread running {{(pid=105592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:15.355721 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.context [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6(cell1) {{(pid=105593) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 19:49:15.359737 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:15.360191 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:15.361826 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:15.362600 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:15.363028 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:15.365047 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:15.366838 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.context [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6(cell1) {{(pid=105592) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 19:49:15.367145 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO dbcounter [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Registered counter for database nova_cell0 Sep 13 19:49:15.371425 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO dbcounter [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Registered counter for database nova_cell1 Sep 13 19:49:15.373245 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG oslo_concurrency.lockutils [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:15.373959 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG oslo_concurrency.lockutils [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:15.376963 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG oslo_concurrency.lockutils [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:15.379926 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG oslo_concurrency.lockutils [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:15.379926 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG oslo_concurrency.lockutils [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:15.380702 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_db.sqlalchemy.engines [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:15.381663 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_db.sqlalchemy.engines [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:15.383067 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG oslo_concurrency.lockutils [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:15.385258 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO dbcounter [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Registered counter for database nova_cell0 Sep 13 19:49:15.389851 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO dbcounter [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Registered counter for database nova_cell1 Sep 13 19:49:15.392503 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writer thread running {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:15.395610 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writer thread running {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:15.398786 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG oslo_db.sqlalchemy.engines [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:15.402828 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG oslo_db.sqlalchemy.engines [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:15.405524 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG dbcounter [-] [105592] Writer thread running {{(pid=105592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:15.535961 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO dbcounter [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Registered counter for database nova_cell0 Sep 13 19:49:15.543330 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG dbcounter [-] [105592] Writer thread running {{(pid=105592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:15.545961 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_db.sqlalchemy.engines [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:15.550884 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writer thread running {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:15.553915 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO dbcounter [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Registered counter for database nova_cell0 Sep 13 19:49:15.562994 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG oslo_db.sqlalchemy.engines [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:15.568431 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG dbcounter [-] [105592] Writer thread running {{(pid=105592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:15.884158 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: WARNING keystonemiddleware.auth_token [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:49:15.885027 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: WARNING keystonemiddleware.auth_token [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:49:15.891580 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: WARNING keystonemiddleware.auth_token [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:49:15.892498 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: WARNING keystonemiddleware.auth_token [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:49:16.233236 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: WARNING keystonemiddleware.auth_token [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:49:16.233919 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: WARNING keystonemiddleware.auth_token [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:49:16.239401 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: WARNING keystonemiddleware.auth_token [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:49:16.239946 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: WARNING keystonemiddleware.auth_token [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:49:16.244683 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd730e29c0 pid: 105592 (default app) Sep 13 19:49:16.245272 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd730e29c0 pid: 105593 (default app) Sep 13 19:49:16.246842 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:16.248192 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-08da107d-b663-4d50-b0f7-b49baa10bffc None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001843 Sep 13 19:49:16.248613 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Tue Sep 13 19:49:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:48.367577 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:48.368955 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Sep 13 19:50:48.369436 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:50:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:50:48.381876 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG dbcounter [-] [105592] Writing DB stats nova_api:SELECT=3 {{(pid=105592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:48.383554 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG dbcounter [-] [105592] Writing DB stats nova_cell1:SELECT=3 {{(pid=105592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:48.384330 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG dbcounter [-] [105592] Writing DB stats nova_cell0:SELECT=3 {{(pid=105592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:48.385274 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG dbcounter [-] [105592] Writing DB stats nova_cell0:SELECT=3 {{(pid=105592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:49.511932 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-cbc54c6e-4d60-4b20-9064-b4eeca70d17e admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:49.555618 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-cbc54c6e-4d60-4b20-9064-b4eeca70d17e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.179370 Sep 13 19:50:49.556163 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 13 19:50:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:52.319359 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:52.320909 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-a4946b7b-c750-4bc6-b68e-68214732bf2f None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002808 Sep 13 19:50:52.323126 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 2/4] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:50:52 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:52.956520 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-62337cbf-2e77-4b55-8ed3-4519f7f459ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:53.048827 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-62337cbf-2e77-4b55-8ed3-4519f7f459ca admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.720073 Sep 13 19:50:53.049851 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 3/5] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 13 19:50:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:50:53.070499 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writing DB stats nova_api:SELECT=3 {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:53.071619 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writing DB stats nova_cell0:SELECT=3 {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:53.073830 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writing DB stats nova_cell1:SELECT=3 {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:53.074791 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:53.338935 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-aa23d4e4-0f11-4753-b3ed-6bc1037f08a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:53.456208 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-aa23d4e4-0f11-4753-b3ed-6bc1037f08a6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.392667 Sep 13 19:50:53.456812 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 3/6] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Sep 13 19:50:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:56.324024 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-62337cbf-2e77-4b55-8ed3-4519f7f459ca admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:56.331561 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-62337cbf-2e77-4b55-8ed3-4519f7f459ca admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.007777 Sep 13 19:50:56.338351 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 4/7] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:50:56 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:57.410849 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-09abc59e-e56e-48a7-a604-4c4dbb650fc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "ram": 512}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:57.476035 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-09abc59e-e56e-48a7-a604-4c4dbb650fc2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.135945 Sep 13 19:50:57.477097 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 4/8] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 13 19:50:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:50:57.494751 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-3cd27234-a65a-4c46-b565-1e06c0e37568 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:57.555850 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-3cd27234-a65a-4c46-b565-1e06c0e37568 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069399 Sep 13 19:50:57.557448 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 5/9] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Sep 13 19:50:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:01.060460 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-09abc59e-e56e-48a7-a604-4c4dbb650fc2 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:01.062225 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-09abc59e-e56e-48a7-a604-4c4dbb650fc2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002220 Sep 13 19:51:01.063024 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:51:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:01.732574 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-31d06846-d20c-4175-9022-acd74ba85cc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "id": "d2", "vcpus": 1}} {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:01.761199 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-31d06846-d20c-4175-9022-acd74ba85cc5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.686061 Sep 13 19:51:01.761841 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 6/11] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 13 19:51:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:51:01.779564 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-57ff2883-14eb-462a-89c1-f39d551a5c1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:01.823215 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-57ff2883-14eb-462a-89c1-f39d551a5c1f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049257 Sep 13 19:51:01.824219 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 6/12] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Sep 13 19:51:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:05.596014 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-31d06846-d20c-4175-9022-acd74ba85cc5 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:05.597283 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-31d06846-d20c-4175-9022-acd74ba85cc5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 13 19:51:05.600337 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 7/13] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:51:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:51:06.124979 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-ee82275f-0815-451d-9dd5-8ac27973a729 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:06.157452 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-ee82275f-0815-451d-9dd5-8ac27973a729 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.553093 Sep 13 19:51:06.158565 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 7/14] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 13 19:51:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:51:06.178626 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-482c1a02-4756-49a1-b271-6b6954740aee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:06.216199 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-482c1a02-4756-49a1-b271-6b6954740aee admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043701 Sep 13 19:51:06.216835 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 8/15] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Sep 13 19:51:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:09.385697 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-ee82275f-0815-451d-9dd5-8ac27973a729 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:09.386794 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-ee82275f-0815-451d-9dd5-8ac27973a729 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Sep 13 19:51:09.387432 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 8/16] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:51:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:51:09.993414 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-79669084-1038-4081-bec7-dac970a94361 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "name": "ds4G", "ram": 4096}} {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:10.020402 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-79669084-1038-4081-bec7-dac970a94361 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.620772 Sep 13 19:51:10.022444 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 9/17] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 13 19:51:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:51:10.042099 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-75d678d4-9316-45d9-950c-10fe9febd1a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:10.095864 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-75d678d4-9316-45d9-950c-10fe9febd1a3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064246 Sep 13 19:51:10.096833 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 9/18] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Sep 13 19:51:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:13.677838 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-79669084-1038-4081-bec7-dac970a94361 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:13.679235 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-79669084-1038-4081-bec7-dac970a94361 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002301 Sep 13 19:51:13.679813 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 10/19] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:51:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:14.271232 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-7fce7142-81f8-4768-9feb-bc7eef54d24c admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:14.310544 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-7fce7142-81f8-4768-9feb-bc7eef54d24c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.621771 Sep 13 19:51:14.311095 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 13 19:51:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:17.227829 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-79669084-1038-4081-bec7-dac970a94361 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:17.229196 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-79669084-1038-4081-bec7-dac970a94361 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001830 Sep 13 19:51:17.229689 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 11/21] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:51:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:51:17.728571 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-40eeda6e-c6a0-46d8-8305-edefe9b80c65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "1"}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:17.753536 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-40eeda6e-c6a0-46d8-8305-edefe9b80c65 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.516029 Sep 13 19:51:17.758442 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 11/22] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 13 19:51:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:51:17.769709 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-61807f54-f073-46c6-86ff-162f0458d47b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:17.802106 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-61807f54-f073-46c6-86ff-162f0458d47b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038352 Sep 13 19:51:17.802755 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 12/23] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Sep 13 19:51:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:20.640137 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-40eeda6e-c6a0-46d8-8305-edefe9b80c65 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:20.643368 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-40eeda6e-c6a0-46d8-8305-edefe9b80c65 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003863 Sep 13 19:51:20.644116 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:51:20 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:21.330885 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-754d7b11-ec5c-4b9f-863e-df4897a721cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "name": "m1.small", "ram": 2048, "id": "2"}} {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:21.339716 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG dbcounter [-] [105592] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:21.368726 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-754d7b11-ec5c-4b9f-863e-df4897a721cd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.717065 Sep 13 19:51:21.369710 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 13/25] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 13 19:51:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:51:21.386419 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-cc82deff-b50e-4768-88e7-1698927d18cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:21.429413 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-cc82deff-b50e-4768-88e7-1698927d18cb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049484 Sep 13 19:51:21.430404 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 13/26] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Sep 13 19:51:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:24.743213 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-754d7b11-ec5c-4b9f-863e-df4897a721cd admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:24.744382 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-754d7b11-ec5c-4b9f-863e-df4897a721cd admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001648 Sep 13 19:51:24.744820 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:51:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:25.394735 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-8eed3125-64eb-4135-b20e-817cd80dd177 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:25.408799 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:25.450679 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-8eed3125-64eb-4135-b20e-817cd80dd177 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.697963 Sep 13 19:51:25.470539 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 14/28] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 13 19:51:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:51:25.477505 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-344339d9-8f6d-41a6-9ec1-9a3647262b0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:25.513458 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-344339d9-8f6d-41a6-9ec1-9a3647262b0d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041184 Sep 13 19:51:25.514866 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 15/29] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Sep 13 19:51:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:28.715888 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-8eed3125-64eb-4135-b20e-817cd80dd177 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:28.718047 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-8eed3125-64eb-4135-b20e-817cd80dd177 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002777 Sep 13 19:51:28.718832 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 15/30] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:29.386044 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-c358219b-2a7e-4167-9b5e-f0fc37f56676 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "disk": 80}} {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:29.442860 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-c358219b-2a7e-4167-9b5e-f0fc37f56676 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.714281 Sep 13 19:51:29.450409 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 16/31] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 13 19:51:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:51:29.457057 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-41e65d1a-e040-451d-a20f-74e3e9bc895f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:29.493195 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-41e65d1a-e040-451d-a20f-74e3e9bc895f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040414 Sep 13 19:51:29.504971 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 16/32] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Sep 13 19:51:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:32.652914 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-c358219b-2a7e-4167-9b5e-f0fc37f56676 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:32.654310 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-c358219b-2a7e-4167-9b5e-f0fc37f56676 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002094 Sep 13 19:51:32.656047 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 17/33] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:33.501491 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-3980f1d4-5a20-49fe-943c-c72b6c8832a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "ram": 16384, "vcpus": 8, "swap": 0, "name": "m1.xlarge"}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:33.541429 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-3980f1d4-5a20-49fe-943c-c72b6c8832a9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.876682 Sep 13 19:51:33.554444 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 17/34] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 13 19:51:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:51:33.562769 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-f4dbb0e1-5f1c-45d7-b78d-e00969d788b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:33.600420 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-f4dbb0e1-5f1c-45d7-b78d-e00969d788b0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043544 Sep 13 19:51:33.601104 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 18/35] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Sep 13 19:51:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:48.132667 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-3980f1d4-5a20-49fe-943c-c72b6c8832a9 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:48.133588 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-3980f1d4-5a20-49fe-943c-c72b6c8832a9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 13 19:51:48.133987 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 18/36] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:51:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:48.148470 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG dbcounter [-] [105592] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:48.579933 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-7b2f2c07-ef7e-4892-a584-3f798a56904d admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:48.603057 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-7b2f2c07-ef7e-4892-a584-3f798a56904d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.461180 Sep 13 19:51:48.603614 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 19/37] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 13 19:51:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:49.977443 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-3980f1d4-5a20-49fe-943c-c72b6c8832a9 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:49.978690 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-3980f1d4-5a20-49fe-943c-c72b6c8832a9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001846 Sep 13 19:51:49.979205 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 19/38] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 13 19:51:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:50.552848 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-e3e51db6-0eec-4ce3-b87e-cbcf49be5930 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:50.558664 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.wsgi [None req-e3e51db6-0eec-4ce3-b87e-cbcf49be5930 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-e3e51db6-0eec-4ce3-b87e-cbcf49be5930 admin admin] Request method failure captured: Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Accept: application/json Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Accept-Encoding: gzip, deflate Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Connection: keep-alive Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Content-Length: 0 Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Host: 10.222.0.52 Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Openstack-Api-Version: compute 2.92 Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Openstack-System-Scope: None Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: User-Agent: python-novaclient Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Auth-Token: gAAAAABjIN9VOlUZS0IXoixoeALiaZxqtnZIZoTChgRKhVyDcIvA0PcO5DVJ971CpVDD4lc4NUcOj7E7wfXPgtmojLtm8uMkatWM7wQr2FlUCDL4iZHjXz--oEQTx6xF21Ktk7NOUSRUCnrnflsT2c5mxrVdw6T3mjQY9xmnzvAiletuW8Nf9Q0 Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Domain-Id: None Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Domain-Name: None Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Identity-Status: Confirmed Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Is-Admin-Project: True Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Project-Domain-Id: default Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Project-Domain-Name: Default Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Project-Id: 02e765af7d454a8f9fe205c67fe1fdbb Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Project-Name: admin Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Role: reader,admin,member Sep 13 19:51:50.561833 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Roles: reader,admin,member Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/02e765af7d454a8f9fe205c67fe1fdbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_02e765af7d454a8f9fe205c67fe1fdbb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02e765af7d454a8f9fe205c67fe1fdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02e765af7d454a8f9fe205c67fe1fdbb"}]}] Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Tenant: admin Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Tenant-Id: 02e765af7d454a8f9fe205c67fe1fdbb Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Tenant-Name: admin Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User: admin Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User-Domain-Id: default Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User-Domain-Name: Default Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User-Id: 0f81252e23c341beb35dc2c378ed375c Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User-Name: admin Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: method: > Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: exception: Flavor 42 could not be found. Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: action_args: {'id': '42'} Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:51:50.563456 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:50.564541 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:50.566147 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-e3e51db6-0eec-4ce3-b87e-cbcf49be5930 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:51:50.567971 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-e3e51db6-0eec-4ce3-b87e-cbcf49be5930 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.436558 Sep 13 19:51:50.567971 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 20/39] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Sep 13 19:51:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:50.574822 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-df9ddfa2-d1cf-4c7d-83ec-b0d54877275e admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:50.580597 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:50.603966 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-df9ddfa2-d1cf-4c7d-83ec-b0d54877275e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.033851 Sep 13 19:51:50.604543 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 20/40] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Sep 13 19:51:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:50.615699 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-a83312c7-ce04-4dbb-b260-f1ef869497da admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:50.638647 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-a83312c7-ce04-4dbb-b260-f1ef869497da admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027537 Sep 13 19:51:50.639200 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 21/41] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Sep 13 19:51:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:50.649733 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-53a6f93f-a0e4-4886-92a8-23aae4a7b132 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:50.655542 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.wsgi [None req-53a6f93f-a0e4-4886-92a8-23aae4a7b132 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-53a6f93f-a0e4-4886-92a8-23aae4a7b132 admin admin] Request method failure captured: Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Accept: application/json Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Accept-Encoding: gzip, deflate Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Connection: keep-alive Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Content-Length: 0 Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Host: 10.222.0.52 Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Openstack-Api-Version: compute 2.92 Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Openstack-System-Scope: None Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: User-Agent: python-novaclient Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Auth-Token: gAAAAABjIN9VOlUZS0IXoixoeALiaZxqtnZIZoTChgRKhVyDcIvA0PcO5DVJ971CpVDD4lc4NUcOj7E7wfXPgtmojLtm8uMkatWM7wQr2FlUCDL4iZHjXz--oEQTx6xF21Ktk7NOUSRUCnrnflsT2c5mxrVdw6T3mjQY9xmnzvAiletuW8Nf9Q0 Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Domain-Id: None Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Domain-Name: None Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Identity-Status: Confirmed Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Is-Admin-Project: True Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Project-Domain-Id: default Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Project-Domain-Name: Default Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Project-Id: 02e765af7d454a8f9fe205c67fe1fdbb Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Project-Name: admin Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Role: reader,admin,member Sep 13 19:51:50.658962 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Roles: reader,admin,member Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/02e765af7d454a8f9fe205c67fe1fdbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_02e765af7d454a8f9fe205c67fe1fdbb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02e765af7d454a8f9fe205c67fe1fdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02e765af7d454a8f9fe205c67fe1fdbb"}]}] Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Tenant: admin Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Tenant-Id: 02e765af7d454a8f9fe205c67fe1fdbb Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Tenant-Name: admin Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User: admin Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User-Domain-Id: default Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User-Domain-Name: Default Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User-Id: 0f81252e23c341beb35dc2c378ed375c Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User-Name: admin Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: method: > Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: exception: Flavor 42 could not be found. Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: action_args: {'id': '42'} Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:51:50.660522 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:50.661541 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:50.663019 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-53a6f93f-a0e4-4886-92a8-23aae4a7b132 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:51:50.664239 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-53a6f93f-a0e4-4886-92a8-23aae4a7b132 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015043 Sep 13 19:51:50.664239 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 21/42] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Sep 13 19:51:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:51.927954 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-a83312c7-ce04-4dbb-b260-f1ef869497da admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:51.929046 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-a83312c7-ce04-4dbb-b260-f1ef869497da admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 13 19:51:51.929433 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 22/43] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 13 19:51:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:52.530226 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-15090c0b-e91b-488c-858f-09f1c659408b admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:52.535772 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.wsgi [None req-15090c0b-e91b-488c-858f-09f1c659408b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-15090c0b-e91b-488c-858f-09f1c659408b admin admin] Request method failure captured: Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Accept: application/json Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Accept-Encoding: gzip, deflate Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Connection: keep-alive Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Content-Length: 0 Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Host: 10.222.0.52 Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Openstack-Api-Version: compute 2.92 Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Openstack-System-Scope: None Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: User-Agent: python-novaclient Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Auth-Token: gAAAAABjIN9XapMvRViuBBn_Alrz2g6oH3dHHLghg4ehv8OG75vF2N1jF9HCXnEiNxQ2U7eYTf1W6AGvED664OfnxvzSP4WJpqNE9XCW11OH4o05NopQqtlT2PbI76O3fYcpoH_r3vsw-heI52EFYffTL04xBry6AvILnAmxtfbEg717dBMnolU Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Domain-Id: None Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Domain-Name: None Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Identity-Status: Confirmed Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Is-Admin-Project: True Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Project-Domain-Id: default Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Project-Domain-Name: Default Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Project-Id: 02e765af7d454a8f9fe205c67fe1fdbb Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Project-Name: admin Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Role: reader,admin,member Sep 13 19:51:52.537334 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Roles: reader,admin,member Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/02e765af7d454a8f9fe205c67fe1fdbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_02e765af7d454a8f9fe205c67fe1fdbb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02e765af7d454a8f9fe205c67fe1fdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02e765af7d454a8f9fe205c67fe1fdbb"}]}] Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Tenant: admin Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Tenant-Id: 02e765af7d454a8f9fe205c67fe1fdbb Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Tenant-Name: admin Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User: admin Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User-Domain-Id: default Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User-Domain-Name: Default Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User-Id: 0f81252e23c341beb35dc2c378ed375c Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User-Name: admin Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: method: > Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: exception: Flavor 84 could not be found. Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: action_args: {'id': '84'} Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:51:52.540927 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:52.541816 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:52.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-15090c0b-e91b-488c-858f-09f1c659408b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:51:52.544205 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-15090c0b-e91b-488c-858f-09f1c659408b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.471192 Sep 13 19:51:52.544205 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Sep 13 19:51:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 473 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:52.551631 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-a6fadc0d-3799-4c2a-8daa-663679951cf6 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:52.568261 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-a6fadc0d-3799-4c2a-8daa-663679951cf6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020524 Sep 13 19:51:52.568855 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Sep 13 19:51:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:52.579671 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-c60ab8be-1bd3-4446-9d2a-de1ab20a5c7a admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:52.597964 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-c60ab8be-1bd3-4446-9d2a-de1ab20a5c7a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022129 Sep 13 19:51:52.598576 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Sep 13 19:51:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:51:52.608955 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-7e21b40c-c7a9-4d67-a4f0-0e79a9dc2a30 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:52.614466 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.wsgi [None req-7e21b40c-c7a9-4d67-a4f0-0e79a9dc2a30 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-7e21b40c-c7a9-4d67-a4f0-0e79a9dc2a30 admin admin] Request method failure captured: Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Accept: application/json Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Accept-Encoding: gzip, deflate Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Connection: keep-alive Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Content-Length: 0 Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Host: 10.222.0.52 Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Openstack-Api-Version: compute 2.92 Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Openstack-System-Scope: None Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: User-Agent: python-novaclient Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Auth-Token: gAAAAABjIN9XapMvRViuBBn_Alrz2g6oH3dHHLghg4ehv8OG75vF2N1jF9HCXnEiNxQ2U7eYTf1W6AGvED664OfnxvzSP4WJpqNE9XCW11OH4o05NopQqtlT2PbI76O3fYcpoH_r3vsw-heI52EFYffTL04xBry6AvILnAmxtfbEg717dBMnolU Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Domain-Id: None Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Domain-Name: None Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Identity-Status: Confirmed Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Is-Admin-Project: True Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Project-Domain-Id: default Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Project-Domain-Name: Default Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Project-Id: 02e765af7d454a8f9fe205c67fe1fdbb Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Project-Name: admin Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Role: reader,admin,member Sep 13 19:51:52.616197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Roles: reader,admin,member Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/02e765af7d454a8f9fe205c67fe1fdbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_02e765af7d454a8f9fe205c67fe1fdbb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02e765af7d454a8f9fe205c67fe1fdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02e765af7d454a8f9fe205c67fe1fdbb"}]}] Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Tenant: admin Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Tenant-Id: 02e765af7d454a8f9fe205c67fe1fdbb Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Tenant-Name: admin Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User: admin Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User-Domain-Id: default Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User-Domain-Name: Default Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User-Id: 0f81252e23c341beb35dc2c378ed375c Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User-Name: admin Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: method: > Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: exception: Flavor 84 could not be found. Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: action_args: {'id': '84'} Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:51:52.617640 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:52.618624 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:52.628197 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-7e21b40c-c7a9-4d67-a4f0-0e79a9dc2a30 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:51:52.629389 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-7e21b40c-c7a9-4d67-a4f0-0e79a9dc2a30 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012629 Sep 13 19:51:52.629389 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 24/47] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Sep 13 19:51:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:53.877427 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-c60ab8be-1bd3-4446-9d2a-de1ab20a5c7a admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:53.879184 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-c60ab8be-1bd3-4446-9d2a-de1ab20a5c7a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002351 Sep 13 19:51:53.879936 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 24/48] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 13 19:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:54.477098 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-d96713c0-cd79-42a7-b60d-787408187bc1 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:54.483478 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.wsgi [None req-d96713c0-cd79-42a7-b60d-787408187bc1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-d96713c0-cd79-42a7-b60d-787408187bc1 admin admin] Request method failure captured: Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Accept: application/json Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Accept-Encoding: gzip, deflate Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Connection: keep-alive Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Content-Length: 0 Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Host: 10.222.0.52 Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Openstack-Api-Version: compute 2.92 Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Openstack-System-Scope: None Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: User-Agent: python-novaclient Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Auth-Token: gAAAAABjIN9ZwvL7jxIEC299xbEXVsLL0iRBT_IInfup_uItmSedoP-gqltyZEMDYpezl5nqhPWYyMDeRe13X-oOSLXKINkWPm2g1C2_ncAUKlasvVQ8NfcLOvXgExUMijPylqpSUBZQWtHLpH_8cvHzRmWOYG0DUv_liSPkOg-dkzd4cLrfoj4 Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Domain-Id: None Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Domain-Name: None Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Identity-Status: Confirmed Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Is-Admin-Project: True Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Project-Domain-Id: default Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Project-Domain-Name: Default Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Project-Id: 02e765af7d454a8f9fe205c67fe1fdbb Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Project-Name: admin Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Role: reader,admin,member Sep 13 19:51:54.485056 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Roles: reader,admin,member Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/02e765af7d454a8f9fe205c67fe1fdbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_02e765af7d454a8f9fe205c67fe1fdbb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02e765af7d454a8f9fe205c67fe1fdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02e765af7d454a8f9fe205c67fe1fdbb"}]}] Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Tenant: admin Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Tenant-Id: 02e765af7d454a8f9fe205c67fe1fdbb Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-Tenant-Name: admin Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User: admin Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User-Domain-Id: default Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User-Domain-Name: Default Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User-Id: 0f81252e23c341beb35dc2c378ed375c Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: X-User-Name: admin Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: method: > Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: exception: Flavor 451 could not be found. Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: action_args: {'id': '451'} Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:51:54.486672 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:54.487620 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: ERROR nova.api.openstack.wsgi Sep 13 19:51:54.488998 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-d96713c0-cd79-42a7-b60d-787408187bc1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:51:54.490259 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-d96713c0-cd79-42a7-b60d-787408187bc1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.451481 Sep 13 19:51:54.490259 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 25/49] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 13 19:51:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:54.497219 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-657155b8-0c2d-4bdd-b51e-e7a31ca7c694 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:54.513358 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-657155b8-0c2d-4bdd-b51e-e7a31ca7c694 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019686 Sep 13 19:51:54.513906 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 25/50] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Sep 13 19:51:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:54.525580 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:54.542334 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021640 Sep 13 19:51:54.542929 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 26/51] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Sep 13 19:51:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:54.552942 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-97d07e68-b5ec-40d6-be48-635c010784a9 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:54.558389 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.wsgi [None req-97d07e68-b5ec-40d6-be48-635c010784a9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-97d07e68-b5ec-40d6-be48-635c010784a9 admin admin] Request method failure captured: Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Accept: application/json Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Accept-Encoding: gzip, deflate Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Connection: keep-alive Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Content-Length: 0 Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Host: 10.222.0.52 Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Openstack-Api-Version: compute 2.92 Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Openstack-System-Scope: None Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: User-Agent: python-novaclient Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Auth-Token: gAAAAABjIN9ZwvL7jxIEC299xbEXVsLL0iRBT_IInfup_uItmSedoP-gqltyZEMDYpezl5nqhPWYyMDeRe13X-oOSLXKINkWPm2g1C2_ncAUKlasvVQ8NfcLOvXgExUMijPylqpSUBZQWtHLpH_8cvHzRmWOYG0DUv_liSPkOg-dkzd4cLrfoj4 Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Domain-Id: None Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Domain-Name: None Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Identity-Status: Confirmed Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Is-Admin-Project: True Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Project-Domain-Id: default Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Project-Domain-Name: Default Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Project-Id: 02e765af7d454a8f9fe205c67fe1fdbb Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Project-Name: admin Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Role: reader,admin,member Sep 13 19:51:54.559944 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Roles: reader,admin,member Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/02e765af7d454a8f9fe205c67fe1fdbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_02e765af7d454a8f9fe205c67fe1fdbb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02e765af7d454a8f9fe205c67fe1fdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02e765af7d454a8f9fe205c67fe1fdbb"}]}] Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Tenant: admin Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Tenant-Id: 02e765af7d454a8f9fe205c67fe1fdbb Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-Tenant-Name: admin Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User: admin Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User-Domain-Id: default Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User-Domain-Name: Default Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User-Id: 0f81252e23c341beb35dc2c378ed375c Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: X-User-Name: admin Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: method: > Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: exception: Flavor 451 could not be found. Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: action_args: {'id': '451'} Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:51:54.561422 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:54.562745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: ERROR nova.api.openstack.wsgi Sep 13 19:51:54.563998 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-97d07e68-b5ec-40d6-be48-635c010784a9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:51:54.564980 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-97d07e68-b5ec-40d6-be48-635c010784a9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012050 Sep 13 19:51:54.564980 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 26/52] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 13 19:51:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:55.837885 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:55.838965 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Sep 13 19:51:55.839453 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 13 19:51:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:56.540417 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-4c0d4c9a-5f7d-4eea-8701-3929bc98f14a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:56.571120 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-4c0d4c9a-5f7d-4eea-8701-3929bc98f14a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.588547 Sep 13 19:51:56.572214 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 27/54] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Sep 13 19:51:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:51:57.908193 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:57.909194 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 13 19:51:57.909581 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 13 19:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:58.482086 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-e41d6aa1-4e12-4daf-a33c-ef860db02952 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:58.500968 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-e41d6aa1-4e12-4daf-a33c-ef860db02952 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.454146 Sep 13 19:51:58.501515 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 28/56] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Sep 13 19:51:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:51:59.749478 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:59.750614 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 13 19:51:59.751035 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 29/57] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 13 19:51:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:00.340908 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-8ebf6ebe-49f7-46f5-87d9-8aa04f7f1163 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:00.361745 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-8ebf6ebe-49f7-46f5-87d9-8aa04f7f1163 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.471608 Sep 13 19:52:00.362283 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 29/58] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Sep 13 19:51:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:52:01.658926 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:01.660121 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002192 Sep 13 19:52:01.660705 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 30/59] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 13 19:52:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:02.363630 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-abdc74c3-f839-4d6b-aeda-5e4de2688f57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:02.387403 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-abdc74c3-f839-4d6b-aeda-5e4de2688f57 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.585823 Sep 13 19:52:02.387936 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 30/60] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Sep 13 19:52:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:52:03.650997 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:03.651996 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 13 19:52:03.652393 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 31/61] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 13 19:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:04.249573 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-b9648b50-2857-444d-89d9-23403b56ad12 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:04.284682 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-b9648b50-2857-444d-89d9-23403b56ad12 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.495748 Sep 13 19:52:04.285232 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 31/62] 10.222.0.52 () {60 vars in 1202 bytes} [Tue Sep 13 19:52:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:53:04.246326 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:04.247741 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-24249752-4336-4c56-b2f8-310cb9fc1a94 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Sep 13 19:53:04.248453 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 13 19:53:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:04.257526 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:04.709384 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-98ce033f-6010-43cb-b98f-344fd6ea9365 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:04.731807 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-98ce033f-6010-43cb-b98f-344fd6ea9365 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.475684 Sep 13 19:53:04.732417 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 32/64] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 13 19:53:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:04.756411 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG dbcounter [-] [105592] Writing DB stats nova_api:SELECT=14 {{(pid=105592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:04.762220 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-d821b8d4-bdb7-41a9-9421-9ba64e8999a6 admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:04.770475 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-d821b8d4-bdb7-41a9-9421-9ba64e8999a6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015577 Sep 13 19:53:04.770989 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 33/65] 10.222.0.52 () {60 vars in 1283 bytes} [Tue Sep 13 19:53:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:04.784286 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-9de43580-12bb-4628-a83b-9596059443aa admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:04.792817 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-9de43580-12bb-4628-a83b-9596059443aa admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012452 Sep 13 19:53:04.793533 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 33/66] 10.222.0.52 () {60 vars in 1286 bytes} [Tue Sep 13 19:53:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:04.811225 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-f82564eb-73f2-4558-a4ac-aee594ba42df admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:04.822049 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-f82564eb-73f2-4558-a4ac-aee594ba42df admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019495 Sep 13 19:53:04.822781 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 34/67] 10.222.0.52 () {60 vars in 1286 bytes} [Tue Sep 13 19:53:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:04.836493 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-6e454563-a49e-4c8f-a556-6a862f078477 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:04.846413 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-6e454563-a49e-4c8f-a556-6a862f078477 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012690 Sep 13 19:53:04.848458 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 34/68] 10.222.0.52 () {60 vars in 1283 bytes} [Tue Sep 13 19:53:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:11.173930 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-f82564eb-73f2-4558-a4ac-aee594ba42df admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:11.174972 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-f82564eb-73f2-4558-a4ac-aee594ba42df admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 13 19:56:11.175374 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 35/69] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 13 19:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:11.317246 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writing DB stats nova_api:SELECT=6 {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:11.521043 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-77ddd101-e966-4faa-9e53-f31743b6021f admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:11.526252 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-77ddd101-e966-4faa-9e53-f31743b6021f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.526834 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-77ddd101-e966-4faa-9e53-f31743b6021f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.527264 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-77ddd101-e966-4faa-9e53-f31743b6021f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.527981 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-77ddd101-e966-4faa-9e53-f31743b6021f admin admin] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.528417 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-77ddd101-e966-4faa-9e53-f31743b6021f admin admin] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.528825 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-77ddd101-e966-4faa-9e53-f31743b6021f admin admin] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.562847 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-77ddd101-e966-4faa-9e53-f31743b6021f admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.246964 Sep 13 19:56:11.563462 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 35/70] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 13 19:56:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:56:12.726061 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-f82564eb-73f2-4558-a4ac-aee594ba42df admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:12.727115 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-f82564eb-73f2-4558-a4ac-aee594ba42df admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Sep 13 19:56:12.727517 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 36/71] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 13 19:56:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:12.926426 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-e3fe0d9e-3a54-4901-9ca7-bf73fecde25f admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:12.929793 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-e3fe0d9e-3a54-4901-9ca7-bf73fecde25f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:12.930276 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-e3fe0d9e-3a54-4901-9ca7-bf73fecde25f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:12.930725 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-e3fe0d9e-3a54-4901-9ca7-bf73fecde25f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.931409 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-e3fe0d9e-3a54-4901-9ca7-bf73fecde25f admin admin] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:12.931868 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-e3fe0d9e-3a54-4901-9ca7-bf73fecde25f admin admin] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:12.932273 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-e3fe0d9e-3a54-4901-9ca7-bf73fecde25f admin admin] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.952527 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-e3fe0d9e-3a54-4901-9ca7-bf73fecde25f admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.081618 Sep 13 19:56:12.953266 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 36/72] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 13 19:56:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:56:24.529316 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-f82564eb-73f2-4558-a4ac-aee594ba42df admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:24.530819 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-f82564eb-73f2-4558-a4ac-aee594ba42df admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001910 Sep 13 19:56:24.531365 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 37/73] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 13 19:56:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:24.681773 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writing DB stats nova_cell0:SELECT=4 {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:24.682872 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writing DB stats nova_cell1:SELECT=4 {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:24.683992 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG dbcounter [-] [105593] Writing DB stats nova_api:SELECT=8 {{(pid=105593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:24.738753 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-4081e989-a0d2-4aa5-bee9-8f2dd6dd5d32 admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:24.742415 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-4081e989-a0d2-4aa5-bee9-8f2dd6dd5d32 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:24.742911 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-4081e989-a0d2-4aa5-bee9-8f2dd6dd5d32 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:24.743333 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-4081e989-a0d2-4aa5-bee9-8f2dd6dd5d32 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:24.744042 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-4081e989-a0d2-4aa5-bee9-8f2dd6dd5d32 admin admin] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:24.744481 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-4081e989-a0d2-4aa5-bee9-8f2dd6dd5d32 admin admin] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:24.744883 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-4081e989-a0d2-4aa5-bee9-8f2dd6dd5d32 admin admin] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:24.771712 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-4081e989-a0d2-4aa5-bee9-8f2dd6dd5d32 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.096572 Sep 13 19:56:24.772281 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 37/74] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 13 19:56:24 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:25.934722 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG nova.api.openstack.wsgi [None req-f82564eb-73f2-4558-a4ac-aee594ba42df admin admin] Calling method '>' {{(pid=105592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:25.935728 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: INFO nova.api.openstack.requestlog [None req-f82564eb-73f2-4558-a4ac-aee594ba42df admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 13 19:56:25.936110 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: [pid: 105592|app: 0|req: 38/75] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 13 19:56:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:26.165611 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG nova.api.openstack.wsgi [None req-18f29dae-639c-4fd3-b8a7-877dc31d517b admin admin] Calling method '>' {{(pid=105593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:26.169164 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-18f29dae-639c-4fd3-b8a7-877dc31d517b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:26.169655 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-18f29dae-639c-4fd3-b8a7-877dc31d517b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:26.170119 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-18f29dae-639c-4fd3-b8a7-877dc31d517b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:26.170860 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-18f29dae-639c-4fd3-b8a7-877dc31d517b admin admin] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:26.171315 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-18f29dae-639c-4fd3-b8a7-877dc31d517b admin admin] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:26.171726 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: DEBUG oslo_concurrency.lockutils [None req-18f29dae-639c-4fd3-b8a7-877dc31d517b admin admin] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:26.195251 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: INFO nova.api.openstack.requestlog [None req-18f29dae-639c-4fd3-b8a7-877dc31d517b admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.112426 Sep 13 19:56:26.195858 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: [pid: 105593|app: 0|req: 38/76] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 13 19:56:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:57:24.985721 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: Tue Sep 13 19:57:24 2022 - graceful shutdown triggered... Sep 13 19:57:24.985256 dv-cinder-854274-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 19:57:24.987586 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: Gracefully killing worker 1 (pid: 105592)... Sep 13 19:57:24.988174 dv-cinder-854274-5-iscsi devstack@n-api.service[105593]: Gracefully killing worker 2 (pid: 105593)... Sep 13 19:57:25.119937 dv-cinder-854274-5-iscsi devstack@n-api.service[105592]: DEBUG dbcounter [-] [105592] Writing DB stats nova_api:SELECT=4 {{(pid=105592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:25.986200 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: worker 1 buried after 1 seconds Sep 13 19:57:25.986200 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: worker 2 buried after 1 seconds Sep 13 19:57:25.986200 dv-cinder-854274-5-iscsi devstack@n-api.service[105591]: goodbye to uWSGI. Sep 13 19:57:25.987970 dv-cinder-854274-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 19:57:25.988849 dv-cinder-854274-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 19:57:25.992256 dv-cinder-854274-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 19:57:26.014012 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 19:57:26.016665 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 19:57:26 2022] *** Sep 13 19:57:26.016665 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 19:57:26.016665 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 19:57:26.016665 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: nodename: dv-cinder-854274-5-iscsi Sep 13 19:57:26.016665 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: machine: x86_64 Sep 13 19:57:26.016665 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: clock source: unix Sep 13 19:57:26.016665 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: pcre jit disabled Sep 13 19:57:26.016665 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: detected number of CPU cores: 4 Sep 13 19:57:26.016665 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: current working directory: / Sep 13 19:57:26.016665 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: detected binary path: /usr/bin/uwsgi-core Sep 13 19:57:26.017973 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: your processes number limit is 47680 Sep 13 19:57:26.017973 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: your memory page size is 4096 bytes Sep 13 19:57:26.017973 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: detected max file descriptor number: 2048 Sep 13 19:57:26.017973 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: lock engine: pthread robust mutexes Sep 13 19:57:26.017973 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: thunder lock: enabled Sep 13 19:57:26.017973 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 19:57:26.017973 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 19:57:26.059216 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: Python main interpreter initialized at 0x55f092e0f9c0 Sep 13 19:57:26.059216 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: python threads support enabled Sep 13 19:57:26.059216 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: your server socket listen backlog is limited to 100 connections Sep 13 19:57:26.059216 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: your mercy for graceful operations on workers is 90 seconds Sep 13 19:57:26.059870 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 19:57:26.059870 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: *** Operational MODE: preforking *** Sep 13 19:57:26.060163 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: *** uWSGI is running in multiple interpreter mode *** Sep 13 19:57:26.060163 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: spawned uWSGI master process (pid: 120828) Sep 13 19:57:26.060362 dv-cinder-854274-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 19:57:26.060999 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: spawned uWSGI worker 1 (pid: 120844, cores: 1) Sep 13 19:57:26.061376 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: spawned uWSGI worker 2 (pid: 120845, cores: 1) Sep 13 19:57:26.061541 dv-cinder-854274-5-iscsi devstack@n-api.service[120828]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 19:57:26.756895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 19:57:26.820535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 19:57:27.956329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:57:27.956329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: from cryptography.utils import int_from_bytes Sep 13 19:57:27.957403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:57:27.957403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: from cryptography.utils import int_from_bytes Sep 13 19:57:28.000557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:57:28.000557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: from cryptography.utils import int_from_bytes Sep 13 19:57:28.001476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:57:28.001476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: from cryptography.utils import int_from_bytes Sep 13 19:57:30.484537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:57:30.486529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:57:30.486529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:57:30.486529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:57:30.486529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:57:30.486529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.487169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.487169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.487334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.487652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.487937 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.488294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.488654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.488987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.489293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.489610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.490102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-5-iscsi {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.490459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.490774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.491095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.491425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.491728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.492051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.492370 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.492881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.493341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.493654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.494243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.494430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.494716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.494960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.495272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.495586 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.495913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.496228 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.496641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-5-iscsi {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.496962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.497297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.497589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.498009 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.498331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.498677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.499002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.499324 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.499643 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.499968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.500289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.500610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.500932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.501235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.501548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.501863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.502181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.502513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.502820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.503071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.503379 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.503702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.504067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.504392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.504646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.504928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.505247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.505552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.505838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.506176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.506513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.506793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.507125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.507405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.507738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.508046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.508366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.508656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.509008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.509281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.509630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.510033 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.510284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.510604 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.510948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.511257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.511578 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.511903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.512210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.512528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.512838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.513143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.513464 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.513801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.514106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.514358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.514690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.514997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.515326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.515627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.515945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.516244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.516548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.516853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.517148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.517454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.517764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.518069 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.518403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.518721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.519024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.519336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.519723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.520052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.520375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.520686 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.520996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.521299 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.521605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.521938 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.522246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.522588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.522910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.523216 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.523521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.523840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.524146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.524453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.524811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.525071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.525377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.525704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.526009 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.526319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.526653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.526957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.527263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.527569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.527875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.528303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.528674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.528791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.529120 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.529416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.529703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.530010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.531232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.531232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.531232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.531668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.531668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.531991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.532329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.532654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.532970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.533309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.533661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.533911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.534223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.534566 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.534889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.535296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.535633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.535958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.536284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.536602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.536916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.537237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.537577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.537907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.538224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.538602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.538953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.539271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.539600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.539927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.540242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.540561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.540874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.541222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.541570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.541850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.542172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.542518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.542847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.543163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.543482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.543806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.544115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.544426 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.544770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.545088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.545412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.545729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.546126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.546403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.546691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.547046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.547332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.547610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.547941 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.548253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.548535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.548865 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.549187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.549622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.549780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.550155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.550484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.550825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.551171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.551485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.551792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.552106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.552405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.552700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.553039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.553352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.553656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.553986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.554290 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.554636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.554953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.555269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.555580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.555893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.556202 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.556542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.556844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.557157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.557494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.557825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.558140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.558485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.558824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.559139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.559446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.559756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.560063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.560369 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.560678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.560987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.561280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.561594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.561901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.562202 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.562537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.562854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.563184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.563488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.563797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.564091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.564458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.564766 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.565115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.565445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.565774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.570079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.570079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.570079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.570079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.570079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.570079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.570079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.570079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.571213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.571213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.571213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.571213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.571213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.571213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.571213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.571213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.572150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.572412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.572778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.573112 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.573434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.573760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.574084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.574430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.574748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.575064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.575392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.575709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.576032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.576353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.576691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.577006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.577485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.577807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.578128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.578496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.578853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.579161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.579485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.579798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.580465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.580465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.580755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.581018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.581331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.581642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.581962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.582319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.582666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.582974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.583296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.583611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.583938 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.584219 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.584536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.584878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.585366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.585519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.586674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.586674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.586674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.587114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.587114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.587375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.587639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.587945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.588301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.588613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.588917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.589238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.589553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.589866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.590184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.590529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.590843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.591171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.591488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.591799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.592112 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.592423 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.592734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.593053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.593376 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.593686 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.594000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.594307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.594643 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.594956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.595279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.596246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.596588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.596903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.597227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.597580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.597979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.598315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.598679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.598993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.599305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.599617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.599921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.600227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.600623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.600856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.601166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.601505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.601786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.602140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.603263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.603586 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.603904 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.604229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.604543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.604860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.605172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.605513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.605831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.606163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.606707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.606941 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.607195 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.607441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.607787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.608122 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.608470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.608785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.609089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.609417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.609813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.610039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.610320 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.610947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.611270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.611582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.611897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.612213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.612529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.612846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.613154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.613513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.613823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.614147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.614732 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.615048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.615358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.615673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.615989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.616302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.616618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.616926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.617244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.617552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.617866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.618170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.618694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.619264 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.619406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.619631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.619949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.620256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.620561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.620876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.621181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.621488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.621799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.622126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.622726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.623264 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.624049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.624758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.625334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.625905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.626427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.626878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.627535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.627982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.628551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.629255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.629719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.630158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.630620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.630960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.631291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.631677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.632172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.632563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.632893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.633263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.633610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.633946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.634274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.634644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.634963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.635297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.635623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.635986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.636483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.636714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.636945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.637408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.637725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.638141 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.638628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.638928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.639225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.639548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.639974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.640388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.640722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.641050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.641373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.641698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.642055 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.642399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.642727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.643050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.643379 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.643770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.644014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.644361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.644736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.645053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.645375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.645691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.646013 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.646330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.646833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.647162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.647493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.647812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.648225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.648597 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.649022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.649469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.649816 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.650323 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.650713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.651037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.651361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.651705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.652022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.652344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.652684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.653001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.653318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.653629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.653963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.654280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.654680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.655093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.655416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.655757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.656317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.656623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.657046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.657386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.657725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.658085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.659634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.659634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.659634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.659634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.660556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.660556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.660556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.661212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.661560 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.661918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.666104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.666104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.666104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.666104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.666104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.666104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.666104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.666104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.668400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.668400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.668400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.668400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.668400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.668400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.668400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.668400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.669641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.669641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.669641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.669641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.670398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.670398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.670695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.670853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.671609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.671609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.672275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.672275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.673084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.673084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.673084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.673510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.673707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.673912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.674251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.674620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.674947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.675294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.675633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.675998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.676339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.676651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.676991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.677303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.677614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.677947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.678260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.678638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.678924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.679241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.679752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.680065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.680379 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.681004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.681004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.681351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.681742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.682064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.682400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.682722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.683083 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.683552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.683978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.684316 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.684692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.684977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.685306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.685631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.685957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.686282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.686635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.686961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.687281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.687608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.687959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.688286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.688871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.689216 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.689533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.689943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.690417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.690750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.691074 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.691782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.692122 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.692447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.692770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.693115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.693721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.693959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.694215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.694485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.694818 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.695241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.695496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.695766 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.696089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.696410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.696732 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.697057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.697379 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.697699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.698027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.698349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.698700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.699022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.699339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.700500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.700500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.700500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.701201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.701201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.701201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.701849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.701849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.702434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.702760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.703103 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.703436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.703919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.704251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.704581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.704918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.705234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.705557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.705856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.706175 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.706514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.706990 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.707271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.707503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.707846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.708158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.708752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.709112 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.709437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.709771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.710105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.710455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.710771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.711103 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.711417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.711727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.712050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.712373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.712680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.712992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.713314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.713627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.714051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.714311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.714609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.714910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.715223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.715648 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.715896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.716150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.716458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.716775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.717105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.717392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.717722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.718037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.718495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.718809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.719130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.719491 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.719813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.720126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.720821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.721143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.721455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.721784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.722103 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.722466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.722858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.723178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.723566 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.723868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.724462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.724845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.725159 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.725509 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.725851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.726227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.726651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.726968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.727375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.727793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.728122 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.728444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.728764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.729080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.729400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.729719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.730038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.730357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.730849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.731172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.731492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.731810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.732131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.732463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.732826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.733181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.733477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.734008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.734434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.734834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.735106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.735422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.735740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.736109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.736407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.736733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.737161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.737622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.737831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.738132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.738537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.738861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.740037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.740037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.740037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.740716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.740716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.741113 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.741113 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.741541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.741779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.742048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.742360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.742699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.743017 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.743345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.743662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.743972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.744279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.744695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.744917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.745170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.746431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.746431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.746431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.746431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.746948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.747114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.747303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.747644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.747932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.748253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.748566 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.748878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.749190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.749648 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.749797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.750145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.750667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.750904 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.751194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.751518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.751852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.752169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.752496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.753277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.753607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.753996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.754599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.754924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.755249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.755575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.755899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.756221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.756541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.756892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.757231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.757559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.757895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.758220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.758601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.758936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.759255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.759599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.759917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.760237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.760558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.760886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.761198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.761637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.761876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.762130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.762505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.762821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.763163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.763683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.764003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.764340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.764676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.765037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.765358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.765713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.766051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.766446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.766715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.767019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.767254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:57:30.830619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO dbcounter [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Registered counter for database nova_api Sep 13 19:57:30.846130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:57:30.847010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:57:30.847010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:57:30.847488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:57:30.847658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:57:30.850229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.850229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.850654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.850800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.854043 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.855561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.856217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:57:30.856878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.857538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.858208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.859112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.859832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.860445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-5-iscsi {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.861229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.861810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.862675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.863326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.864208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.864872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.865504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.865628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writer thread running {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:57:30.866691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.867327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.867950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.868581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.869246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.869901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.870589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.871378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.871926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.872546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.873111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.873877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-5-iscsi {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.874531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.875107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.875675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.876468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.877248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.877805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.878413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.879119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.879641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.880088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.880661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.881177 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.881917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.882692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.883259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.883734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.884297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.884821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.885373 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.885790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.886305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.886897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.887483 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.888071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.888596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.889043 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.889614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.890193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.890837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.891334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.891824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.892375 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.892917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.893462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.894017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.894615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.895214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.895787 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.896358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.896916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.897471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.898618 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.898855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.899591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.900211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.900783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.901359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.901923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.902545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.903104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.903666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.904231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.904820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.905447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.906033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.906542 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.907103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.907670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.908307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.908873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.909433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.909987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.910692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.911244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.911807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.912358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.912936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.913472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.914019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.914604 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.915154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.915705 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.916254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.916830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.917418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.917982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.918609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.919128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.919692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.920258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.920799 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.921353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.921926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.922511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.923074 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.923654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.924214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.924816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.925429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.926128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.926706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.927274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.927433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.context [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6(cell1) {{(pid=120845) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 19:57:30.927827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.928384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.928949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.929539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.930096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.930678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.931336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.931764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:30.931918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.932250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:30.932744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.933309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.933898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.934167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:30.934493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.935002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:30.935103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.935463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:30.935575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.936125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:57:30.936717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.937286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.937598 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:30.937883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.938487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.939070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.939648 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.939828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO dbcounter [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Registered counter for database nova_cell0 Sep 13 19:57:30.940229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.940795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.941409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.942025 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.942640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.943224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.943809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.944335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.944820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO dbcounter [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Registered counter for database nova_cell1 Sep 13 19:57:30.944930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.945470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.946054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.946678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.947299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.947843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.948431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.949134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.949740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.950437 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.951225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.951918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.952491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.953049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.953653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.954231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.954963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.955528 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.955929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:57:30.956120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.957203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.957671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.957795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:57:30.958017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.958532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.959064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.959434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.959753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.960236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.960860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.961191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.961547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.961870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.962394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.962812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.963647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.964207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.964789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.965438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.965684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writer thread running {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:57:30.966036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.966155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writer thread running {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:57:30.966550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.967031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.967513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.968000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.968476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.968967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.969461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.969935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.970880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.971342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.971783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.972239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.972824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.973333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.973832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.974320 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.974836 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.975396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.975882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.976366 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.976929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.977408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.977885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.978471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.978931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.979412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.979877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.980396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.980951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.981481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.982018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.982626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.983217 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.983755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.984325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.984957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.985488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.986041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.986623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.987181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.988410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.988410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.989018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.989665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.990225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.990876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.991510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.992066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.992644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.993217 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.993776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.994323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.994915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.995555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.996119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.996753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.997446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.998034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.998714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.999354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:30.999951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.001564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.002332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.002827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.003450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.004068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.004639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.005230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.005806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.006420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.006972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.007547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.008108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.008681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.009285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.009842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.010347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.010932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.011444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.011931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.012424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.012954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.013464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.014006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.014638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.015188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.015757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.016318 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.016916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.017492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.018031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.018635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.019215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.019993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.020608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.021191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.021742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.022312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.022902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.023447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.024120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.024745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.025291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.025887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.026487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.027066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.027631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.028187 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.028775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.029345 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.029908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.030510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.031086 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.031859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.032424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.033134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.033577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.034260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.034835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.035445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.035999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.036546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.037078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.037635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.038243 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.038822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.039363 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.039909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.040527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.041096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.041659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.042211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.042806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.043393 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.043961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.044517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.045095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.045663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.046232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.046845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.047419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.047972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.048544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.049119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.049670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.050225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.050878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.051874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.052511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.053101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.053685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.054296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.054901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.055514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.056101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.056660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.057201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.057750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.058294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.058947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.059455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.060112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.060659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.061271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.061826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.062415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.063040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.063586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.064120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.064685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.065247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.065795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.066484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.067013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.067569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.068143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.068772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.069343 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.070050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.070701 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.071337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.071931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.072560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.073217 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.073844 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.074470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.075124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.075738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.076282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.076841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.077394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.078016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.078878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.079301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.079994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.080616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.081219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.081908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.082922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.083335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.083962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.084508 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.085031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.085596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.086150 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.086715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.087288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.087826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.088389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.088942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.089494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.090038 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.090645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.091219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.091771 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.092379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.092942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.093502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.094067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.094653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.095203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.096118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.096690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.097310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.097932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.098513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.099066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.099617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.100172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.100723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.101291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.101845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.102431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.102989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.103555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.104122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.104988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.105404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.105963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.106602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.107137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.107770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.108355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.108941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.109485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.110057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.110667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.111510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.112063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.112891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.113595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.114185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.114818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.115418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.115957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.116520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.117209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.117762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.118315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.118899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.119484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.120065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.120584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.121157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.121726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.122323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.122918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.123467 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.124019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.124576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.125133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.125696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.126259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.126857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.127429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.128010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.128128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO dbcounter [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Registered counter for database nova_cell0 Sep 13 19:57:31.128568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.129222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.129788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.130328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.130914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.131444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.131975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.132541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.133272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.133608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.134051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.134641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.135203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.135387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:57:31.135769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.136323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.136893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.137447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.138224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.139030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.139489 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.140263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.140571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writer thread running {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:57:31.141654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.141654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.141909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.142732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.143508 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.144056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.144745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.145529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.146074 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.146708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.147489 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.148060 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.148618 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.149367 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.149925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.150514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.151331 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.151684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.152273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.152849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.153439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.154010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.154639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.155237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.155808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.156362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.156918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.157507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.158093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.158707 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.159294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.160066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.160702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.161278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.161877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.162509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.163084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.163644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.164222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.164766 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.165322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.165922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.166502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.167072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.167642 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.168223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.168821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.169318 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.169913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.170513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.171106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.171693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.172275 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.172864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.173434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.174033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.174655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.175218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.175870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.176427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.177065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.177599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.178166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.178801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.179360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.179908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.180520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.181105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.181667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.182238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.182875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.183462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.184023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.184655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.185232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.185866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.186493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.187039 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.187593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.188145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.188702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.189252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.189825 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.190426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.191006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.191544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.192096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.192639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.193304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.193931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.194549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.195149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.195708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.196247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.196888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.197453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.198027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.198629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.199190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.199757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.200319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.200885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.201469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.202062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.202669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.203693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.204292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.204896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.205462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.206022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.206631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.207362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.207934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.208504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.209079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.209639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.210239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.210854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.211439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.212036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.212607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.213175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.213752 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.214319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.214985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.215558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.216119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.216843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.217443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.218018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.218606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.219158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.219723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.220303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.221215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.221773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.222334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.222980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.223589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.224201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.224798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.225381 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.225966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.226582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.227602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.228183 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.228798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.229381 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.229952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.230524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.231057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.231604 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.232122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.232714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.233249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.233788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.234325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.234927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.235519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.236001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.236561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.237092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.238094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.238914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.239482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.240062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.240642 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.241220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.241793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.242359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.242920 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.243459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.244026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.244584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.245118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.245666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.246227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.246821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.247347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.247895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.248446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.249037 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.249575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.250126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.250726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.251297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.251805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.252350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.252890 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.253432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.254038 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.254620 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.255168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.255698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.256255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.256882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.257437 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.257999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.258609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.259159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.259705 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.260277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.260842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.261433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.262016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.262614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.263233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.263825 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.264843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.265445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.266021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.266649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.267802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.268494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.269133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.269972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.270677 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.271397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.272136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.272879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.273658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.274450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.275194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.275993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.276820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.277564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.278246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.278950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.279680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.280434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.281190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.281954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.282746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.283491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.284261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.285061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.285966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.286790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.287611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.288397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.289176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.289736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.290328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.291179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.291958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.293865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.294740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.295571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.296421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.297268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.297937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.299384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.299960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.300795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.301591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.302186 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.303033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.303866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.304666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.305449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.306192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.307050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.307900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.308756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.309569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.310328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.311156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.311982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.312795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.313334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.313889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.314475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.315040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.315582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.316138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.316759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.317322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.317873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.318446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.319018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.319574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.320108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.320637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.321201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.321744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.322360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.322994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.323576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.324163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.324753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.325337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.325909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.326539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.327117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.327712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.328261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.328837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.329388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.329985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.330583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.331163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.331721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.332306 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.332902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.333474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.334028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.334894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.335469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.336068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.336652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.337228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.337813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.338520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.339086 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.339653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.340216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.340785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.341383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.341946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.342757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.343984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.343984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.344517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.345040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.346013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.346568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.347431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.348022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.348563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.349181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.349769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.350335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.350906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.351444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:57:31.351866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:57:31.482060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: WARNING keystonemiddleware.auth_token [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:57:31.490869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: WARNING keystonemiddleware.auth_token [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:57:31.613817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO dbcounter [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Registered counter for database nova_api Sep 13 19:57:31.649121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_db.sqlalchemy.engines [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:57:31.661486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writer thread running {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:57:31.778857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.context [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6(cell1) {{(pid=120844) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 19:57:31.787507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.788400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.792108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.793496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.794449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.800136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.804380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO dbcounter [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Registered counter for database nova_cell0 Sep 13 19:57:31.812686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO dbcounter [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Registered counter for database nova_cell1 Sep 13 19:57:31.827721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_db.sqlalchemy.engines [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:57:31.830212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_db.sqlalchemy.engines [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:57:31.844377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writer thread running {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:57:31.844996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writer thread running {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:57:31.875308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: WARNING keystonemiddleware.auth_token [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:57:31.881678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: WARNING keystonemiddleware.auth_token [None req-ea4eec75-131d-46ad-9018-9ea887de8f17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:57:31.887807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f092e0f9c0 pid: 120845 (default app) Sep 13 19:57:32.140624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO dbcounter [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Registered counter for database nova_cell0 Sep 13 19:57:32.152826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_db.sqlalchemy.engines [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:57:32.158999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writer thread running {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:57:32.494672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: WARNING keystonemiddleware.auth_token [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:57:32.502690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: WARNING keystonemiddleware.auth_token [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:57:32.860335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: WARNING keystonemiddleware.auth_token [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:57:32.866720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: WARNING keystonemiddleware.auth_token [None req-8a460c52-8cc2-4771-8083-803e0e83607c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:57:32.872293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f092e0f9c0 pid: 120844 (default app) Sep 13 19:58:09.154794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=3 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:09.157010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=3 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:09.158285 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=3 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:09.159329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=3 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:10.338264 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-03a2a20d-26b6-49eb-bced-efa89ffc9ee1 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Action: 'create', calling method: .version_select at 0x7f98474d9430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-194208001"}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:10.382233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=3 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:10.383577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=3 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:10.384566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=3 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:10.385526 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=3 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:11.832021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c45eab4b-08a3-4d98-9d33-90cb8b929237 tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] Action: 'create', calling method: .version_select at 0x7f98474893a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-93748448", "metadata": {"Type": "work"}}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:12.500098 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-03a2a20d-26b6-49eb-bced-efa89ffc9ee1 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.355618 Sep 13 19:58:12.501932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Sep 13 19:58:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3360 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 19:58:12.523555 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-128249c8-c0d8-4b7f-909b-a2d389ebb42f tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f98473ac310>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:12.633435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-128249c8-c0d8-4b7f-909b-a2d389ebb42f tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87" status: 200 len: 344 microversion: 2.1 time: 0.117031 Sep 13 19:58:12.640841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 2/2] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 19:58:12 2022] GET /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87 => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:13.651701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8b0f8155-f038-45e0-8b37-a86eb7ae4c36 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f98473ac9d0>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:13.862028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8b0f8155-f038-45e0-8b37-a86eb7ae4c36 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87" status: 200 len: 345 microversion: 2.1 time: 0.214873 Sep 13 19:58:13.862817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 3/3] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 19:58:13 2022] GET /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87 => generated 345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:13.874099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c45eab4b-08a3-4d98-9d33-90cb8b929237 tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 3.497309 Sep 13 19:58:13.875361 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1/4] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Sep 13 19:58:10 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 3500 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 13 19:58:13.887300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2061f27f-56a3-4972-975e-782707cd39d1 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Action: 'create', calling method: .version_select at 0x7f98473ba040>, body: {"snapshot": {"volume_id": "1339db29-c585-4842-8500-1f1ae9052a87", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-764854765"}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:13.893734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3a59d99c-d30e-4da6-b495-a2e4fa360f7a tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] Calling method '.version_select at 0x7f9847370280>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:14.405732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3a59d99c-d30e-4da6-b495-a2e4fa360f7a tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6e483959-964d-4dd2-8a52-cb2b9f3979ba" status: 200 len: 352 microversion: 2.1 time: 0.518966 Sep 13 19:58:14.407163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 2/5] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 19:58:13 2022] GET /compute/v2.1/os-volumes/6e483959-964d-4dd2-8a52-cb2b9f3979ba => generated 352 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:14.421198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b1fbd55a-028d-4deb-957c-06f4e91698da tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] Calling method '.version_select at 0x7f9847370940>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:14.518182 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b1fbd55a-028d-4deb-957c-06f4e91698da tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6e483959-964d-4dd2-8a52-cb2b9f3979ba" status: 200 len: 352 microversion: 2.1 time: 0.101142 Sep 13 19:58:14.519946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 19:58:14 2022] GET /compute/v2.1/os-volumes/6e483959-964d-4dd2-8a52-cb2b9f3979ba => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:14.539041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e14d096c-5fee-4f30-92c5-85c2793d133d tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] Calling method '.version_select at 0x7f9847379040>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:14.706756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e14d096c-5fee-4f30-92c5-85c2793d133d tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/6e483959-964d-4dd2-8a52-cb2b9f3979ba" status: 202 len: 0 microversion: 2.1 time: 0.171401 Sep 13 19:58:14.707862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 13 19:58:14 2022] DELETE /compute/v2.1/os-volumes/6e483959-964d-4dd2-8a52-cb2b9f3979ba => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 19:58:14.715692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5bdbefcc-2f14-4dbe-a48c-347392f3afbb tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] Calling method '.version_select at 0x7f98473791f0>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:14.851496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2061f27f-56a3-4972-975e-782707cd39d1 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.978913 Sep 13 19:58:14.852072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 4/8] 10.222.0.52 () {60 vars in 1162 bytes} [Tue Sep 13 19:58:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:14.864678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-38f48c49-d60f-4297-a470-1c7b491691ad tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f98473ba8b0>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:14.875565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5bdbefcc-2f14-4dbe-a48c-347392f3afbb tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6e483959-964d-4dd2-8a52-cb2b9f3979ba" status: 200 len: 351 microversion: 2.1 time: 0.163619 Sep 13 19:58:14.876699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 5/9] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 19:58:14 2022] GET /compute/v2.1/os-volumes/6e483959-964d-4dd2-8a52-cb2b9f3979ba => generated 351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:14.944741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-38f48c49-d60f-4297-a470-1c7b491691ad tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b" status: 200 len: 286 microversion: 2.1 time: 0.084869 Sep 13 19:58:14.945289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 5/10] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 13 19:58:14 2022] GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:14.958504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ccdf8786-7379-432a-b96a-0d3ab8a760b9 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f9847379940>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:15.085136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ccdf8786-7379-432a-b96a-0d3ab8a760b9 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.132024 Sep 13 19:58:15.086303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 6/11] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Sep 13 19:58:14 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:15.102843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-375b51a4-8cb2-43bc-adbf-2a6c8f7dc1dc tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f9847d06790>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:15.144820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-375b51a4-8cb2-43bc-adbf-2a6c8f7dc1dc tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b" status: 200 len: 286 microversion: 2.1 time: 0.047585 Sep 13 19:58:15.146401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 13 19:58:15 2022] GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:15.897079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d572ab85-908a-4a4c-aff0-55b1bfd79a97 tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] Calling method '.version_select at 0x7f984737dd30>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:15.966273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-d572ab85-908a-4a4c-aff0-55b1bfd79a97 tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] HTTP exception thrown: Volume 6e483959-964d-4dd2-8a52-cb2b9f3979ba could not be found. Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d572ab85-908a-4a4c-aff0-55b1bfd79a97 tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] Request method failure captured: Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/os-volumes/6e483959-964d-4dd2-8a52-cb2b9f3979ba HTTP/1.1 Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIODSeEiPkYVlRzrzn1mC88CQpOszknVaSo3kyEkEIqhkQgwoZWYP22ORJTPGD4NEaZyzL31vXOlFHwk6RuZsDviROs4XnZMSsgdDqTL_w1pnJ4SdpUokSklUs5RF2CiMX8Dzqn3ecyRZgB0RXSUjIrfMhkwWwnRmHbxjrm6vM0g28ec Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: f483c5fd42bd4655bc9a2bbeb49efb1a Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-VolumesGetTestJSON-2032472901 Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 19:58:15.974133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f483c5fd42bd4655bc9a2bbeb49efb1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f483c5fd42bd4655bc9a2bbeb49efb1a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f483c5fd42bd4655bc9a2bbeb49efb1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f483c5fd42bd4655bc9a2bbeb49efb1a"}]}] Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-VolumesGetTestJSON-2032472901 Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: f483c5fd42bd4655bc9a2bbeb49efb1a Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-VolumesGetTestJSON-2032472901 Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-VolumesGetTestJSON-2032472901-project Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: f54f79e394174315a1f0df895d888364 Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-VolumesGetTestJSON-2032472901-project Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Volume 6e483959-964d-4dd2-8a52-cb2b9f3979ba could not be found. Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '6e483959-964d-4dd2-8a52-cb2b9f3979ba'} Sep 13 19:58:15.975494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e483959-964d-4dd2-8a52-cb2b9f3979ba could not be found. (HTTP 404) (Request-ID: req-1792bf07-d22d-44ad-8c3b-d5eed737d841) Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:15.976082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:58:15.976901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e483959-964d-4dd2-8a52-cb2b9f3979ba could not be found. Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 19:58:15.977738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:58:15.979802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e483959-964d-4dd2-8a52-cb2b9f3979ba could not be found. Sep 13 19:58:15.979802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:15.979802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:15.979802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:15.979802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:15.979802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:58:15.979802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:58:15.979802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:58:15.979802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:58:15.979802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e483959-964d-4dd2-8a52-cb2b9f3979ba could not be found. Sep 13 19:58:15.979802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:15.991442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d572ab85-908a-4a4c-aff0-55b1bfd79a97 tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] Returning 404 to user: Volume 6e483959-964d-4dd2-8a52-cb2b9f3979ba could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:58:15.998581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d572ab85-908a-4a4c-aff0-55b1bfd79a97 tempest-VolumesGetTestJSON-2032472901 tempest-VolumesGetTestJSON-2032472901-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6e483959-964d-4dd2-8a52-cb2b9f3979ba" status: 404 len: 109 microversion: 2.1 time: 0.109831 Sep 13 19:58:16.002070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 19:58:15 2022] GET /compute/v2.1/os-volumes/6e483959-964d-4dd2-8a52-cb2b9f3979ba => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:58:16.187493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6be6a9f2-fc6b-4b30-83fc-c1654a1b414d tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f98473ace50>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:16.287535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6be6a9f2-fc6b-4b30-83fc-c1654a1b414d tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b" status: 200 len: 286 microversion: 2.1 time: 0.117862 Sep 13 19:58:16.294400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 7/14] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 13 19:58:16 2022] GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b => generated 286 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:17.303811 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-739c2dcc-3c3f-4988-8940-76ff07aae262 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f9847379430>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:17.448693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-739c2dcc-3c3f-4988-8940-76ff07aae262 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b" status: 200 len: 286 microversion: 2.1 time: 0.151290 Sep 13 19:58:17.449587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 8/15] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 13 19:58:17 2022] GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b => generated 286 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:18.464793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ab07497e-bfb8-4155-a06d-7fe6d9e48083 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f98473ac790>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:18.515653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ab07497e-bfb8-4155-a06d-7fe6d9e48083 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b" status: 200 len: 287 microversion: 2.1 time: 0.057321 Sep 13 19:58:18.525206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 13 19:58:18 2022] GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:18.531491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-91792e38-2c24-4ed8-8883-9cc2a59b85c7 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f98473790d0>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:18.773395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-91792e38-2c24-4ed8-8883-9cc2a59b85c7 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b" status: 202 len: 0 microversion: 2.1 time: 0.246044 Sep 13 19:58:18.777801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 9/17] 10.222.0.52 () {58 vars in 1254 bytes} [Tue Sep 13 19:58:18 2022] DELETE /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:58:18.785668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f15a779d-2670-44be-9258-321fabdd6b63 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f98473ba940>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:18.862671 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f15a779d-2670-44be-9258-321fabdd6b63 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b" status: 200 len: 286 microversion: 2.1 time: 0.082218 Sep 13 19:58:18.868587 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 9/18] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 13 19:58:18 2022] GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:19.876772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9efec00c-0d0d-46c0-94d2-2c4386cff682 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f9847ccc670>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:19.920982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-9efec00c-0d0d-46c0-94d2-2c4386cff682 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] HTTP exception thrown: Snapshot b2bcffc0-5083-46a0-a18d-41f88f93480b could not be found. Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9efec00c-0d0d-46c0-94d2-2c4386cff682 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Request method failure captured: Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b HTTP/1.1 Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIODRJQGxI6keS7Shjw5GE5uOzAp-9KTOm1S6RinULYlkr9Pl9J4V1hjKiCz5z65Am48tPE_mrf8O-Pc07aVaZoH_jt-ut2PJqpq4o_45leevlE87WFilpS5wr7llUNARStvzx78kKdVhRnixJb_FmngETZUg-8fw2hAWnLg_Nvqlx3I Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: 3fdc25924a1446f883d7993a9d4cc5b9 Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2081088929 Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 19:58:19.924654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3fdc25924a1446f883d7993a9d4cc5b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3fdc25924a1446f883d7993a9d4cc5b9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fdc25924a1446f883d7993a9d4cc5b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fdc25924a1446f883d7993a9d4cc5b9"}]}] Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2081088929 Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: 3fdc25924a1446f883d7993a9d4cc5b9 Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2081088929 Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-VolumesSnapshotsTestJSON-2081088929-project Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 848f3bab2f8b404aaf6eca4beeb78487 Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2081088929-project Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Snapshot b2bcffc0-5083-46a0-a18d-41f88f93480b could not be found. Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': 'b2bcffc0-5083-46a0-a18d-41f88f93480b'} Sep 13 19:58:19.925680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b2bcffc0-5083-46a0-a18d-41f88f93480b could not be found. (HTTP 404) (Request-ID: req-41148add-3f99-4889-9e1b-1018bc5563ba) Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:19.926285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:58:19.927122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b2bcffc0-5083-46a0-a18d-41f88f93480b could not be found. Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 19:58:19.927961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:58:19.928819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b2bcffc0-5083-46a0-a18d-41f88f93480b could not be found. Sep 13 19:58:19.928819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:19.928819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:19.928819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:19.928819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:19.928819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:58:19.928819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:58:19.928819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:58:19.928819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:58:19.928819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b2bcffc0-5083-46a0-a18d-41f88f93480b could not be found. Sep 13 19:58:19.928819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:19.931478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9efec00c-0d0d-46c0-94d2-2c4386cff682 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Returning 404 to user: Snapshot b2bcffc0-5083-46a0-a18d-41f88f93480b could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:58:19.932538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9efec00c-0d0d-46c0-94d2-2c4386cff682 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b" status: 404 len: 111 microversion: 2.1 time: 0.059825 Sep 13 19:58:19.933438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 10/19] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 13 19:58:19 2022] GET /compute/v2.1/os-snapshots/b2bcffc0-5083-46a0-a18d-41f88f93480b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 19:58:19.943265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3ce639fc-30cb-4d3d-b421-88d1834355da tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f98473baa60>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:20.110907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3ce639fc-30cb-4d3d-b421-88d1834355da tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87" status: 202 len: 0 microversion: 2.1 time: 0.172428 Sep 13 19:58:20.113379 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 10/20] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 13 19:58:19 2022] DELETE /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:58:20.124101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-21e9a900-84c2-4f2c-9a0b-ee9b4be31e8b tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f9847ccc700>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:20.278767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-21e9a900-84c2-4f2c-9a0b-ee9b4be31e8b tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87" status: 200 len: 344 microversion: 2.1 time: 0.161554 Sep 13 19:58:20.280211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 11/21] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 19:58:20 2022] GET /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:21.295493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-12bb2839-5f95-45c0-8e47-528235129848 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f98473ac8b0>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:21.363918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-12bb2839-5f95-45c0-8e47-528235129848 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] HTTP exception thrown: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-12bb2839-5f95-45c0-8e47-528235129848 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Request method failure captured: Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87 HTTP/1.1 Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIODRJQGxI6keS7Shjw5GE5uOzAp-9KTOm1S6RinULYlkr9Pl9J4V1hjKiCz5z65Am48tPE_mrf8O-Pc07aVaZoH_jt-ut2PJqpq4o_45leevlE87WFilpS5wr7llUNARStvzx78kKdVhRnixJb_FmngETZUg-8fw2hAWnLg_Nvqlx3I Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: 3fdc25924a1446f883d7993a9d4cc5b9 Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2081088929 Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 19:58:21.369341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3fdc25924a1446f883d7993a9d4cc5b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3fdc25924a1446f883d7993a9d4cc5b9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fdc25924a1446f883d7993a9d4cc5b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fdc25924a1446f883d7993a9d4cc5b9"}]}] Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2081088929 Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: 3fdc25924a1446f883d7993a9d4cc5b9 Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2081088929 Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-VolumesSnapshotsTestJSON-2081088929-project Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 848f3bab2f8b404aaf6eca4beeb78487 Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2081088929-project Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '1339db29-c585-4842-8500-1f1ae9052a87'} Sep 13 19:58:21.371407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. (HTTP 404) (Request-ID: req-9586855a-3f43-4a62-a10f-4a1a93ac433e) Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:21.372832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:58:21.375053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 19:58:21.376689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-12bb2839-5f95-45c0-8e47-528235129848 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Returning 404 to user: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:58:21.379912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-12bb2839-5f95-45c0-8e47-528235129848 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87" status: 404 len: 109 microversion: 2.1 time: 0.082654 Sep 13 19:58:21.383010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 11/22] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 19:58:21 2022] GET /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:58:21.393756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6a950cd0-3566-4220-9919-4c447dc9f6ec tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f98473794c0>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:21.481845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-6a950cd0-3566-4220-9919-4c447dc9f6ec tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] HTTP exception thrown: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6a950cd0-3566-4220-9919-4c447dc9f6ec tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Request method failure captured: Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: DELETE /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87 HTTP/1.1 Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIODRJQGxI6keS7Shjw5GE5uOzAp-9KTOm1S6RinULYlkr9Pl9J4V1hjKiCz5z65Am48tPE_mrf8O-Pc07aVaZoH_jt-ut2PJqpq4o_45leevlE87WFilpS5wr7llUNARStvzx78kKdVhRnixJb_FmngETZUg-8fw2hAWnLg_Nvqlx3I Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: 3fdc25924a1446f883d7993a9d4cc5b9 Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2081088929 Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 19:58:21.484085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3fdc25924a1446f883d7993a9d4cc5b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3fdc25924a1446f883d7993a9d4cc5b9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fdc25924a1446f883d7993a9d4cc5b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fdc25924a1446f883d7993a9d4cc5b9"}]}] Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2081088929 Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: 3fdc25924a1446f883d7993a9d4cc5b9 Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2081088929 Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-VolumesSnapshotsTestJSON-2081088929-project Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 848f3bab2f8b404aaf6eca4beeb78487 Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2081088929-project Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '1339db29-c585-4842-8500-1f1ae9052a87'} Sep 13 19:58:21.485159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. (HTTP 404) (Request-ID: req-48f9ad78-c45d-48a7-b703-4557f488f984) Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:21.485756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 19:58:21.487059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 19:58:21.487943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:58:21.488950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.488950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.488950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:21.488950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.488950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:21.488950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:58:21.488950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:58:21.488950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:58:21.488950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:58:21.488950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.488950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.490460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6a950cd0-3566-4220-9919-4c447dc9f6ec tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Returning 404 to user: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:58:21.491455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6a950cd0-3566-4220-9919-4c447dc9f6ec tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87" status: 404 len: 109 microversion: 2.1 time: 0.103285 Sep 13 19:58:21.492575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 13 19:58:21 2022] DELETE /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:58:21.501656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f6496853-8767-4fce-82b1-566b161bd0e9 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Calling method '.version_select at 0x7f98473ac280>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:21.941077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-f6496853-8767-4fce-82b1-566b161bd0e9 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] HTTP exception thrown: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f6496853-8767-4fce-82b1-566b161bd0e9 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Request method failure captured: Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87 HTTP/1.1 Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIODRJQGxI6keS7Shjw5GE5uOzAp-9KTOm1S6RinULYlkr9Pl9J4V1hjKiCz5z65Am48tPE_mrf8O-Pc07aVaZoH_jt-ut2PJqpq4o_45leevlE87WFilpS5wr7llUNARStvzx78kKdVhRnixJb_FmngETZUg-8fw2hAWnLg_Nvqlx3I Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: 3fdc25924a1446f883d7993a9d4cc5b9 Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2081088929 Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 19:58:21.944714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3fdc25924a1446f883d7993a9d4cc5b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3fdc25924a1446f883d7993a9d4cc5b9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fdc25924a1446f883d7993a9d4cc5b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3fdc25924a1446f883d7993a9d4cc5b9"}]}] Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2081088929 Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: 3fdc25924a1446f883d7993a9d4cc5b9 Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2081088929 Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-VolumesSnapshotsTestJSON-2081088929-project Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 848f3bab2f8b404aaf6eca4beeb78487 Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2081088929-project Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '1339db29-c585-4842-8500-1f1ae9052a87'} Sep 13 19:58:21.945961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. (HTTP 404) (Request-ID: req-10fa4234-e4ac-4bc4-be29-ec8b28f8b73d) Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:21.947041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:58:21.948231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 19:58:21.949411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:58:21.951530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.951530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.951530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:58:21.951530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.951530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:58:21.951530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:58:21.951530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:58:21.951530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:58:21.951530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:58:21.951530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. Sep 13 19:58:21.951530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:58:21.955323 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f6496853-8767-4fce-82b1-566b161bd0e9 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] Returning 404 to user: Volume 1339db29-c585-4842-8500-1f1ae9052a87 could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:58:21.956949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f6496853-8767-4fce-82b1-566b161bd0e9 tempest-VolumesSnapshotsTestJSON-2081088929 tempest-VolumesSnapshotsTestJSON-2081088929-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87" status: 404 len: 109 microversion: 2.1 time: 0.460134 Sep 13 19:58:21.959211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 12/24] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 19:58:21 2022] GET /compute/v2.1/os-volumes/1339db29-c585-4842-8500-1f1ae9052a87 => generated 109 bytes in 463 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:58:23.478017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-433019783", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "networks": [{"uuid": "3882e311-9c48-4756-9535-2983b05918ad"}]}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:23.700280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.network.neutron [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] validate_networks() for [('3882e311-9c48-4756-9535-2983b05918ad', None, None, None, None, None)] {{(pid=120844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:58:26.192259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Flavor limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:58:26.192877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Image limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:58:26.193501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Flavor pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:58:26.198512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Image pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:58:26.199116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:58:26.231070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:26.231827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:26.232400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:26.233800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:26.234481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:26.235167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:26.341942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Getting quotas for project 8ac3cf4af51e419c848daba7adc86024. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:58:26.371933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Getting quotas for user bd55568bf88346b794922ef8555f9654 and project 8ac3cf4af51e419c848daba7adc86024. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:58:26.440157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Going to run 1 instances... {{(pid=120844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:58:26.445060 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:58:26.655171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0bffe4fa-8e98-48d3-8daa-802a973aa47a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.352281 Sep 13 19:58:26.657816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 13/25] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 19:58:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 4355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:58:26.670441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6bf3bac9-f609-467e-a1af-4e396a365981 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:26.671206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6bf3bac9-f609-467e-a1af-4e396a365981 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:27.061252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6bf3bac9-f609-467e-a1af-4e396a365981 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:27.111977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6bf3bac9-f609-467e-a1af-4e396a365981 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1214 microversion: 2.1 time: 0.446817 Sep 13 19:58:27.112872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 13/26] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:26 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1214 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:28.134846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d4f58394-e294-4b07-aec4-5b43e50a85cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Action: 'create', calling method: .version_select at 0x7f98471f05e0>, body: {"keypair": {"name": "tempest-keypair-1199737398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzRjYhWQpHAid1ArEF+GYB8XPr+OZSmon4L9vr5p4j9sAeHL4uzIhsevkMGpGT0eKLn8rBA4BUL19paeb9rwyWfNKqM0GRgZcZLX2vBf95Jwf1h+ku43udZ0VPtMiAiuw=="}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:28.259516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-d4f58394-e294-4b07-aec4-5b43e50a85cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Getting quotas for project fdc8b1b561f247ed84babfad941e55f6. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:58:28.279381 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-d4f58394-e294-4b07-aec4-5b43e50a85cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Getting quotas for user b07b8b251aaa456c9916c41f9a0b77e3 and project fdc8b1b561f247ed84babfad941e55f6. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:58:28.366249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d4f58394-e294-4b07-aec4-5b43e50a85cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.176271 Sep 13 19:58:28.367622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 14/27] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Sep 13 19:58:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1179 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 19:58:28.377267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-044ff2e4-da6a-4668-a94e-ba732f802d59 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:28.380951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-044ff2e4-da6a-4668-a94e-ba732f802d59 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:28.620716 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-044ff2e4-da6a-4668-a94e-ba732f802d59 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:28.662597 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-044ff2e4-da6a-4668-a94e-ba732f802d59 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1214 microversion: 2.1 time: 0.293270 Sep 13 19:58:28.663841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 15/28] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:28 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1214 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:29.135743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1066557159", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:29.407183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] validate_networks() for [('29817ba4-d6b3-4bd2-a1ab-dc4db767ab34', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:58:29.697300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a76d4843-912c-4daf-b28d-8a4b512d6d0d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:29.698703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a76d4843-912c-4daf-b28d-8a4b512d6d0d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:29.715656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a76d4843-912c-4daf-b28d-8a4b512d6d0d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:29.716832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a76d4843-912c-4daf-b28d-8a4b512d6d0d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:29.717476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a76d4843-912c-4daf-b28d-8a4b512d6d0d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:29.718986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a76d4843-912c-4daf-b28d-8a4b512d6d0d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:29.719629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a76d4843-912c-4daf-b28d-8a4b512d6d0d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:29.721318 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a76d4843-912c-4daf-b28d-8a4b512d6d0d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:30.455541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a76d4843-912c-4daf-b28d-8a4b512d6d0d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:30.491455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a76d4843-912c-4daf-b28d-8a4b512d6d0d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1210 microversion: 2.1 time: 0.806580 Sep 13 19:58:30.496544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 16/29] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:29 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1210 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:31.530053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0f572e8f-0ec6-4932-81ac-8c8764ef56b5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:31.532589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0f572e8f-0ec6-4932-81ac-8c8764ef56b5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:31.546568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f572e8f-0ec6-4932-81ac-8c8764ef56b5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:31.547118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f572e8f-0ec6-4932-81ac-8c8764ef56b5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:31.547676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f572e8f-0ec6-4932-81ac-8c8764ef56b5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:31.548444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f572e8f-0ec6-4932-81ac-8c8764ef56b5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:31.548886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f572e8f-0ec6-4932-81ac-8c8764ef56b5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:31.549348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f572e8f-0ec6-4932-81ac-8c8764ef56b5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:32.048922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0f572e8f-0ec6-4932-81ac-8c8764ef56b5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:32.059653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0f572e8f-0ec6-4932-81ac-8c8764ef56b5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1272 microversion: 2.1 time: 0.533898 Sep 13 19:58:32.060255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 17/30] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:31 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1272 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:32.656187 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-102e05d2-6be6-486b-9bc3-c6fcdf411b2f tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] Calling method '.version_select at 0x7f98468e7f70>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:32.842501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-102e05d2-6be6-486b-9bc3-c6fcdf411b2f tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1a91be9f-0595-470e-a4c8-bae8d7bb420f" status: 200 len: 351 microversion: 2.1 time: 0.189051 Sep 13 19:58:32.847069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 18/31] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 19:58:32 2022] GET /compute/v2.1/os-volumes/1a91be9f-0595-470e-a4c8-bae8d7bb420f => generated 351 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:33.108286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3595c7c7-ce9a-4377-8b3e-9e5cb0b8a4d4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:33.109299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3595c7c7-ce9a-4377-8b3e-9e5cb0b8a4d4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:33.151601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3595c7c7-ce9a-4377-8b3e-9e5cb0b8a4d4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:33.163725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3595c7c7-ce9a-4377-8b3e-9e5cb0b8a4d4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:33.169696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3595c7c7-ce9a-4377-8b3e-9e5cb0b8a4d4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:33.175226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3595c7c7-ce9a-4377-8b3e-9e5cb0b8a4d4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:33.178674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3595c7c7-ce9a-4377-8b3e-9e5cb0b8a4d4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:33.186897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3595c7c7-ce9a-4377-8b3e-9e5cb0b8a4d4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:33.611172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:58:33.612079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:58:33.613382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:58:33.614533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:58:33.615332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:58:33.672961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:33.673850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:33.674620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:33.676179 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:33.677394 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:33.678318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:33.744643 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Getting quotas for project 23873d995d564c0388a4649e57821c69. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:58:33.773144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Getting quotas for user 2577fc11946c4597857187ae7b464fe7 and project 23873d995d564c0388a4649e57821c69. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:58:33.809884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:58:33.821181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:58:34.024422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2c36c3e5-db3b-49b1-b4e4-78a219b5ad9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.050062 Sep 13 19:58:34.038452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 14/32] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 19:58:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 6058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 19:58:34.050240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4b6f4ad4-05d7-4b4c-adad-4cd6f7cf8994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:34.058975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4b6f4ad4-05d7-4b4c-adad-4cd6f7cf8994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:34.116305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3595c7c7-ce9a-4377-8b3e-9e5cb0b8a4d4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:34.209249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3595c7c7-ce9a-4377-8b3e-9e5cb0b8a4d4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1272 microversion: 2.1 time: 1.099681 Sep 13 19:58:34.215046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 19/33] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:33 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1272 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:34.284409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4b6f4ad4-05d7-4b4c-adad-4cd6f7cf8994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:34.299926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4b6f4ad4-05d7-4b4c-adad-4cd6f7cf8994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1222 microversion: 2.1 time: 0.251968 Sep 13 19:58:34.301267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 15/34] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:34 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1222 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:34.632825 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1055359380", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:34.802997 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.network.neutron [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] validate_networks() for [('29817ba4-d6b3-4bd2-a1ab-dc4db767ab34', None, None, None, None, None)] {{(pid=120844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:58:34.907887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b13e1de9-b254-4003-a195-ea314bbe3223 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] Calling method '.version_select at 0x7f98469d1310>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:35.012328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b13e1de9-b254-4003-a195-ea314bbe3223 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/160c9001-e56e-45b2-b396-acb52c8f567e" status: 200 len: 350 microversion: 2.1 time: 0.108980 Sep 13 19:58:35.013348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 16/35] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 19:58:34 2022] GET /compute/v2.1/os-volumes/160c9001-e56e-45b2-b396-acb52c8f567e => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:35.235387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0877a776-12c5-4dcb-8203-7b2a26a7a103 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:35.236155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0877a776-12c5-4dcb-8203-7b2a26a7a103 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:35.255872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0877a776-12c5-4dcb-8203-7b2a26a7a103 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:35.256383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0877a776-12c5-4dcb-8203-7b2a26a7a103 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:35.267068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0877a776-12c5-4dcb-8203-7b2a26a7a103 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:35.267068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0877a776-12c5-4dcb-8203-7b2a26a7a103 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:35.267068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0877a776-12c5-4dcb-8203-7b2a26a7a103 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:35.267068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0877a776-12c5-4dcb-8203-7b2a26a7a103 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:36.283563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:37.471578 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0877a776-12c5-4dcb-8203-7b2a26a7a103 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:37.474068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Flavor limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:58:37.474628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Image limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:58:37.475018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Flavor pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:58:37.475431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Image pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:58:37.475963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:58:37.536153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0877a776-12c5-4dcb-8203-7b2a26a7a103 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 2.306577 Sep 13 19:58:37.541333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:37.548967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:37.553169 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:37.554621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:37.555525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 17/36] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:35 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 2327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:37.557621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:37.562188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:37.571086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1502903733", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7304e426-9c27-4fdc-adde-8a2c88147851"}], "security_groups": [{"name": "tempest-securitygroup--1150193168"}], "key_name": "tempest-keypair-1199737398", "user_data": "}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:37.651171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Getting quotas for project 23873d995d564c0388a4649e57821c69. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:58:37.658573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Getting quotas for user 2577fc11946c4597857187ae7b464fe7 and project 23873d995d564c0388a4649e57821c69. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:58:37.694857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Going to run 1 instances... {{(pid=120844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:58:37.703149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:58:37.818550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6db4506c-0c48-4aee-9731-f9430868cca9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.192377 Sep 13 19:58:37.830233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 20/37] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 19:58:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 3205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:58:37.846341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7c20bcb9-8e50-4990-a9a3-7259336bfdc6 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] Calling method '.version_select at 0x7f98468c3c10>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:37.996471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7c20bcb9-8e50-4990-a9a3-7259336bfdc6 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d2736018-35f5-4a6c-95c6-599b05050e29" status: 200 len: 349 microversion: 2.1 time: 0.164821 Sep 13 19:58:37.998329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 21/38] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 19:58:37 2022] GET /compute/v2.1/os-volumes/d2736018-35f5-4a6c-95c6-599b05050e29 => generated 349 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:38.005627 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0cd7ded1-1b24-4a8a-a780-9db6cfcda208 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:38.006868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0cd7ded1-1b24-4a8a-a780-9db6cfcda208 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:38.269099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] validate_networks() for [('7304e426-9c27-4fdc-adde-8a2c88147851', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:58:38.557959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0cd7ded1-1b24-4a8a-a780-9db6cfcda208 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:38.575959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0cd7ded1-1b24-4a8a-a780-9db6cfcda208 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1222 microversion: 2.1 time: 0.573538 Sep 13 19:58:38.578583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 22/39] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:37 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1222 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:38.611674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f7a6ab75-8319-4429-8710-35e29b4f1ed9 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] Calling method '.version_select at 0x7f984698adc0>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:39.044461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f7a6ab75-8319-4429-8710-35e29b4f1ed9 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.463750 Sep 13 19:58:39.045761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 23/40] 10.222.0.52 () {58 vars in 1134 bytes} [Tue Sep 13 19:58:38 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:39.051884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-adae871e-3ffa-4100-867d-6aac27f6df85 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:39.053026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-adae871e-3ffa-4100-867d-6aac27f6df85 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:39.069350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-adae871e-3ffa-4100-867d-6aac27f6df85 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:39.073111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-adae871e-3ffa-4100-867d-6aac27f6df85 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:39.073828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-adae871e-3ffa-4100-867d-6aac27f6df85 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:39.074861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-adae871e-3ffa-4100-867d-6aac27f6df85 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:39.077944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-adae871e-3ffa-4100-867d-6aac27f6df85 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:39.078919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-adae871e-3ffa-4100-867d-6aac27f6df85 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:39.529637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-adae871e-3ffa-4100-867d-6aac27f6df85 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:39.543344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-adae871e-3ffa-4100-867d-6aac27f6df85 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 0.495989 Sep 13 19:58:39.546358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 24/41] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:39 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:39.556995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b46fab4f-5553-4973-ac6b-a3c9e2afaf6a tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] Calling method '.version_select at 0x7f9846883dc0>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:39.825190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b46fab4f-5553-4973-ac6b-a3c9e2afaf6a tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.276196 Sep 13 19:58:39.825967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 25/42] 10.222.0.52 () {58 vars in 1149 bytes} [Tue Sep 13 19:58:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:39.844591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7a6824f2-97a6-4736-ad6f-ad77e2a21d1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:39.849112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7a6824f2-97a6-4736-ad6f-ad77e2a21d1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:39.888649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a6824f2-97a6-4736-ad6f-ad77e2a21d1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:39.890891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a6824f2-97a6-4736-ad6f-ad77e2a21d1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:39.893895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a6824f2-97a6-4736-ad6f-ad77e2a21d1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:39.899092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a6824f2-97a6-4736-ad6f-ad77e2a21d1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:39.906113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a6824f2-97a6-4736-ad6f-ad77e2a21d1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:39.909726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a6824f2-97a6-4736-ad6f-ad77e2a21d1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:40.093290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7a6824f2-97a6-4736-ad6f-ad77e2a21d1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:40.109270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7a6824f2-97a6-4736-ad6f-ad77e2a21d1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1274 microversion: 2.1 time: 0.282046 Sep 13 19:58:40.114450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 26/43] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:39 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1274 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:40.119672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-defd9edf-45eb-4922-aefb-4f6329fa0cd4 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] Calling method '.version_select at 0x7f98468cf670>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:40.485912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-defd9edf-45eb-4922-aefb-4f6329fa0cd4 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.368604 Sep 13 19:58:40.487127 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 27/44] 10.222.0.52 () {58 vars in 1134 bytes} [Tue Sep 13 19:58:40 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:40.520303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-46f6b5c5-9d4d-4deb-8aff-a5e5fec1dfdb tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] Calling method '.version_select at 0x7f9846883c10>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:41.009151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-46f6b5c5-9d4d-4deb-8aff-a5e5fec1dfdb tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.502141 Sep 13 19:58:41.013041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 28/45] 10.222.0.52 () {58 vars in 1167 bytes} [Tue Sep 13 19:58:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:41.030297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-72c543d1-a508-4efb-a491-adfaed3487d7 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:41.037858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-72c543d1-a508-4efb-a491-adfaed3487d7 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:41.080515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-72c543d1-a508-4efb-a491-adfaed3487d7 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:41.081389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-72c543d1-a508-4efb-a491-adfaed3487d7 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:41.082180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-72c543d1-a508-4efb-a491-adfaed3487d7 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:41.113047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-72c543d1-a508-4efb-a491-adfaed3487d7 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:41.115164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-72c543d1-a508-4efb-a491-adfaed3487d7 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:41.117546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-72c543d1-a508-4efb-a491-adfaed3487d7 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:41.997154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-72c543d1-a508-4efb-a491-adfaed3487d7 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:42.030958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-72c543d1-a508-4efb-a491-adfaed3487d7 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 1.004585 Sep 13 19:58:42.036654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 29/46] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:41 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:42.055114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-532cd0be-caad-4a82-8b0e-cd3d68bed7e8 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] Calling method '.version_select at 0x7f98468f8d30>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:42.355514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-532cd0be-caad-4a82-8b0e-cd3d68bed7e8 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.314052 Sep 13 19:58:42.356941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 30/47] 10.222.0.52 () {58 vars in 1170 bytes} [Tue Sep 13 19:58:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:42.364449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a1b0d293-7182-4170-a42d-34aaca164d12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:42.368886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a1b0d293-7182-4170-a42d-34aaca164d12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:42.411090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1b0d293-7182-4170-a42d-34aaca164d12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:42.415931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1b0d293-7182-4170-a42d-34aaca164d12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:42.416955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1b0d293-7182-4170-a42d-34aaca164d12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:42.418267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1b0d293-7182-4170-a42d-34aaca164d12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:42.429564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1b0d293-7182-4170-a42d-34aaca164d12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:42.430352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1b0d293-7182-4170-a42d-34aaca164d12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:42.844791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a1b0d293-7182-4170-a42d-34aaca164d12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:42.862006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a1b0d293-7182-4170-a42d-34aaca164d12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1280 microversion: 2.1 time: 0.502305 Sep 13 19:58:42.875588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 31/48] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:42 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1280 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:42.922787 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-94e35262-c1a2-489a-b518-55e14efb46cd tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] Calling method '.version_select at 0x7f98468cf040>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:43.223841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-94e35262-c1a2-489a-b518-55e14efb46cd tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.345495 Sep 13 19:58:43.226758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 32/49] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 13 19:58:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:43.248444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-97923d94-eb2a-4755-ba79-349028484ea5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:43.255554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-97923d94-eb2a-4755-ba79-349028484ea5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:43.279430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97923d94-eb2a-4755-ba79-349028484ea5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.281848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97923d94-eb2a-4755-ba79-349028484ea5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.283852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97923d94-eb2a-4755-ba79-349028484ea5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.292264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97923d94-eb2a-4755-ba79-349028484ea5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.293441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97923d94-eb2a-4755-ba79-349028484ea5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.294692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97923d94-eb2a-4755-ba79-349028484ea5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.697040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:44.159631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:58:44.161182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:58:44.161765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:58:44.162421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:58:44.162989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:58:44.194832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.198207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.201217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.214221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.217872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.218623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.279914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Getting quotas for project fdc8b1b561f247ed84babfad941e55f6. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:58:44.306690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Getting quotas for user b07b8b251aaa456c9916c41f9a0b77e3 and project fdc8b1b561f247ed84babfad941e55f6. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:58:44.355615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:58:44.361345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:58:44.501687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-98701577-1a36-4d68-b5d3-04ca1e4ce9cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.943644 Sep 13 19:58:44.504517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 18/50] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 13 19:58:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 6948 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 19:58:44.515151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fad2929f-224e-445e-a843-d2956440f585 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] Calling method '.version_select at 0x7f984691f4c0>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:44.515537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-97923d94-eb2a-4755-ba79-349028484ea5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:44.560966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-97923d94-eb2a-4755-ba79-349028484ea5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 1.330081 Sep 13 19:58:44.591768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 33/51] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:43 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:44.636817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e743af48-ef4a-412b-8f59-b72f125c936a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:44.654140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e743af48-ef4a-412b-8f59-b72f125c936a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:44.695605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e743af48-ef4a-412b-8f59-b72f125c936a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.698041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e743af48-ef4a-412b-8f59-b72f125c936a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.701334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e743af48-ef4a-412b-8f59-b72f125c936a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.705016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e743af48-ef4a-412b-8f59-b72f125c936a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.709104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e743af48-ef4a-412b-8f59-b72f125c936a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.715215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e743af48-ef4a-412b-8f59-b72f125c936a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.872086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fad2929f-224e-445e-a843-d2956440f585 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.364645 Sep 13 19:58:44.891657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 19/52] 10.222.0.52 () {58 vars in 1188 bytes} [Tue Sep 13 19:58:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:44.932608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-35d10e7a-8345-41d1-8bc0-c53db542bce0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:44.944614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-35d10e7a-8345-41d1-8bc0-c53db542bce0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:45.251553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-35d10e7a-8345-41d1-8bc0-c53db542bce0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:45.264201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-35d10e7a-8345-41d1-8bc0-c53db542bce0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:45.268583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-35d10e7a-8345-41d1-8bc0-c53db542bce0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:45.275880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-35d10e7a-8345-41d1-8bc0-c53db542bce0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1282 microversion: 2.20 time: 0.375809 Sep 13 19:58:45.277434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 20/53] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:58:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1282 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:58:45.289499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-67f195c4-6c43-4cfb-902c-a3d005e06657 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] Calling method '.version_select at 0x7f984691f310>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:45.605081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-67f195c4-6c43-4cfb-902c-a3d005e06657 tempest-VolumesTestJSON-389154154 tempest-VolumesTestJSON-389154154-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.325851 Sep 13 19:58:45.606685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 21/54] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 13 19:58:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:45.656764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-02110e99-39bf-4574-823f-5a72847e4c3a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:45.658607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-02110e99-39bf-4574-823f-5a72847e4c3a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:45.679012 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-02110e99-39bf-4574-823f-5a72847e4c3a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:45.690995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-02110e99-39bf-4574-823f-5a72847e4c3a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:45.695133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-02110e99-39bf-4574-823f-5a72847e4c3a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:45.697888 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-02110e99-39bf-4574-823f-5a72847e4c3a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:45.700034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-02110e99-39bf-4574-823f-5a72847e4c3a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:45.702146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-02110e99-39bf-4574-823f-5a72847e4c3a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:47.598665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:47.635215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e743af48-ef4a-412b-8f59-b72f125c936a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:47.653570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e743af48-ef4a-412b-8f59-b72f125c936a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 3.059264 Sep 13 19:58:47.654243 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 34/55] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:44 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 3062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:47.665464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6dbb8770-a78c-4bfe-8122-a5c4cacae94e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:47.672416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6dbb8770-a78c-4bfe-8122-a5c4cacae94e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:47.686907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6dbb8770-a78c-4bfe-8122-a5c4cacae94e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:47.694550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6dbb8770-a78c-4bfe-8122-a5c4cacae94e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:47.694550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6dbb8770-a78c-4bfe-8122-a5c4cacae94e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:47.697255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6dbb8770-a78c-4bfe-8122-a5c4cacae94e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:47.703858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6dbb8770-a78c-4bfe-8122-a5c4cacae94e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:47.706151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6dbb8770-a78c-4bfe-8122-a5c4cacae94e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.072435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-02110e99-39bf-4574-823f-5a72847e4c3a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:48.089226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-02110e99-39bf-4574-823f-5a72847e4c3a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 2.468436 Sep 13 19:58:48.089817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 22/56] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:45 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 2470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:48.507692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-b75c5cfd-961f-43c2-886c-3377c00231ea req-59c23fb8-812d-4bdd-8bc3-8546818c44d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9023a0ae-81d4-4d4b-b223-340bc286c78d", "tag": "183c0c24-2522-4f2c-ab0d-0148986b5686"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:48.552597 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-b75c5cfd-961f-43c2-886c-3377c00231ea req-59c23fb8-812d-4bdd-8bc3-8546818c44d7 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.555593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-b75c5cfd-961f-43c2-886c-3377c00231ea req-59c23fb8-812d-4bdd-8bc3-8546818c44d7 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.558163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-b75c5cfd-961f-43c2-886c-3377c00231ea req-59c23fb8-812d-4bdd-8bc3-8546818c44d7 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.565022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=20 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:48.643953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-b75c5cfd-961f-43c2-886c-3377c00231ea req-59c23fb8-812d-4bdd-8bc3-8546818c44d7 service nova] Creating event network-changed:183c0c24-2522-4f2c-ab0d-0148986b5686 for instance 9023a0ae-81d4-4d4b-b223-340bc286c78d on hv-cinder-85427 Sep 13 19:58:48.651601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-b75c5cfd-961f-43c2-886c-3377c00231ea req-59c23fb8-812d-4bdd-8bc3-8546818c44d7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120845) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 19:58:48.656735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-b75c5cfd-961f-43c2-886c-3377c00231ea req-59c23fb8-812d-4bdd-8bc3-8546818c44d7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120845) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 19:58:48.663091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6d161d-f9fc-4221-895d-2c8b102d211a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.663693 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6d161d-f9fc-4221-895d-2c8b102d211a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.664220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6d161d-f9fc-4221-895d-2c8b102d211a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.676758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6d161d-f9fc-4221-895d-2c8b102d211a None None] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.677596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6d161d-f9fc-4221-895d-2c8b102d211a None None] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.678699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6d161d-f9fc-4221-895d-2c8b102d211a None None] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.694614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6dbb8770-a78c-4bfe-8122-a5c4cacae94e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:48.715059 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.compute.rpcapi [None req-da6d161d-f9fc-4221-895d-2c8b102d211a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 19:58:48.716186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6d161d-f9fc-4221-895d-2c8b102d211a None None] Releasing lock "compute-rpcapi-router" {{(pid=120845) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 19:58:48.753955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-da6d161d-f9fc-4221-895d-2c8b102d211a None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.660722 Sep 13 19:58:48.754833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 23/57] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:48.761256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-10f0dda8-d44a-424e-ac7b-fe65b63860b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:48.766158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6dbb8770-a78c-4bfe-8122-a5c4cacae94e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:48.767993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6dbb8770-a78c-4bfe-8122-a5c4cacae94e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:48.768662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-10f0dda8-d44a-424e-ac7b-fe65b63860b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:48.769143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6dbb8770-a78c-4bfe-8122-a5c4cacae94e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1334 microversion: 2.20 time: 1.111643 Sep 13 19:58:48.769715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 35/58] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:58:47 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1334 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:58:48.806313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10f0dda8-d44a-424e-ac7b-fe65b63860b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.806950 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10f0dda8-d44a-424e-ac7b-fe65b63860b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.808065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10f0dda8-d44a-424e-ac7b-fe65b63860b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.810360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10f0dda8-d44a-424e-ac7b-fe65b63860b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.810937 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10f0dda8-d44a-424e-ac7b-fe65b63860b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.811876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10f0dda8-d44a-424e-ac7b-fe65b63860b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:49.142223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-275861c9-39c6-4e63-a1df-24602507796c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:49.147960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-275861c9-39c6-4e63-a1df-24602507796c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:49.181890 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-275861c9-39c6-4e63-a1df-24602507796c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:49.182848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-275861c9-39c6-4e63-a1df-24602507796c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:49.183649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-275861c9-39c6-4e63-a1df-24602507796c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:49.185018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-275861c9-39c6-4e63-a1df-24602507796c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:49.185961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-275861c9-39c6-4e63-a1df-24602507796c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:49.207221 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-275861c9-39c6-4e63-a1df-24602507796c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:49.941166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-275861c9-39c6-4e63-a1df-24602507796c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:49.954910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-275861c9-39c6-4e63-a1df-24602507796c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 0.820828 Sep 13 19:58:49.972779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 36/59] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:49 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:49.988611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f75ac348-63d5-4235-b124-1e1dc14d63e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:49.998676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f75ac348-63d5-4235-b124-1e1dc14d63e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:50.017315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f75ac348-63d5-4235-b124-1e1dc14d63e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:50.018166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f75ac348-63d5-4235-b124-1e1dc14d63e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:50.018772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f75ac348-63d5-4235-b124-1e1dc14d63e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:50.019717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f75ac348-63d5-4235-b124-1e1dc14d63e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:50.024493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f75ac348-63d5-4235-b124-1e1dc14d63e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:50.025613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f75ac348-63d5-4235-b124-1e1dc14d63e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:50.308542 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f75ac348-63d5-4235-b124-1e1dc14d63e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:50.337238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f75ac348-63d5-4235-b124-1e1dc14d63e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:50.345722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f75ac348-63d5-4235-b124-1e1dc14d63e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:50.350729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f75ac348-63d5-4235-b124-1e1dc14d63e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1340 microversion: 2.20 time: 0.374913 Sep 13 19:58:50.353071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 37/60] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:58:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1340 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:58:51.001289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-10f0dda8-d44a-424e-ac7b-fe65b63860b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:51.021823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-10f0dda8-d44a-424e-ac7b-fe65b63860b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 2.265135 Sep 13 19:58:51.027728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 24/61] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:48 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:51.044019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f6321aeb-84ce-40e7-b0e1-0c9ff267bb2a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:51.046206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f6321aeb-84ce-40e7-b0e1-0c9ff267bb2a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:51.050679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=6 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:51.071218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6321aeb-84ce-40e7-b0e1-0c9ff267bb2a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:51.072056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6321aeb-84ce-40e7-b0e1-0c9ff267bb2a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:51.077090 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6321aeb-84ce-40e7-b0e1-0c9ff267bb2a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:51.079992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6321aeb-84ce-40e7-b0e1-0c9ff267bb2a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:51.080766 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6321aeb-84ce-40e7-b0e1-0c9ff267bb2a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:51.081623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6321aeb-84ce-40e7-b0e1-0c9ff267bb2a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:51.341489 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-42c47dda-f3e1-4570-a1b6-ae7d671948d3 req-040f9cc3-2d0a-4d5e-9765-0fb89df87d2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0fd2dce-024b-45c3-add3-01474a42c86f", "tag": "60931cbe-66dd-401a-834f-6790eb3724c0"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:51.363739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-42c47dda-f3e1-4570-a1b6-ae7d671948d3 req-040f9cc3-2d0a-4d5e-9765-0fb89df87d2d service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:51.364211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-42c47dda-f3e1-4570-a1b6-ae7d671948d3 req-040f9cc3-2d0a-4d5e-9765-0fb89df87d2d service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:51.364661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-42c47dda-f3e1-4570-a1b6-ae7d671948d3 req-040f9cc3-2d0a-4d5e-9765-0fb89df87d2d service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:51.395874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=78 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:51.413164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-42c47dda-f3e1-4570-a1b6-ae7d671948d3 req-040f9cc3-2d0a-4d5e-9765-0fb89df87d2d service nova] Creating event network-changed:60931cbe-66dd-401a-834f-6790eb3724c0 for instance e0fd2dce-024b-45c3-add3-01474a42c86f on hv-cinder-85427 Sep 13 19:58:51.413698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-42c47dda-f3e1-4570-a1b6-ae7d671948d3 req-040f9cc3-2d0a-4d5e-9765-0fb89df87d2d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 19:58:51.414078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-42c47dda-f3e1-4570-a1b6-ae7d671948d3 req-040f9cc3-2d0a-4d5e-9765-0fb89df87d2d service nova] Acquired lock "compute-rpcapi-router" {{(pid=120844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 19:58:51.415206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5be7c0e-3497-40b9-93e7-3a5893c91be8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:51.415660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5be7c0e-3497-40b9-93e7-3a5893c91be8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:51.416075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5be7c0e-3497-40b9-93e7-3a5893c91be8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:51.427501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5be7c0e-3497-40b9-93e7-3a5893c91be8 None None] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:51.427983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5be7c0e-3497-40b9-93e7-3a5893c91be8 None None] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:51.428404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5be7c0e-3497-40b9-93e7-3a5893c91be8 None None] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:51.442522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.compute.rpcapi [None req-f5be7c0e-3497-40b9-93e7-3a5893c91be8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 19:58:51.455580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5be7c0e-3497-40b9-93e7-3a5893c91be8 None None] Releasing lock "compute-rpcapi-router" {{(pid=120844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 19:58:51.475850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f5be7c0e-3497-40b9-93e7-3a5893c91be8 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.510765 Sep 13 19:58:51.476834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 38/62] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:51.483917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-17b3d8b9-9c86-4036-9bd1-a0fe5b17adc7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:51.514974 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-17b3d8b9-9c86-4036-9bd1-a0fe5b17adc7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:51.554871 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:51.565441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17b3d8b9-9c86-4036-9bd1-a0fe5b17adc7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:51.583612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17b3d8b9-9c86-4036-9bd1-a0fe5b17adc7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:51.584561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17b3d8b9-9c86-4036-9bd1-a0fe5b17adc7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:51.588563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17b3d8b9-9c86-4036-9bd1-a0fe5b17adc7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:51.591649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17b3d8b9-9c86-4036-9bd1-a0fe5b17adc7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:51.593092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17b3d8b9-9c86-4036-9bd1-a0fe5b17adc7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:51.927753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17b3d8b9-9c86-4036-9bd1-a0fe5b17adc7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:51.945757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17b3d8b9-9c86-4036-9bd1-a0fe5b17adc7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:51.961890 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17b3d8b9-9c86-4036-9bd1-a0fe5b17adc7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:51.966395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-17b3d8b9-9c86-4036-9bd1-a0fe5b17adc7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1340 microversion: 2.20 time: 0.486664 Sep 13 19:58:51.969424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f6321aeb-84ce-40e7-b0e1-0c9ff267bb2a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:51.971855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 39/63] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:58:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1340 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:58:52.006836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f6321aeb-84ce-40e7-b0e1-0c9ff267bb2a tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 0.975904 Sep 13 19:58:52.009806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 25/64] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:51 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:52.051428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-01dacbce-81c9-42f3-9174-6cdc32505360 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:52.052304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-01dacbce-81c9-42f3-9174-6cdc32505360 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:52.059407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-01dacbce-81c9-42f3-9174-6cdc32505360 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:52.059962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-01dacbce-81c9-42f3-9174-6cdc32505360 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:52.060565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-01dacbce-81c9-42f3-9174-6cdc32505360 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:52.061534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-01dacbce-81c9-42f3-9174-6cdc32505360 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:52.062262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-01dacbce-81c9-42f3-9174-6cdc32505360 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:52.063236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-01dacbce-81c9-42f3-9174-6cdc32505360 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:52.337199 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-01dacbce-81c9-42f3-9174-6cdc32505360 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:52.353036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-01dacbce-81c9-42f3-9174-6cdc32505360 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.306170 Sep 13 19:58:52.356065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 40/65] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:52 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:53.000811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-041e9e7a-946e-41b0-95cf-beb2e0db302b req-1aa08a3b-0601-448e-8118-6f20cdca26ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1188b80c-75f7-4d0e-a43b-4f1285e63a69", "tag": "472b58b8-c20c-4b18-bc4b-7be000f86805"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:53.004281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-474e7d22-0076-4f4f-b5e5-80cc57d44aa0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:53.005228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-474e7d22-0076-4f4f-b5e5-80cc57d44aa0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:53.021049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-474e7d22-0076-4f4f-b5e5-80cc57d44aa0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.024057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-474e7d22-0076-4f4f-b5e5-80cc57d44aa0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.024562 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-474e7d22-0076-4f4f-b5e5-80cc57d44aa0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.029307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-474e7d22-0076-4f4f-b5e5-80cc57d44aa0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.034082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-474e7d22-0076-4f4f-b5e5-80cc57d44aa0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.034961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-041e9e7a-946e-41b0-95cf-beb2e0db302b req-1aa08a3b-0601-448e-8118-6f20cdca26ad service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.036909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-041e9e7a-946e-41b0-95cf-beb2e0db302b req-1aa08a3b-0601-448e-8118-6f20cdca26ad service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.037573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-041e9e7a-946e-41b0-95cf-beb2e0db302b req-1aa08a3b-0601-448e-8118-6f20cdca26ad service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.037699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-474e7d22-0076-4f4f-b5e5-80cc57d44aa0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.053760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-041e9e7a-946e-41b0-95cf-beb2e0db302b req-1aa08a3b-0601-448e-8118-6f20cdca26ad service nova] Creating event network-changed:472b58b8-c20c-4b18-bc4b-7be000f86805 for instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 on hv-cinder-85427 Sep 13 19:58:53.062726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-041e9e7a-946e-41b0-95cf-beb2e0db302b req-1aa08a3b-0601-448e-8118-6f20cdca26ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067387 Sep 13 19:58:53.064631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 26/66] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:53.076604 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5d42ef01-d49e-4d86-878c-49bbdb0d2600 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:53.077858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5d42ef01-d49e-4d86-878c-49bbdb0d2600 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:53.091347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d42ef01-d49e-4d86-878c-49bbdb0d2600 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.092006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d42ef01-d49e-4d86-878c-49bbdb0d2600 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.092819 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d42ef01-d49e-4d86-878c-49bbdb0d2600 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.093539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d42ef01-d49e-4d86-878c-49bbdb0d2600 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.093997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d42ef01-d49e-4d86-878c-49bbdb0d2600 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.094591 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d42ef01-d49e-4d86-878c-49bbdb0d2600 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.383130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-474e7d22-0076-4f4f-b5e5-80cc57d44aa0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:53.396523 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-474e7d22-0076-4f4f-b5e5-80cc57d44aa0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:53.401572 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-474e7d22-0076-4f4f-b5e5-80cc57d44aa0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:53.405617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-474e7d22-0076-4f4f-b5e5-80cc57d44aa0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.404361 Sep 13 19:58:53.408020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 41/67] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:58:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:58:53.414703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ac31b4f8-7af3-4943-a695-1e18c8544ada tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:53.415460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ac31b4f8-7af3-4943-a695-1e18c8544ada tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:53.423274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ac31b4f8-7af3-4943-a695-1e18c8544ada tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.423821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ac31b4f8-7af3-4943-a695-1e18c8544ada tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.424337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ac31b4f8-7af3-4943-a695-1e18c8544ada tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.425497 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ac31b4f8-7af3-4943-a695-1e18c8544ada tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.426749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ac31b4f8-7af3-4943-a695-1e18c8544ada tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.427370 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ac31b4f8-7af3-4943-a695-1e18c8544ada tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.520956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5d42ef01-d49e-4d86-878c-49bbdb0d2600 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:53.565586 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5d42ef01-d49e-4d86-878c-49bbdb0d2600 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 0.496878 Sep 13 19:58:53.569889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 27/68] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:53 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:53.977151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ac31b4f8-7af3-4943-a695-1e18c8544ada tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:53.994096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ac31b4f8-7af3-4943-a695-1e18c8544ada tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.578161 Sep 13 19:58:53.996431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 42/69] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:53 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:54.437550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b4323ec5-1aed-4055-97b7-b89bd2d76bf7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:54.438397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b4323ec5-1aed-4055-97b7-b89bd2d76bf7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:54.456418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4323ec5-1aed-4055-97b7-b89bd2d76bf7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:54.457343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4323ec5-1aed-4055-97b7-b89bd2d76bf7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:54.462260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4323ec5-1aed-4055-97b7-b89bd2d76bf7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:54.466718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4323ec5-1aed-4055-97b7-b89bd2d76bf7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:54.467672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4323ec5-1aed-4055-97b7-b89bd2d76bf7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:54.468131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4323ec5-1aed-4055-97b7-b89bd2d76bf7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:54.597378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-45f74f93-1776-4ba1-9209-f32542aa4cd6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:54.597971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-45f74f93-1776-4ba1-9209-f32542aa4cd6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:54.615654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45f74f93-1776-4ba1-9209-f32542aa4cd6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:54.620395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45f74f93-1776-4ba1-9209-f32542aa4cd6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:54.621870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45f74f93-1776-4ba1-9209-f32542aa4cd6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:54.623105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45f74f93-1776-4ba1-9209-f32542aa4cd6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:54.623750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45f74f93-1776-4ba1-9209-f32542aa4cd6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:54.625472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45f74f93-1776-4ba1-9209-f32542aa4cd6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:54.852446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-45f74f93-1776-4ba1-9209-f32542aa4cd6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:54.864189 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-45f74f93-1776-4ba1-9209-f32542aa4cd6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 0.272130 Sep 13 19:58:54.878265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 43/70] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:54 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:55.021384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f3c11df2-9a94-45bd-8065-20e15bf2a1af tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:55.022226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f3c11df2-9a94-45bd-8065-20e15bf2a1af tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:55.042788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f3c11df2-9a94-45bd-8065-20e15bf2a1af tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:55.043653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f3c11df2-9a94-45bd-8065-20e15bf2a1af tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:55.044424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f3c11df2-9a94-45bd-8065-20e15bf2a1af tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:55.046311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f3c11df2-9a94-45bd-8065-20e15bf2a1af tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:55.049211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f3c11df2-9a94-45bd-8065-20e15bf2a1af tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:55.050066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f3c11df2-9a94-45bd-8065-20e15bf2a1af tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:55.256925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=18 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:55.495533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b4323ec5-1aed-4055-97b7-b89bd2d76bf7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:55.508782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f3c11df2-9a94-45bd-8065-20e15bf2a1af tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:55.509883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b4323ec5-1aed-4055-97b7-b89bd2d76bf7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:55.516865 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b4323ec5-1aed-4055-97b7-b89bd2d76bf7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:55.517277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f3c11df2-9a94-45bd-8065-20e15bf2a1af tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.500225 Sep 13 19:58:55.520794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b4323ec5-1aed-4055-97b7-b89bd2d76bf7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 1.086190 Sep 13 19:58:55.523482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 44/71] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:55 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:55.523964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 28/72] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:58:54 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:58:55.897051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-14e90cb7-d635-49a5-9c41-2d966d211003 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:55.897824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-14e90cb7-d635-49a5-9c41-2d966d211003 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:55.909121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14e90cb7-d635-49a5-9c41-2d966d211003 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:55.910054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14e90cb7-d635-49a5-9c41-2d966d211003 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:55.910887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14e90cb7-d635-49a5-9c41-2d966d211003 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:55.911876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14e90cb7-d635-49a5-9c41-2d966d211003 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:55.913061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14e90cb7-d635-49a5-9c41-2d966d211003 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:55.913946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14e90cb7-d635-49a5-9c41-2d966d211003 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:56.176029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-14e90cb7-d635-49a5-9c41-2d966d211003 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:56.184948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-14e90cb7-d635-49a5-9c41-2d966d211003 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 0.300335 Sep 13 19:58:56.200632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 45/73] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:55 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:56.544170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6cf55591-baa9-4f38-a2b5-39acfbdb2488 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:56.544768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6cf55591-baa9-4f38-a2b5-39acfbdb2488 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:56.558078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-11a8e43f-af55-475e-bf0a-05420c0093b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:56.558078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-11a8e43f-af55-475e-bf0a-05420c0093b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:56.580001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cf55591-baa9-4f38-a2b5-39acfbdb2488 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:56.582583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11a8e43f-af55-475e-bf0a-05420c0093b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:56.582935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cf55591-baa9-4f38-a2b5-39acfbdb2488 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:56.583554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cf55591-baa9-4f38-a2b5-39acfbdb2488 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:56.584273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11a8e43f-af55-475e-bf0a-05420c0093b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:56.585152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11a8e43f-af55-475e-bf0a-05420c0093b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:56.585825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cf55591-baa9-4f38-a2b5-39acfbdb2488 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:56.587805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11a8e43f-af55-475e-bf0a-05420c0093b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:56.588474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cf55591-baa9-4f38-a2b5-39acfbdb2488 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:56.589070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cf55591-baa9-4f38-a2b5-39acfbdb2488 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:56.589827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11a8e43f-af55-475e-bf0a-05420c0093b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:56.592649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11a8e43f-af55-475e-bf0a-05420c0093b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:56.914357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6cf55591-baa9-4f38-a2b5-39acfbdb2488 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:56.921697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-11a8e43f-af55-475e-bf0a-05420c0093b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:56.926404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6cf55591-baa9-4f38-a2b5-39acfbdb2488 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.386190 Sep 13 19:58:56.938748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-11a8e43f-af55-475e-bf0a-05420c0093b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:56.939135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-11a8e43f-af55-475e-bf0a-05420c0093b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:56.940250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 29/74] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:56 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:56.941433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-11a8e43f-af55-475e-bf0a-05420c0093b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.388333 Sep 13 19:58:56.957268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 46/75] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:58:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:58:56.962313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-0d160290-f732-420a-82ee-19526534f1d0 req-4fdfa4f4-2bf8-4484-97f2-1bc9599c9db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0decb4-2f46-4f2f-860f-e8ca277f7080", "tag": "2f770f4f-2f9f-4723-a236-5204e36adea7"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:56.975666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0d160290-f732-420a-82ee-19526534f1d0 req-4fdfa4f4-2bf8-4484-97f2-1bc9599c9db9 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:56.976489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0d160290-f732-420a-82ee-19526534f1d0 req-4fdfa4f4-2bf8-4484-97f2-1bc9599c9db9 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:56.977102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0d160290-f732-420a-82ee-19526534f1d0 req-4fdfa4f4-2bf8-4484-97f2-1bc9599c9db9 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:56.991203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-0d160290-f732-420a-82ee-19526534f1d0 req-4fdfa4f4-2bf8-4484-97f2-1bc9599c9db9 service nova] Creating event network-changed:2f770f4f-2f9f-4723-a236-5204e36adea7 for instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 on hv-cinder-85427 Sep 13 19:58:56.998295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-0d160290-f732-420a-82ee-19526534f1d0 req-4fdfa4f4-2bf8-4484-97f2-1bc9599c9db9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052299 Sep 13 19:58:56.999114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 30/76] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:57.215784 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e5da09ee-f792-4755-835a-df61d880193f tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:57.220013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e5da09ee-f792-4755-835a-df61d880193f tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:57.247039 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5da09ee-f792-4755-835a-df61d880193f tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.247588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5da09ee-f792-4755-835a-df61d880193f tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.248032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5da09ee-f792-4755-835a-df61d880193f tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.248760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5da09ee-f792-4755-835a-df61d880193f tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.251612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5da09ee-f792-4755-835a-df61d880193f tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.257658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5da09ee-f792-4755-835a-df61d880193f tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.489921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-3ef34d1d-9847-41db-ac75-18b2c3b4f7c3 req-554963d9-3cc8-4819-a121-47043ce97b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9023a0ae-81d4-4d4b-b223-340bc286c78d", "name": "network-vif-plugged", "status": "completed", "tag": "183c0c24-2522-4f2c-ab0d-0148986b5686"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:57.527835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-3ef34d1d-9847-41db-ac75-18b2c3b4f7c3 req-554963d9-3cc8-4819-a121-47043ce97b4d service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.528761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-3ef34d1d-9847-41db-ac75-18b2c3b4f7c3 req-554963d9-3cc8-4819-a121-47043ce97b4d service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.531214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-3ef34d1d-9847-41db-ac75-18b2c3b4f7c3 req-554963d9-3cc8-4819-a121-47043ce97b4d service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.561015 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-3ef34d1d-9847-41db-ac75-18b2c3b4f7c3 req-554963d9-3cc8-4819-a121-47043ce97b4d service nova] Creating event network-vif-plugged:183c0c24-2522-4f2c-ab0d-0148986b5686 for instance 9023a0ae-81d4-4d4b-b223-340bc286c78d on hv-cinder-85427 Sep 13 19:58:57.576402 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-3ef34d1d-9847-41db-ac75-18b2c3b4f7c3 req-554963d9-3cc8-4819-a121-47043ce97b4d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212864 Sep 13 19:58:57.577383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 31/77] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:57.681766 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e5da09ee-f792-4755-835a-df61d880193f tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:57.695637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e5da09ee-f792-4755-835a-df61d880193f tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 0.491297 Sep 13 19:58:57.714207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 47/78] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:57 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:57.953205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fdd5be85-99ac-407b-9839-224d36d5b66e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:57.954057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fdd5be85-99ac-407b-9839-224d36d5b66e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:57.966892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fdd5be85-99ac-407b-9839-224d36d5b66e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.968037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fdd5be85-99ac-407b-9839-224d36d5b66e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.968683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fdd5be85-99ac-407b-9839-224d36d5b66e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.970262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fdd5be85-99ac-407b-9839-224d36d5b66e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.971127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fdd5be85-99ac-407b-9839-224d36d5b66e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.971873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fdd5be85-99ac-407b-9839-224d36d5b66e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.972708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-de13e916-c4f6-4605-960c-e6901a384394 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:57.973272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-de13e916-c4f6-4605-960c-e6901a384394 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:57.981220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de13e916-c4f6-4605-960c-e6901a384394 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.982910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de13e916-c4f6-4605-960c-e6901a384394 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.983831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de13e916-c4f6-4605-960c-e6901a384394 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.984788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de13e916-c4f6-4605-960c-e6901a384394 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.985437 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de13e916-c4f6-4605-960c-e6901a384394 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.986095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de13e916-c4f6-4605-960c-e6901a384394 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:58.189786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-de13e916-c4f6-4605-960c-e6901a384394 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:58.199590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-de13e916-c4f6-4605-960c-e6901a384394 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:58.201852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-de13e916-c4f6-4605-960c-e6901a384394 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:58.203152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-de13e916-c4f6-4605-960c-e6901a384394 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.237748 Sep 13 19:58:58.204267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 48/79] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:58:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:58:58.388288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fdd5be85-99ac-407b-9839-224d36d5b66e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:58.402075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fdd5be85-99ac-407b-9839-224d36d5b66e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.453080 Sep 13 19:58:58.414411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 32/80] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:57 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:58.725998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bc4b3033-f143-43c8-9a99-ddd8b91da659 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:58.726758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bc4b3033-f143-43c8-9a99-ddd8b91da659 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:58.739469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc4b3033-f143-43c8-9a99-ddd8b91da659 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:58.740631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc4b3033-f143-43c8-9a99-ddd8b91da659 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:58.742002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc4b3033-f143-43c8-9a99-ddd8b91da659 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:58.743314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc4b3033-f143-43c8-9a99-ddd8b91da659 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:58.743939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc4b3033-f143-43c8-9a99-ddd8b91da659 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:58.745016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc4b3033-f143-43c8-9a99-ddd8b91da659 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.007379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bc4b3033-f143-43c8-9a99-ddd8b91da659 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:59.019593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bc4b3033-f143-43c8-9a99-ddd8b91da659 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 0.299100 Sep 13 19:58:59.023938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 49/81] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:58 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:59.231486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0c53f3d8-b4cd-4be9-8516-8516795a94b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:59.232114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0c53f3d8-b4cd-4be9-8516-8516795a94b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:59.234482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=4 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:59.243587 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c53f3d8-b4cd-4be9-8516-8516795a94b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.244486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c53f3d8-b4cd-4be9-8516-8516795a94b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.244881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c53f3d8-b4cd-4be9-8516-8516795a94b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.245570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c53f3d8-b4cd-4be9-8516-8516795a94b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.249164 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c53f3d8-b4cd-4be9-8516-8516795a94b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.249650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c53f3d8-b4cd-4be9-8516-8516795a94b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.429123 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-669c8c9b-2735-4e3f-b9c0-cdbd93ba80c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:59.429906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-669c8c9b-2735-4e3f-b9c0-cdbd93ba80c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:59.440207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-669c8c9b-2735-4e3f-b9c0-cdbd93ba80c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.440883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-669c8c9b-2735-4e3f-b9c0-cdbd93ba80c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.441325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-669c8c9b-2735-4e3f-b9c0-cdbd93ba80c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.442044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-669c8c9b-2735-4e3f-b9c0-cdbd93ba80c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.442524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-669c8c9b-2735-4e3f-b9c0-cdbd93ba80c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.442945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-669c8c9b-2735-4e3f-b9c0-cdbd93ba80c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.502330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0c53f3d8-b4cd-4be9-8516-8516795a94b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:59.512147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0c53f3d8-b4cd-4be9-8516-8516795a94b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:59.514182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0c53f3d8-b4cd-4be9-8516-8516795a94b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:59.515885 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0c53f3d8-b4cd-4be9-8516-8516795a94b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.287852 Sep 13 19:58:59.516850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 33/82] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:58:59 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:58:59.594576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-fb751144-5ed1-4c2e-b886-a4450766c9e1 req-0d9bce3d-895f-49c3-b7a8-d6f1edc0e925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fd2dce-024b-45c3-add3-01474a42c86f", "name": "network-vif-plugged", "status": "completed", "tag": "60931cbe-66dd-401a-834f-6790eb3724c0"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:59.605544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-fb751144-5ed1-4c2e-b886-a4450766c9e1 req-0d9bce3d-895f-49c3-b7a8-d6f1edc0e925 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.606229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-fb751144-5ed1-4c2e-b886-a4450766c9e1 req-0d9bce3d-895f-49c3-b7a8-d6f1edc0e925 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.606862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-fb751144-5ed1-4c2e-b886-a4450766c9e1 req-0d9bce3d-895f-49c3-b7a8-d6f1edc0e925 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.619224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-fb751144-5ed1-4c2e-b886-a4450766c9e1 req-0d9bce3d-895f-49c3-b7a8-d6f1edc0e925 service nova] Creating event network-vif-plugged:60931cbe-66dd-401a-834f-6790eb3724c0 for instance e0fd2dce-024b-45c3-add3-01474a42c86f on hv-cinder-85427 Sep 13 19:58:59.624865 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-fb751144-5ed1-4c2e-b886-a4450766c9e1 req-0d9bce3d-895f-49c3-b7a8-d6f1edc0e925 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034956 Sep 13 19:58:59.626299 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 34/83] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:59.652503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-669c8c9b-2735-4e3f-b9c0-cdbd93ba80c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:59.661079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-669c8c9b-2735-4e3f-b9c0-cdbd93ba80c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.236541 Sep 13 19:58:59.661980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 50/84] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:59 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:00.048040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d72022fb-2b7a-4ffe-ab05-52d922861900 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:00.048942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d72022fb-2b7a-4ffe-ab05-52d922861900 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:00.056762 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d72022fb-2b7a-4ffe-ab05-52d922861900 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.057756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d72022fb-2b7a-4ffe-ab05-52d922861900 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.058407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d72022fb-2b7a-4ffe-ab05-52d922861900 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.059432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d72022fb-2b7a-4ffe-ab05-52d922861900 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.060111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d72022fb-2b7a-4ffe-ab05-52d922861900 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.060537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d72022fb-2b7a-4ffe-ab05-52d922861900 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.065519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=71 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:00.241901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d72022fb-2b7a-4ffe-ab05-52d922861900 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:00.250658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d72022fb-2b7a-4ffe-ab05-52d922861900 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 0.206845 Sep 13 19:59:00.251234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 35/85] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:00 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:00.544903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d32520e8-cb14-4962-9207-ca31f7fee4c3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:00.544903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d32520e8-cb14-4962-9207-ca31f7fee4c3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:00.550638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d32520e8-cb14-4962-9207-ca31f7fee4c3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.551113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d32520e8-cb14-4962-9207-ca31f7fee4c3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.551766 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d32520e8-cb14-4962-9207-ca31f7fee4c3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.552463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d32520e8-cb14-4962-9207-ca31f7fee4c3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.552902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d32520e8-cb14-4962-9207-ca31f7fee4c3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.553306 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d32520e8-cb14-4962-9207-ca31f7fee4c3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.686776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bf637759-9385-459c-9186-ab4dac3ae05d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:00.687712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bf637759-9385-459c-9186-ab4dac3ae05d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:00.699424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bf637759-9385-459c-9186-ab4dac3ae05d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.699908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bf637759-9385-459c-9186-ab4dac3ae05d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.700335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bf637759-9385-459c-9186-ab4dac3ae05d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.701026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bf637759-9385-459c-9186-ab4dac3ae05d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.701470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bf637759-9385-459c-9186-ab4dac3ae05d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.701883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bf637759-9385-459c-9186-ab4dac3ae05d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.706205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d32520e8-cb14-4962-9207-ca31f7fee4c3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:00.715486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d32520e8-cb14-4962-9207-ca31f7fee4c3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:00.717502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d32520e8-cb14-4962-9207-ca31f7fee4c3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:00.719026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d32520e8-cb14-4962-9207-ca31f7fee4c3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.182150 Sep 13 19:59:00.736543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 51/86] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:00 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:00.844637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bf637759-9385-459c-9186-ab4dac3ae05d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:00.852558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bf637759-9385-459c-9186-ab4dac3ae05d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.170674 Sep 13 19:59:00.853131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 36/87] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:00 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:01.273790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b1658680-826e-4d32-8345-7f40a105e7aa tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:01.275181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b1658680-826e-4d32-8345-7f40a105e7aa tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:01.281676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1658680-826e-4d32-8345-7f40a105e7aa tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:01.282183 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1658680-826e-4d32-8345-7f40a105e7aa tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:01.282840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1658680-826e-4d32-8345-7f40a105e7aa tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:01.283557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1658680-826e-4d32-8345-7f40a105e7aa tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:01.284010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1658680-826e-4d32-8345-7f40a105e7aa tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:01.284428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1658680-826e-4d32-8345-7f40a105e7aa tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:01.421265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b1658680-826e-4d32-8345-7f40a105e7aa tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:01.430029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b1658680-826e-4d32-8345-7f40a105e7aa tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 0.160742 Sep 13 19:59:01.430679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 52/88] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:01 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:01.743833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b8dae06a-bcd2-46da-be5c-3a3e4b667b59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:01.744472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b8dae06a-bcd2-46da-be5c-3a3e4b667b59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:01.750329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b8dae06a-bcd2-46da-be5c-3a3e4b667b59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:01.750842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b8dae06a-bcd2-46da-be5c-3a3e4b667b59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:01.751267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b8dae06a-bcd2-46da-be5c-3a3e4b667b59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:01.751953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b8dae06a-bcd2-46da-be5c-3a3e4b667b59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:01.752393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b8dae06a-bcd2-46da-be5c-3a3e4b667b59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:01.752807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b8dae06a-bcd2-46da-be5c-3a3e4b667b59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:01.876330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-43946478-b113-4a9a-aac9-f91d99a44436 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:01.876935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-43946478-b113-4a9a-aac9-f91d99a44436 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:01.879873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:01.888371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43946478-b113-4a9a-aac9-f91d99a44436 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:01.888865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43946478-b113-4a9a-aac9-f91d99a44436 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:01.889302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43946478-b113-4a9a-aac9-f91d99a44436 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:01.890064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43946478-b113-4a9a-aac9-f91d99a44436 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:01.890554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43946478-b113-4a9a-aac9-f91d99a44436 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:01.891032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43946478-b113-4a9a-aac9-f91d99a44436 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:02.063630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b8dae06a-bcd2-46da-be5c-3a3e4b667b59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:02.074396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b8dae06a-bcd2-46da-be5c-3a3e4b667b59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:02.075838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b8dae06a-bcd2-46da-be5c-3a3e4b667b59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:02.083508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b8dae06a-bcd2-46da-be5c-3a3e4b667b59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.342595 Sep 13 19:59:02.084625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 37/89] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:02.085080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-43946478-b113-4a9a-aac9-f91d99a44436 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:02.096963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-43946478-b113-4a9a-aac9-f91d99a44436 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.224820 Sep 13 19:59:02.097821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 53/90] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:01 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:02.456305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a89377d7-6342-4f76-8527-bea3f35587c5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:02.456305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a89377d7-6342-4f76-8527-bea3f35587c5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:02.461901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a89377d7-6342-4f76-8527-bea3f35587c5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:02.462733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a89377d7-6342-4f76-8527-bea3f35587c5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:02.463127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a89377d7-6342-4f76-8527-bea3f35587c5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:02.463926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a89377d7-6342-4f76-8527-bea3f35587c5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:02.465795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a89377d7-6342-4f76-8527-bea3f35587c5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:02.466258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a89377d7-6342-4f76-8527-bea3f35587c5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:02.681045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a89377d7-6342-4f76-8527-bea3f35587c5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:02.690764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a89377d7-6342-4f76-8527-bea3f35587c5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1314 microversion: 2.1 time: 0.241113 Sep 13 19:59:02.691621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 38/91] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:02 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:03.113260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c4a01e88-6c52-4882-bb14-03ce6a1f2eee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:03.113910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c4a01e88-6c52-4882-bb14-03ce6a1f2eee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:03.120621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4a01e88-6c52-4882-bb14-03ce6a1f2eee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.121453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4a01e88-6c52-4882-bb14-03ce6a1f2eee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.122066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4a01e88-6c52-4882-bb14-03ce6a1f2eee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.122917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4a01e88-6c52-4882-bb14-03ce6a1f2eee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.123385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4a01e88-6c52-4882-bb14-03ce6a1f2eee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.123982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4a01e88-6c52-4882-bb14-03ce6a1f2eee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.126465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-222fc530-15e0-43bf-a4e3-23b99b10ebd8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:03.127213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-222fc530-15e0-43bf-a4e3-23b99b10ebd8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:03.135723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-222fc530-15e0-43bf-a4e3-23b99b10ebd8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.136417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-222fc530-15e0-43bf-a4e3-23b99b10ebd8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.136899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-222fc530-15e0-43bf-a4e3-23b99b10ebd8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.138014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-222fc530-15e0-43bf-a4e3-23b99b10ebd8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.138714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-222fc530-15e0-43bf-a4e3-23b99b10ebd8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.139593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-222fc530-15e0-43bf-a4e3-23b99b10ebd8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.298637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c4a01e88-6c52-4882-bb14-03ce6a1f2eee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:03.311273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c4a01e88-6c52-4882-bb14-03ce6a1f2eee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:03.313111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c4a01e88-6c52-4882-bb14-03ce6a1f2eee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:03.314529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c4a01e88-6c52-4882-bb14-03ce6a1f2eee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.207993 Sep 13 19:59:03.326913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-222fc530-15e0-43bf-a4e3-23b99b10ebd8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:03.326913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-222fc530-15e0-43bf-a4e3-23b99b10ebd8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.205106 Sep 13 19:59:03.326913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 39/92] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:03 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:03.327840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 54/93] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:03.715529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8a00b07b-c16f-4dc8-93b8-d539b47049cf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:03.716066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8a00b07b-c16f-4dc8-93b8-d539b47049cf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:03.722995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a00b07b-c16f-4dc8-93b8-d539b47049cf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.723535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a00b07b-c16f-4dc8-93b8-d539b47049cf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.723972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a00b07b-c16f-4dc8-93b8-d539b47049cf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.724651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a00b07b-c16f-4dc8-93b8-d539b47049cf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.725356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a00b07b-c16f-4dc8-93b8-d539b47049cf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.725827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a00b07b-c16f-4dc8-93b8-d539b47049cf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.885506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8a00b07b-c16f-4dc8-93b8-d539b47049cf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:03.894171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8a00b07b-c16f-4dc8-93b8-d539b47049cf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1501 microversion: 2.1 time: 0.183007 Sep 13 19:59:03.894969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 40/94] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:03 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:04.341392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a817fcfa-fed0-43af-ad2e-1d5ae8db5e5a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:04.342468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a817fcfa-fed0-43af-ad2e-1d5ae8db5e5a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:04.348812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a817fcfa-fed0-43af-ad2e-1d5ae8db5e5a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:04.349304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a817fcfa-fed0-43af-ad2e-1d5ae8db5e5a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:04.349764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a817fcfa-fed0-43af-ad2e-1d5ae8db5e5a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:04.350454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a817fcfa-fed0-43af-ad2e-1d5ae8db5e5a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:04.350899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a817fcfa-fed0-43af-ad2e-1d5ae8db5e5a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:04.351310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a817fcfa-fed0-43af-ad2e-1d5ae8db5e5a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:04.351652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-30e7955d-32af-4761-95bd-ecaa806f97d9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:04.352387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-30e7955d-32af-4761-95bd-ecaa806f97d9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:04.355910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:04.360472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30e7955d-32af-4761-95bd-ecaa806f97d9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:04.361279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30e7955d-32af-4761-95bd-ecaa806f97d9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:04.361980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30e7955d-32af-4761-95bd-ecaa806f97d9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:04.363246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30e7955d-32af-4761-95bd-ecaa806f97d9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:04.363959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30e7955d-32af-4761-95bd-ecaa806f97d9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:04.364358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30e7955d-32af-4761-95bd-ecaa806f97d9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:04.508964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-30e7955d-32af-4761-95bd-ecaa806f97d9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:04.511586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a817fcfa-fed0-43af-ad2e-1d5ae8db5e5a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:04.516608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-30e7955d-32af-4761-95bd-ecaa806f97d9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.169333 Sep 13 19:59:04.518029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 41/95] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:04 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:04.525146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a817fcfa-fed0-43af-ad2e-1d5ae8db5e5a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:04.526806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a817fcfa-fed0-43af-ad2e-1d5ae8db5e5a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:04.528342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a817fcfa-fed0-43af-ad2e-1d5ae8db5e5a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.190973 Sep 13 19:59:04.528895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 55/96] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:04.784302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-86f1f9c5-4a7d-4d35-ba9f-28463fc3a448 req-42fa813a-b06a-4c42-8c7b-6f539325836d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1188b80c-75f7-4d0e-a43b-4f1285e63a69", "name": "network-vif-plugged", "status": "completed", "tag": "472b58b8-c20c-4b18-bc4b-7be000f86805"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:04.795935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-86f1f9c5-4a7d-4d35-ba9f-28463fc3a448 req-42fa813a-b06a-4c42-8c7b-6f539325836d service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:04.796511 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-86f1f9c5-4a7d-4d35-ba9f-28463fc3a448 req-42fa813a-b06a-4c42-8c7b-6f539325836d service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:04.797336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-86f1f9c5-4a7d-4d35-ba9f-28463fc3a448 req-42fa813a-b06a-4c42-8c7b-6f539325836d service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:04.819152 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-86f1f9c5-4a7d-4d35-ba9f-28463fc3a448 req-42fa813a-b06a-4c42-8c7b-6f539325836d service nova] Creating event network-vif-plugged:472b58b8-c20c-4b18-bc4b-7be000f86805 for instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 on hv-cinder-85427 Sep 13 19:59:04.825095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-86f1f9c5-4a7d-4d35-ba9f-28463fc3a448 req-42fa813a-b06a-4c42-8c7b-6f539325836d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044284 Sep 13 19:59:04.826326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 42/97] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:05.554289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-657b589a-cb6d-4860-b772-10ea7fa89fff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:05.554921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-657b589a-cb6d-4860-b772-10ea7fa89fff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:05.560344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7747b8ca-766d-45d3-a7bc-38e3cea4fb82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:05.560916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-657b589a-cb6d-4860-b772-10ea7fa89fff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:05.561427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7747b8ca-766d-45d3-a7bc-38e3cea4fb82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:05.561612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-657b589a-cb6d-4860-b772-10ea7fa89fff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:05.562293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-657b589a-cb6d-4860-b772-10ea7fa89fff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:05.563005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-657b589a-cb6d-4860-b772-10ea7fa89fff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:05.563613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-657b589a-cb6d-4860-b772-10ea7fa89fff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:05.563953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-657b589a-cb6d-4860-b772-10ea7fa89fff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:05.570022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7747b8ca-766d-45d3-a7bc-38e3cea4fb82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:05.570613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7747b8ca-766d-45d3-a7bc-38e3cea4fb82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:05.571032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7747b8ca-766d-45d3-a7bc-38e3cea4fb82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:05.571910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7747b8ca-766d-45d3-a7bc-38e3cea4fb82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:05.572410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7747b8ca-766d-45d3-a7bc-38e3cea4fb82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:05.572835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7747b8ca-766d-45d3-a7bc-38e3cea4fb82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:05.723140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-657b589a-cb6d-4860-b772-10ea7fa89fff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:05.731298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-657b589a-cb6d-4860-b772-10ea7fa89fff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.195450 Sep 13 19:59:05.731958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 56/98] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:05 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:05.734642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7747b8ca-766d-45d3-a7bc-38e3cea4fb82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:05.743480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7747b8ca-766d-45d3-a7bc-38e3cea4fb82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:05.745085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7747b8ca-766d-45d3-a7bc-38e3cea4fb82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:05.746353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7747b8ca-766d-45d3-a7bc-38e3cea4fb82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.192828 Sep 13 19:59:05.746949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 43/99] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:59:06.757721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-933e3bb4-886a-41c9-9e96-ad5eb3031b13 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:06.758333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-933e3bb4-886a-41c9-9e96-ad5eb3031b13 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:06.771032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fbf2a73a-e263-4155-babe-3292707abad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:06.771539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-933e3bb4-886a-41c9-9e96-ad5eb3031b13 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:06.771673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fbf2a73a-e263-4155-babe-3292707abad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:06.772264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-933e3bb4-886a-41c9-9e96-ad5eb3031b13 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:06.772738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-933e3bb4-886a-41c9-9e96-ad5eb3031b13 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:06.773568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-933e3bb4-886a-41c9-9e96-ad5eb3031b13 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:06.774550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-933e3bb4-886a-41c9-9e96-ad5eb3031b13 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:06.774550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-933e3bb4-886a-41c9-9e96-ad5eb3031b13 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:06.779743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbf2a73a-e263-4155-babe-3292707abad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:06.780420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbf2a73a-e263-4155-babe-3292707abad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:06.781242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbf2a73a-e263-4155-babe-3292707abad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:06.781862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbf2a73a-e263-4155-babe-3292707abad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:06.782308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbf2a73a-e263-4155-babe-3292707abad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:06.782744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbf2a73a-e263-4155-babe-3292707abad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:06.932928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-933e3bb4-886a-41c9-9e96-ad5eb3031b13 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:06.942909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-933e3bb4-886a-41c9-9e96-ad5eb3031b13 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.190949 Sep 13 19:59:06.944007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 57/100] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:06 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:07.023682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fbf2a73a-e263-4155-babe-3292707abad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:07.034804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fbf2a73a-e263-4155-babe-3292707abad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:07.036515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fbf2a73a-e263-4155-babe-3292707abad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:07.037765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fbf2a73a-e263-4155-babe-3292707abad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.270657 Sep 13 19:59:07.038675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 44/101] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:06 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:59:07.967045 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7e659323-3517-46a4-ad3b-dd6ccf9e8c5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:07.967654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7e659323-3517-46a4-ad3b-dd6ccf9e8c5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:07.975095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7e659323-3517-46a4-ad3b-dd6ccf9e8c5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:07.976275 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7e659323-3517-46a4-ad3b-dd6ccf9e8c5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:07.976933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7e659323-3517-46a4-ad3b-dd6ccf9e8c5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:07.978000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7e659323-3517-46a4-ad3b-dd6ccf9e8c5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:07.978887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7e659323-3517-46a4-ad3b-dd6ccf9e8c5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:07.979525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7e659323-3517-46a4-ad3b-dd6ccf9e8c5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:08.063166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a7ba5da6-b675-4368-ba38-46b25b7c051f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:08.064487 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a7ba5da6-b675-4368-ba38-46b25b7c051f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:08.071088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a7ba5da6-b675-4368-ba38-46b25b7c051f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:08.071457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a7ba5da6-b675-4368-ba38-46b25b7c051f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:08.071956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a7ba5da6-b675-4368-ba38-46b25b7c051f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:08.072648 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a7ba5da6-b675-4368-ba38-46b25b7c051f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:08.073106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a7ba5da6-b675-4368-ba38-46b25b7c051f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:08.073517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a7ba5da6-b675-4368-ba38-46b25b7c051f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:08.130994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7e659323-3517-46a4-ad3b-dd6ccf9e8c5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:08.139407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7e659323-3517-46a4-ad3b-dd6ccf9e8c5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.176630 Sep 13 19:59:08.140164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 58/102] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:07 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:08.217897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a7ba5da6-b675-4368-ba38-46b25b7c051f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:08.226289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a7ba5da6-b675-4368-ba38-46b25b7c051f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:08.227749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a7ba5da6-b675-4368-ba38-46b25b7c051f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:08.230541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a7ba5da6-b675-4368-ba38-46b25b7c051f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.169645 Sep 13 19:59:08.230541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 45/103] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:59:09.165079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-70f9f66a-d2f1-42b0-b4dd-93c452b50e80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:09.167398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-70f9f66a-d2f1-42b0-b4dd-93c452b50e80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:09.177081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70f9f66a-d2f1-42b0-b4dd-93c452b50e80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:09.177985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70f9f66a-d2f1-42b0-b4dd-93c452b50e80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:09.178520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70f9f66a-d2f1-42b0-b4dd-93c452b50e80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.179295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70f9f66a-d2f1-42b0-b4dd-93c452b50e80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:09.179992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70f9f66a-d2f1-42b0-b4dd-93c452b50e80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:09.180460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70f9f66a-d2f1-42b0-b4dd-93c452b50e80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.253263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-90c728e2-f799-4c66-a985-a8fda7f583db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:09.253874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-90c728e2-f799-4c66-a985-a8fda7f583db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:09.261704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90c728e2-f799-4c66-a985-a8fda7f583db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:09.262193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90c728e2-f799-4c66-a985-a8fda7f583db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:09.262668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90c728e2-f799-4c66-a985-a8fda7f583db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.263377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90c728e2-f799-4c66-a985-a8fda7f583db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:09.276511 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90c728e2-f799-4c66-a985-a8fda7f583db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:09.277471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90c728e2-f799-4c66-a985-a8fda7f583db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.383841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-70f9f66a-d2f1-42b0-b4dd-93c452b50e80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:09.392792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-70f9f66a-d2f1-42b0-b4dd-93c452b50e80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.234064 Sep 13 19:59:09.393785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 59/104] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:09 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:09.421563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-90c728e2-f799-4c66-a985-a8fda7f583db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:09.430398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-90c728e2-f799-4c66-a985-a8fda7f583db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:09.431857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-90c728e2-f799-4c66-a985-a8fda7f583db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:09.433015 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-90c728e2-f799-4c66-a985-a8fda7f583db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.183762 Sep 13 19:59:09.433826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 46/105] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:59:10.418902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5dfd1ea5-6b6e-48e8-9869-c8f25362a952 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:10.419533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5dfd1ea5-6b6e-48e8-9869-c8f25362a952 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:10.427590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5dfd1ea5-6b6e-48e8-9869-c8f25362a952 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.428402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5dfd1ea5-6b6e-48e8-9869-c8f25362a952 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.428954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5dfd1ea5-6b6e-48e8-9869-c8f25362a952 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.429656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5dfd1ea5-6b6e-48e8-9869-c8f25362a952 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.430104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5dfd1ea5-6b6e-48e8-9869-c8f25362a952 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.430557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5dfd1ea5-6b6e-48e8-9869-c8f25362a952 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.459315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ec08da67-32bc-4c66-a01b-b334a3982cce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:10.460581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ec08da67-32bc-4c66-a01b-b334a3982cce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:10.467174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec08da67-32bc-4c66-a01b-b334a3982cce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.467672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec08da67-32bc-4c66-a01b-b334a3982cce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.468078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec08da67-32bc-4c66-a01b-b334a3982cce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.469059 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec08da67-32bc-4c66-a01b-b334a3982cce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.469288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec08da67-32bc-4c66-a01b-b334a3982cce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.469830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec08da67-32bc-4c66-a01b-b334a3982cce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.628477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ec08da67-32bc-4c66-a01b-b334a3982cce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:10.638500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ec08da67-32bc-4c66-a01b-b334a3982cce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:10.641024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ec08da67-32bc-4c66-a01b-b334a3982cce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:10.642232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ec08da67-32bc-4c66-a01b-b334a3982cce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.186971 Sep 13 19:59:10.655310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 47/106] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:10.662991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5dfd1ea5-6b6e-48e8-9869-c8f25362a952 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:10.671548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5dfd1ea5-6b6e-48e8-9869-c8f25362a952 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.258768 Sep 13 19:59:10.672164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 60/107] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:10 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:11.671192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-59a37e98-400f-430f-ae66-4f6dfa50bbff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:11.674397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-59a37e98-400f-430f-ae66-4f6dfa50bbff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:11.684329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59a37e98-400f-430f-ae66-4f6dfa50bbff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:11.684841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59a37e98-400f-430f-ae66-4f6dfa50bbff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:11.685386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59a37e98-400f-430f-ae66-4f6dfa50bbff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:11.686209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59a37e98-400f-430f-ae66-4f6dfa50bbff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:11.686693 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59a37e98-400f-430f-ae66-4f6dfa50bbff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:11.687040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59a37e98-400f-430f-ae66-4f6dfa50bbff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:11.694603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-67187f8b-bf11-4471-bc47-375922dfd914 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:11.695370 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-67187f8b-bf11-4471-bc47-375922dfd914 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:11.702273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67187f8b-bf11-4471-bc47-375922dfd914 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:11.703004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67187f8b-bf11-4471-bc47-375922dfd914 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:11.703551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67187f8b-bf11-4471-bc47-375922dfd914 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:11.704348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67187f8b-bf11-4471-bc47-375922dfd914 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:11.704895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67187f8b-bf11-4471-bc47-375922dfd914 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:11.705496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67187f8b-bf11-4471-bc47-375922dfd914 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:11.874447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-59a37e98-400f-430f-ae66-4f6dfa50bbff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:11.885985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-59a37e98-400f-430f-ae66-4f6dfa50bbff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:11.887955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-59a37e98-400f-430f-ae66-4f6dfa50bbff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:11.889273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-59a37e98-400f-430f-ae66-4f6dfa50bbff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.224706 Sep 13 19:59:11.890078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 48/108] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:11 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:12.044087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-67187f8b-bf11-4471-bc47-375922dfd914 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:12.052107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-67187f8b-bf11-4471-bc47-375922dfd914 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1322 microversion: 2.1 time: 0.361382 Sep 13 19:59:12.052749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 61/109] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:11 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:12.788213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-730447159", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "networks": [{"uuid": "8b3e3196-2420-49f4-80a2-d60fffd9aaaa"}]}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:12.854727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] validate_networks() for [('8b3e3196-2420-49f4-80a2-d60fffd9aaaa', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:59:12.929472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-17453fef-25d5-4088-84e8-f68c1b96b66b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:12.930044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-17453fef-25d5-4088-84e8-f68c1b96b66b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:12.936987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17453fef-25d5-4088-84e8-f68c1b96b66b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:12.937504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17453fef-25d5-4088-84e8-f68c1b96b66b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:12.938129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17453fef-25d5-4088-84e8-f68c1b96b66b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:12.938868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17453fef-25d5-4088-84e8-f68c1b96b66b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:12.939585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17453fef-25d5-4088-84e8-f68c1b96b66b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:12.940133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17453fef-25d5-4088-84e8-f68c1b96b66b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.112569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17453fef-25d5-4088-84e8-f68c1b96b66b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:13.125549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17453fef-25d5-4088-84e8-f68c1b96b66b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:13.127296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17453fef-25d5-4088-84e8-f68c1b96b66b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:13.128599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-17453fef-25d5-4088-84e8-f68c1b96b66b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.203536 Sep 13 19:59:13.129941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 62/110] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:13.146855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-83fad394-764e-47d5-85c9-ec630b66d5cb tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ada8c86-d8cd-46da-8e0c-db02b547264f"}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:13.150130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-83fad394-764e-47d5-85c9-ec630b66d5cb tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:13.156954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83fad394-764e-47d5-85c9-ec630b66d5cb tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.158190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83fad394-764e-47d5-85c9-ec630b66d5cb tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.158633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83fad394-764e-47d5-85c9-ec630b66d5cb tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.159961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83fad394-764e-47d5-85c9-ec630b66d5cb tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.160484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83fad394-764e-47d5-85c9-ec630b66d5cb tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.161082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83fad394-764e-47d5-85c9-ec630b66d5cb tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.317252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:59:13.317925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:59:13.318721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:59:13.319358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:59:13.319910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:59:13.329998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.330526 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.330956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.331670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.332119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.332535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.350467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Getting quotas for project e0a89bb1e9c24a3d8ee45633959e59ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:59:13.355158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Getting quotas for user 7c17f29c73f643ca83a08f4e44e6279b and project e0a89bb1e9c24a3d8ee45633959e59ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:59:13.368274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:59:13.370624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:59:13.428845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-14c6e2fe-157c-40c3-9a71-ea137dd682b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644478 Sep 13 19:59:13.429485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 49/111] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 19:59:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:59:13.435419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d08eb43e-e3d5-45be-a846-bd42533d6ef9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:13.436181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d08eb43e-e3d5-45be-a846-bd42533d6ef9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:13.443715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d08eb43e-e3d5-45be-a846-bd42533d6ef9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.444416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d08eb43e-e3d5-45be-a846-bd42533d6ef9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.445000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d08eb43e-e3d5-45be-a846-bd42533d6ef9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.445851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d08eb43e-e3d5-45be-a846-bd42533d6ef9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.446998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d08eb43e-e3d5-45be-a846-bd42533d6ef9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.447574 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d08eb43e-e3d5-45be-a846-bd42533d6ef9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.681060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d08eb43e-e3d5-45be-a846-bd42533d6ef9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:13.691460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d08eb43e-e3d5-45be-a846-bd42533d6ef9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1515 microversion: 2.1 time: 0.260578 Sep 13 19:59:13.692314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 50/112] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:13 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:13.697176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ccff8fdf-2f30-4de7-9856-684f16bb8477 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:13.697784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ccff8fdf-2f30-4de7-9856-684f16bb8477 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:13.795818 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ccff8fdf-2f30-4de7-9856-684f16bb8477 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:13.804416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ccff8fdf-2f30-4de7-9856-684f16bb8477 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1218 microversion: 2.1 time: 0.110760 Sep 13 19:59:13.805002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 51/113] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:13 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:13.819554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-26393482-9128-420b-98b6-01d4b86664b9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:13.823269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-26393482-9128-420b-98b6-01d4b86664b9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:13.834339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26393482-9128-420b-98b6-01d4b86664b9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.835105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26393482-9128-420b-98b6-01d4b86664b9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.835943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26393482-9128-420b-98b6-01d4b86664b9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.836701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26393482-9128-420b-98b6-01d4b86664b9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.837162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26393482-9128-420b-98b6-01d4b86664b9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.837585 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26393482-9128-420b-98b6-01d4b86664b9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.933832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.objects.instance [None req-26393482-9128-420b-98b6-01d4b86664b9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lazy-loading 'flavor' on Instance uuid e0fd2dce-024b-45c3-add3-01474a42c86f {{(pid=120845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:59:14.049140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:14.094098 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-26393482-9128-420b-98b6-01d4b86664b9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "POST /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f/action" status: 200 len: 32 microversion: 2.1 time: 0.280311 Sep 13 19:59:14.096139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 52/114] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 13 19:59:13 2022] POST /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f/action => generated 32 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 19:59:14.110438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f64c2265-b94e-4517-a959-2c09a60525ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:14.111366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f64c2265-b94e-4517-a959-2c09a60525ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:14.127695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f64c2265-b94e-4517-a959-2c09a60525ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.128546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f64c2265-b94e-4517-a959-2c09a60525ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.128985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f64c2265-b94e-4517-a959-2c09a60525ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.136065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f64c2265-b94e-4517-a959-2c09a60525ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.136640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f64c2265-b94e-4517-a959-2c09a60525ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.137141 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f64c2265-b94e-4517-a959-2c09a60525ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.213411 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-83fad394-764e-47d5-85c9-ec630b66d5cb tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "POST /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.081769 Sep 13 19:59:14.227239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 63/115] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 13 19:59:13 2022] POST /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d/os-volume_attachments => generated 194 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:14.235862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cbfbd12a-06f1-436e-87c0-4a6abc8647f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:14.236823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cbfbd12a-06f1-436e-87c0-4a6abc8647f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:14.248999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbfbd12a-06f1-436e-87c0-4a6abc8647f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.251507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbfbd12a-06f1-436e-87c0-4a6abc8647f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.253230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbfbd12a-06f1-436e-87c0-4a6abc8647f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.254120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbfbd12a-06f1-436e-87c0-4a6abc8647f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.255715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbfbd12a-06f1-436e-87c0-4a6abc8647f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.256971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbfbd12a-06f1-436e-87c0-4a6abc8647f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.418713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f64c2265-b94e-4517-a959-2c09a60525ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:14.427691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f64c2265-b94e-4517-a959-2c09a60525ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.325546 Sep 13 19:59:14.428693 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 53/116] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:14 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:14.433539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-37010153-629b-471c-acfd-993c3eb3a81c req-56f217b5-267c-41b9-a0c1-cb23286af823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0decb4-2f46-4f2f-860f-e8ca277f7080", "name": "network-vif-plugged", "status": "completed", "tag": "2f770f4f-2f9f-4723-a236-5204e36adea7"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:14.459211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-37010153-629b-471c-acfd-993c3eb3a81c req-56f217b5-267c-41b9-a0c1-cb23286af823 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.460001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-37010153-629b-471c-acfd-993c3eb3a81c req-56f217b5-267c-41b9-a0c1-cb23286af823 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.460668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-37010153-629b-471c-acfd-993c3eb3a81c req-56f217b5-267c-41b9-a0c1-cb23286af823 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.475157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-37010153-629b-471c-acfd-993c3eb3a81c req-56f217b5-267c-41b9-a0c1-cb23286af823 service nova] Creating event network-vif-plugged:2f770f4f-2f9f-4723-a236-5204e36adea7 for instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 on hv-cinder-85427 Sep 13 19:59:14.480161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-37010153-629b-471c-acfd-993c3eb3a81c req-56f217b5-267c-41b9-a0c1-cb23286af823 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050240 Sep 13 19:59:14.480792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 54/117] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:14.517678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cbfbd12a-06f1-436e-87c0-4a6abc8647f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:14.526020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cbfbd12a-06f1-436e-87c0-4a6abc8647f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:14.527486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cbfbd12a-06f1-436e-87c0-4a6abc8647f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:14.528588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cbfbd12a-06f1-436e-87c0-4a6abc8647f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.300112 Sep 13 19:59:14.529154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 64/118] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:14.832405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-29b43784-e754-4297-9986-294bcc364bdc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:14.833914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-29b43784-e754-4297-9986-294bcc364bdc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:14.840492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29b43784-e754-4297-9986-294bcc364bdc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.841565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29b43784-e754-4297-9986-294bcc364bdc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.842241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29b43784-e754-4297-9986-294bcc364bdc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.843110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29b43784-e754-4297-9986-294bcc364bdc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.843802 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29b43784-e754-4297-9986-294bcc364bdc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.844369 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29b43784-e754-4297-9986-294bcc364bdc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.961528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-29b43784-e754-4297-9986-294bcc364bdc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:14.973094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-29b43784-e754-4297-9986-294bcc364bdc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1222 microversion: 2.1 time: 0.144619 Sep 13 19:59:14.973905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 55/119] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:14 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1222 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:15.454849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3403e1ac-cb0a-4837-8589-adb7662a72df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:15.455470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3403e1ac-cb0a-4837-8589-adb7662a72df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:15.464103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3403e1ac-cb0a-4837-8589-adb7662a72df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.464870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3403e1ac-cb0a-4837-8589-adb7662a72df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.465488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3403e1ac-cb0a-4837-8589-adb7662a72df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.466788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3403e1ac-cb0a-4837-8589-adb7662a72df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.467443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3403e1ac-cb0a-4837-8589-adb7662a72df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.468119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3403e1ac-cb0a-4837-8589-adb7662a72df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.554397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1797bafc-aa9b-4ed7-ae28-907f000d6256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:15.554701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1797bafc-aa9b-4ed7-ae28-907f000d6256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:15.563421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1797bafc-aa9b-4ed7-ae28-907f000d6256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.564088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1797bafc-aa9b-4ed7-ae28-907f000d6256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.565482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1797bafc-aa9b-4ed7-ae28-907f000d6256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.566677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1797bafc-aa9b-4ed7-ae28-907f000d6256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.567375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1797bafc-aa9b-4ed7-ae28-907f000d6256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.568260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1797bafc-aa9b-4ed7-ae28-907f000d6256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.659050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3403e1ac-cb0a-4837-8589-adb7662a72df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:15.667041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3403e1ac-cb0a-4837-8589-adb7662a72df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.217222 Sep 13 19:59:15.667630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 65/120] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:15 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:15.791391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1797bafc-aa9b-4ed7-ae28-907f000d6256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:15.801296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1797bafc-aa9b-4ed7-ae28-907f000d6256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:15.803121 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1797bafc-aa9b-4ed7-ae28-907f000d6256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:15.804668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1797bafc-aa9b-4ed7-ae28-907f000d6256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.255138 Sep 13 19:59:15.820025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 56/121] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:16.008260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-64012561-1fa4-4cd7-b1c1-e2062a7e0c5a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:16.008867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-64012561-1fa4-4cd7-b1c1-e2062a7e0c5a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:16.016609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64012561-1fa4-4cd7-b1c1-e2062a7e0c5a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.017047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64012561-1fa4-4cd7-b1c1-e2062a7e0c5a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.017651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64012561-1fa4-4cd7-b1c1-e2062a7e0c5a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.018534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64012561-1fa4-4cd7-b1c1-e2062a7e0c5a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.019362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64012561-1fa4-4cd7-b1c1-e2062a7e0c5a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.019953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64012561-1fa4-4cd7-b1c1-e2062a7e0c5a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.093284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-64012561-1fa4-4cd7-b1c1-e2062a7e0c5a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:16.105120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-64012561-1fa4-4cd7-b1c1-e2062a7e0c5a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1222 microversion: 2.1 time: 0.100799 Sep 13 19:59:16.105712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 66/122] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:16 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:16.690498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7207d5e9-3acf-4a76-a5ad-0e1e51f683c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:16.691974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7207d5e9-3acf-4a76-a5ad-0e1e51f683c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:16.698748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7207d5e9-3acf-4a76-a5ad-0e1e51f683c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.699627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7207d5e9-3acf-4a76-a5ad-0e1e51f683c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.700118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7207d5e9-3acf-4a76-a5ad-0e1e51f683c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.700773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7207d5e9-3acf-4a76-a5ad-0e1e51f683c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.701228 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7207d5e9-3acf-4a76-a5ad-0e1e51f683c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.702054 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7207d5e9-3acf-4a76-a5ad-0e1e51f683c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.833478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d5584990-8c96-4536-ba22-be464d6ad85c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:16.834084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d5584990-8c96-4536-ba22-be464d6ad85c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:16.842332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d5584990-8c96-4536-ba22-be464d6ad85c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.842844 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d5584990-8c96-4536-ba22-be464d6ad85c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.843261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d5584990-8c96-4536-ba22-be464d6ad85c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.844479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d5584990-8c96-4536-ba22-be464d6ad85c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.844479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d5584990-8c96-4536-ba22-be464d6ad85c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.844843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d5584990-8c96-4536-ba22-be464d6ad85c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.869955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7207d5e9-3acf-4a76-a5ad-0e1e51f683c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:16.880456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7207d5e9-3acf-4a76-a5ad-0e1e51f683c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.193147 Sep 13 19:59:16.881403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 57/123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:16 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:17.012136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d5584990-8c96-4536-ba22-be464d6ad85c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:17.022587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d5584990-8c96-4536-ba22-be464d6ad85c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:17.022587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d5584990-8c96-4536-ba22-be464d6ad85c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:17.023881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d5584990-8c96-4536-ba22-be464d6ad85c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.194702 Sep 13 19:59:17.024669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 67/124] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:16 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:59:17.131373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e32ca0cd-a5e9-48e3-9241-0bc8caa4bfc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:17.131984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e32ca0cd-a5e9-48e3-9241-0bc8caa4bfc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:17.139191 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e32ca0cd-a5e9-48e3-9241-0bc8caa4bfc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.139943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e32ca0cd-a5e9-48e3-9241-0bc8caa4bfc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.140628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e32ca0cd-a5e9-48e3-9241-0bc8caa4bfc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:17.141962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e32ca0cd-a5e9-48e3-9241-0bc8caa4bfc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.142436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e32ca0cd-a5e9-48e3-9241-0bc8caa4bfc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.143048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e32ca0cd-a5e9-48e3-9241-0bc8caa4bfc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:17.218514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e32ca0cd-a5e9-48e3-9241-0bc8caa4bfc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:17.228013 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e32ca0cd-a5e9-48e3-9241-0bc8caa4bfc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1222 microversion: 2.1 time: 0.100617 Sep 13 19:59:17.228528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 58/125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:17 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:17.908578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7a5cad3b-dd30-4b34-b87c-3de90c2d51f9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:17.909164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7a5cad3b-dd30-4b34-b87c-3de90c2d51f9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:17.925912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a5cad3b-dd30-4b34-b87c-3de90c2d51f9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.927647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a5cad3b-dd30-4b34-b87c-3de90c2d51f9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.928935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a5cad3b-dd30-4b34-b87c-3de90c2d51f9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:17.932727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a5cad3b-dd30-4b34-b87c-3de90c2d51f9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.933215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a5cad3b-dd30-4b34-b87c-3de90c2d51f9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.934260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a5cad3b-dd30-4b34-b87c-3de90c2d51f9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.051532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-894dea25-b863-483f-a824-7f5551835875 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:18.052140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-894dea25-b863-483f-a824-7f5551835875 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:18.069242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-894dea25-b863-483f-a824-7f5551835875 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:18.070684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-894dea25-b863-483f-a824-7f5551835875 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:18.071835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-894dea25-b863-483f-a824-7f5551835875 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.073129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-894dea25-b863-483f-a824-7f5551835875 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:18.073798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-894dea25-b863-483f-a824-7f5551835875 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:18.074396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-894dea25-b863-483f-a824-7f5551835875 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.117267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7a5cad3b-dd30-4b34-b87c-3de90c2d51f9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:18.125696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7a5cad3b-dd30-4b34-b87c-3de90c2d51f9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.222523 Sep 13 19:59:18.150586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 68/126] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:17 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:18.250475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6c7528cd-640d-4dfd-b2b7-6bade3d879ba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:18.251506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6c7528cd-640d-4dfd-b2b7-6bade3d879ba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:18.257884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c7528cd-640d-4dfd-b2b7-6bade3d879ba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:18.260067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c7528cd-640d-4dfd-b2b7-6bade3d879ba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:18.260516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c7528cd-640d-4dfd-b2b7-6bade3d879ba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.261212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c7528cd-640d-4dfd-b2b7-6bade3d879ba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:18.261659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c7528cd-640d-4dfd-b2b7-6bade3d879ba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:18.262081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c7528cd-640d-4dfd-b2b7-6bade3d879ba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.346767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6c7528cd-640d-4dfd-b2b7-6bade3d879ba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:18.354536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6c7528cd-640d-4dfd-b2b7-6bade3d879ba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1270 microversion: 2.1 time: 0.108184 Sep 13 19:59:18.355352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 69/127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:18 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:18.442067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-894dea25-b863-483f-a824-7f5551835875 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:18.451448 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-894dea25-b863-483f-a824-7f5551835875 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:18.452782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-894dea25-b863-483f-a824-7f5551835875 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:18.453979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-894dea25-b863-483f-a824-7f5551835875 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.407221 Sep 13 19:59:18.454573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 59/128] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:59:19.162593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7a3ac0ea-dda5-43a2-8624-5caf72a6d7a2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:19.164021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7a3ac0ea-dda5-43a2-8624-5caf72a6d7a2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:19.170423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a3ac0ea-dda5-43a2-8624-5caf72a6d7a2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:19.171070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a3ac0ea-dda5-43a2-8624-5caf72a6d7a2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:19.171500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a3ac0ea-dda5-43a2-8624-5caf72a6d7a2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:19.172466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a3ac0ea-dda5-43a2-8624-5caf72a6d7a2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:19.172914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a3ac0ea-dda5-43a2-8624-5caf72a6d7a2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:19.173389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a3ac0ea-dda5-43a2-8624-5caf72a6d7a2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:19.195750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:19.346550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7a3ac0ea-dda5-43a2-8624-5caf72a6d7a2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:19.355452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7a3ac0ea-dda5-43a2-8624-5caf72a6d7a2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.197612 Sep 13 19:59:19.356513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 70/129] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:19 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:19.377167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ab30a67d-9c56-4ea5-b3f6-7f31b4e69af4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:19.377782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ab30a67d-9c56-4ea5-b3f6-7f31b4e69af4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:19.383855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab30a67d-9c56-4ea5-b3f6-7f31b4e69af4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:19.384519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab30a67d-9c56-4ea5-b3f6-7f31b4e69af4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:19.384949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab30a67d-9c56-4ea5-b3f6-7f31b4e69af4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:19.385609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab30a67d-9c56-4ea5-b3f6-7f31b4e69af4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:19.386220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab30a67d-9c56-4ea5-b3f6-7f31b4e69af4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:19.386664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab30a67d-9c56-4ea5-b3f6-7f31b4e69af4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:19.467527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ab30a67d-9c56-4ea5-b3f6-7f31b4e69af4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:19.478512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ab30a67d-9c56-4ea5-b3f6-7f31b4e69af4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1278 microversion: 2.1 time: 0.105147 Sep 13 19:59:19.479262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 60/130] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:19 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:19.480252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-28dc0bac-4fac-4eb9-b996-b4049a25531e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:19.480252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-28dc0bac-4fac-4eb9-b996-b4049a25531e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:19.487413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-28dc0bac-4fac-4eb9-b996-b4049a25531e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:19.488021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-28dc0bac-4fac-4eb9-b996-b4049a25531e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:19.488556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-28dc0bac-4fac-4eb9-b996-b4049a25531e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:19.489447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-28dc0bac-4fac-4eb9-b996-b4049a25531e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:19.490464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-28dc0bac-4fac-4eb9-b996-b4049a25531e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:19.491178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-28dc0bac-4fac-4eb9-b996-b4049a25531e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:19.698768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-28dc0bac-4fac-4eb9-b996-b4049a25531e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:19.723559 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-28dc0bac-4fac-4eb9-b996-b4049a25531e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:19.729002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-28dc0bac-4fac-4eb9-b996-b4049a25531e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:19.733556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-28dc0bac-4fac-4eb9-b996-b4049a25531e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.258331 Sep 13 19:59:19.735281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 71/131] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:59:20.379493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d99f1020-a481-4b39-ab83-3d5e99664106 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:20.380125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d99f1020-a481-4b39-ab83-3d5e99664106 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:20.386847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d99f1020-a481-4b39-ab83-3d5e99664106 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.387378 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d99f1020-a481-4b39-ab83-3d5e99664106 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.387803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d99f1020-a481-4b39-ab83-3d5e99664106 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.388512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d99f1020-a481-4b39-ab83-3d5e99664106 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.388951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d99f1020-a481-4b39-ab83-3d5e99664106 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.389347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d99f1020-a481-4b39-ab83-3d5e99664106 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.501955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9088f36d-dda7-4e4b-bac5-2f8a07635b8d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:20.502644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9088f36d-dda7-4e4b-bac5-2f8a07635b8d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:20.509677 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9088f36d-dda7-4e4b-bac5-2f8a07635b8d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.510170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9088f36d-dda7-4e4b-bac5-2f8a07635b8d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.510639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9088f36d-dda7-4e4b-bac5-2f8a07635b8d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.512178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9088f36d-dda7-4e4b-bac5-2f8a07635b8d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.512178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9088f36d-dda7-4e4b-bac5-2f8a07635b8d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.512178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9088f36d-dda7-4e4b-bac5-2f8a07635b8d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.535203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d99f1020-a481-4b39-ab83-3d5e99664106 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:20.547710 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d99f1020-a481-4b39-ab83-3d5e99664106 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.172323 Sep 13 19:59:20.548649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 61/132] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:20 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:20.588577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9088f36d-dda7-4e4b-bac5-2f8a07635b8d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:20.596911 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9088f36d-dda7-4e4b-bac5-2f8a07635b8d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1276 microversion: 2.1 time: 0.099025 Sep 13 19:59:20.597484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 72/133] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:20 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1276 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:20.762843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c9dac2e0-b7ff-46a4-951d-8dfbbbb962b0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:20.763460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c9dac2e0-b7ff-46a4-951d-8dfbbbb962b0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:20.769844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9dac2e0-b7ff-46a4-951d-8dfbbbb962b0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.770331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9dac2e0-b7ff-46a4-951d-8dfbbbb962b0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.770830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9dac2e0-b7ff-46a4-951d-8dfbbbb962b0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.771571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9dac2e0-b7ff-46a4-951d-8dfbbbb962b0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.772060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9dac2e0-b7ff-46a4-951d-8dfbbbb962b0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.772469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9dac2e0-b7ff-46a4-951d-8dfbbbb962b0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.914226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c9dac2e0-b7ff-46a4-951d-8dfbbbb962b0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:20.929019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c9dac2e0-b7ff-46a4-951d-8dfbbbb962b0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:20.929019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c9dac2e0-b7ff-46a4-951d-8dfbbbb962b0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:20.929019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c9dac2e0-b7ff-46a4-951d-8dfbbbb962b0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.172140 Sep 13 19:59:20.929414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 62/134] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:21.576886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-37b343a3-c38b-4a6b-82aa-a4d8582ef7ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:21.577502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-37b343a3-c38b-4a6b-82aa-a4d8582ef7ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:21.584492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37b343a3-c38b-4a6b-82aa-a4d8582ef7ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.585226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37b343a3-c38b-4a6b-82aa-a4d8582ef7ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.585823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37b343a3-c38b-4a6b-82aa-a4d8582ef7ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.586933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37b343a3-c38b-4a6b-82aa-a4d8582ef7ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.587532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37b343a3-c38b-4a6b-82aa-a4d8582ef7ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.588144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37b343a3-c38b-4a6b-82aa-a4d8582ef7ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.628020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e0ff2c22-c4ad-485e-970d-74537d772da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:21.629474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e0ff2c22-c4ad-485e-970d-74537d772da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:21.632396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:21.644291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0ff2c22-c4ad-485e-970d-74537d772da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.645134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0ff2c22-c4ad-485e-970d-74537d772da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.645793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0ff2c22-c4ad-485e-970d-74537d772da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.646783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0ff2c22-c4ad-485e-970d-74537d772da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.647413 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0ff2c22-c4ad-485e-970d-74537d772da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.648130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0ff2c22-c4ad-485e-970d-74537d772da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.741519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e0ff2c22-c4ad-485e-970d-74537d772da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:21.751284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e0ff2c22-c4ad-485e-970d-74537d772da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1276 microversion: 2.1 time: 0.134726 Sep 13 19:59:21.751870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 63/135] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:21 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:21.765830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-37b343a3-c38b-4a6b-82aa-a4d8582ef7ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:21.774905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-37b343a3-c38b-4a6b-82aa-a4d8582ef7ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.202062 Sep 13 19:59:21.775663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 73/136] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:21 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:21.961899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-01e8a15f-12eb-4c2e-84a8-f6dbde2e5506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:21.962599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-01e8a15f-12eb-4c2e-84a8-f6dbde2e5506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:21.969242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01e8a15f-12eb-4c2e-84a8-f6dbde2e5506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.970317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01e8a15f-12eb-4c2e-84a8-f6dbde2e5506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.970945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01e8a15f-12eb-4c2e-84a8-f6dbde2e5506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.971649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01e8a15f-12eb-4c2e-84a8-f6dbde2e5506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.973675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01e8a15f-12eb-4c2e-84a8-f6dbde2e5506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.973675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01e8a15f-12eb-4c2e-84a8-f6dbde2e5506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.134082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-01e8a15f-12eb-4c2e-84a8-f6dbde2e5506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:22.151833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-01e8a15f-12eb-4c2e-84a8-f6dbde2e5506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:22.153248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-01e8a15f-12eb-4c2e-84a8-f6dbde2e5506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:22.155776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-01e8a15f-12eb-4c2e-84a8-f6dbde2e5506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.199147 Sep 13 19:59:22.156243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 64/137] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:22.781056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3354f1bb-0e83-48c8-b3cf-931ff7575271 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:22.782145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3354f1bb-0e83-48c8-b3cf-931ff7575271 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:22.788042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=70 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:22.795777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3354f1bb-0e83-48c8-b3cf-931ff7575271 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.796504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3354f1bb-0e83-48c8-b3cf-931ff7575271 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.796981 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3354f1bb-0e83-48c8-b3cf-931ff7575271 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.797687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3354f1bb-0e83-48c8-b3cf-931ff7575271 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.798180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3354f1bb-0e83-48c8-b3cf-931ff7575271 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.798601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3354f1bb-0e83-48c8-b3cf-931ff7575271 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.799719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-44d06df7-5d54-465f-89e6-7a9a5cd3d44a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:22.800416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-44d06df7-5d54-465f-89e6-7a9a5cd3d44a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:22.807172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-44d06df7-5d54-465f-89e6-7a9a5cd3d44a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.807821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-44d06df7-5d54-465f-89e6-7a9a5cd3d44a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.808640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-44d06df7-5d54-465f-89e6-7a9a5cd3d44a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.809419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-44d06df7-5d54-465f-89e6-7a9a5cd3d44a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.810169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-44d06df7-5d54-465f-89e6-7a9a5cd3d44a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.810654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-44d06df7-5d54-465f-89e6-7a9a5cd3d44a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.873053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3354f1bb-0e83-48c8-b3cf-931ff7575271 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:22.881004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3354f1bb-0e83-48c8-b3cf-931ff7575271 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1276 microversion: 2.1 time: 0.107147 Sep 13 19:59:22.881939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 74/138] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:22 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:22.964666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-44d06df7-5d54-465f-89e6-7a9a5cd3d44a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:22.973354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-44d06df7-5d54-465f-89e6-7a9a5cd3d44a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.178872 Sep 13 19:59:22.974171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 65/139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:22 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:23.182835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dd43155b-1075-4234-a2ef-8967a220f312 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:23.183444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dd43155b-1075-4234-a2ef-8967a220f312 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:23.190129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd43155b-1075-4234-a2ef-8967a220f312 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:23.190642 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd43155b-1075-4234-a2ef-8967a220f312 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:23.191068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd43155b-1075-4234-a2ef-8967a220f312 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.191753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd43155b-1075-4234-a2ef-8967a220f312 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:23.192200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd43155b-1075-4234-a2ef-8967a220f312 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:23.192611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd43155b-1075-4234-a2ef-8967a220f312 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.329343 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dd43155b-1075-4234-a2ef-8967a220f312 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:23.338122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dd43155b-1075-4234-a2ef-8967a220f312 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:23.339568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dd43155b-1075-4234-a2ef-8967a220f312 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:23.340673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dd43155b-1075-4234-a2ef-8967a220f312 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1408 microversion: 2.20 time: 0.163640 Sep 13 19:59:23.341623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 75/140] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:23 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:23.904384 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a9c13dff-b78b-4453-9187-76f67c57fdcb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:23.905168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a9c13dff-b78b-4453-9187-76f67c57fdcb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:23.907290 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:23.908010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=8 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:23.913952 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9c13dff-b78b-4453-9187-76f67c57fdcb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:23.914533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9c13dff-b78b-4453-9187-76f67c57fdcb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:23.915365 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9c13dff-b78b-4453-9187-76f67c57fdcb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.915706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9c13dff-b78b-4453-9187-76f67c57fdcb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:23.916184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9c13dff-b78b-4453-9187-76f67c57fdcb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:23.916568 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9c13dff-b78b-4453-9187-76f67c57fdcb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.984981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a9c13dff-b78b-4453-9187-76f67c57fdcb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:23.999175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2e4bebb2-c79d-4e3d-b98a-e98d3f30946b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:23.999866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2e4bebb2-c79d-4e3d-b98a-e98d3f30946b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:24.002886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a9c13dff-b78b-4453-9187-76f67c57fdcb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1276 microversion: 2.1 time: 0.101863 Sep 13 19:59:24.007024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e4bebb2-c79d-4e3d-b98a-e98d3f30946b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.007519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e4bebb2-c79d-4e3d-b98a-e98d3f30946b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.007947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e4bebb2-c79d-4e3d-b98a-e98d3f30946b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.008649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e4bebb2-c79d-4e3d-b98a-e98d3f30946b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.009090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e4bebb2-c79d-4e3d-b98a-e98d3f30946b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.009504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e4bebb2-c79d-4e3d-b98a-e98d3f30946b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.018826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 66/141] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:23 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1276 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:24.255713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2e4bebb2-c79d-4e3d-b98a-e98d3f30946b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:24.263795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2e4bebb2-c79d-4e3d-b98a-e98d3f30946b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.268638 Sep 13 19:59:24.264376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 76/142] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:23 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:24.365469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-78361d48-e9f6-4772-a329-d3bbdc0a561e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:24.366945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-78361d48-e9f6-4772-a329-d3bbdc0a561e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:24.373724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78361d48-e9f6-4772-a329-d3bbdc0a561e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.374128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78361d48-e9f6-4772-a329-d3bbdc0a561e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.374606 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78361d48-e9f6-4772-a329-d3bbdc0a561e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.375312 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78361d48-e9f6-4772-a329-d3bbdc0a561e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.375751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78361d48-e9f6-4772-a329-d3bbdc0a561e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.376168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78361d48-e9f6-4772-a329-d3bbdc0a561e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.661979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-78361d48-e9f6-4772-a329-d3bbdc0a561e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:24.673619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-78361d48-e9f6-4772-a329-d3bbdc0a561e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:24.675413 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-78361d48-e9f6-4772-a329-d3bbdc0a561e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:24.676773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-78361d48-e9f6-4772-a329-d3bbdc0a561e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1599 microversion: 2.20 time: 0.315315 Sep 13 19:59:24.677331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 67/143] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 19:59:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1599 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:59:24.719770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-92447053-0de0-4c96-8aa5-5d0fa89fed5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:24.720243 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-92447053-0de0-4c96-8aa5-5d0fa89fed5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:24.729122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92447053-0de0-4c96-8aa5-5d0fa89fed5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.729863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92447053-0de0-4c96-8aa5-5d0fa89fed5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.730724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92447053-0de0-4c96-8aa5-5d0fa89fed5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.732092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92447053-0de0-4c96-8aa5-5d0fa89fed5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.732910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92447053-0de0-4c96-8aa5-5d0fa89fed5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.733587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92447053-0de0-4c96-8aa5-5d0fa89fed5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.856002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-92447053-0de0-4c96-8aa5-5d0fa89fed5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.140753 Sep 13 19:59:24.857049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 77/144] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Sep 13 19:59:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:59:25.030593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cf471864-80b9-409e-98ac-c25f577d908b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:25.031793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cf471864-80b9-409e-98ac-c25f577d908b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:25.039022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cf471864-80b9-409e-98ac-c25f577d908b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.039277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cf471864-80b9-409e-98ac-c25f577d908b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.039605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cf471864-80b9-409e-98ac-c25f577d908b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.040589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cf471864-80b9-409e-98ac-c25f577d908b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.041489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cf471864-80b9-409e-98ac-c25f577d908b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.041914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cf471864-80b9-409e-98ac-c25f577d908b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.287459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-17dfa771-c8e6-40df-923c-8858ab6a9a0b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:25.288067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-17dfa771-c8e6-40df-923c-8858ab6a9a0b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:25.290644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-cf471864-80b9-409e-98ac-c25f577d908b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:25.297218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17dfa771-c8e6-40df-923c-8858ab6a9a0b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.297721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17dfa771-c8e6-40df-923c-8858ab6a9a0b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.298151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17dfa771-c8e6-40df-923c-8858ab6a9a0b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.299804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cf471864-80b9-409e-98ac-c25f577d908b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.274036 Sep 13 19:59:25.300600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 68/145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:25 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:25.301762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17dfa771-c8e6-40df-923c-8858ab6a9a0b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.302243 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17dfa771-c8e6-40df-923c-8858ab6a9a0b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.302700 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17dfa771-c8e6-40df-923c-8858ab6a9a0b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.812199 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17dfa771-c8e6-40df-923c-8858ab6a9a0b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:25.822982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-17dfa771-c8e6-40df-923c-8858ab6a9a0b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.539888 Sep 13 19:59:25.825335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 78/146] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:25 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:26.329791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bc4a14ec-30e5-4ee9-9dad-0740457cf958 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:26.331106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bc4a14ec-30e5-4ee9-9dad-0740457cf958 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:26.352972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc4a14ec-30e5-4ee9-9dad-0740457cf958 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.353794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc4a14ec-30e5-4ee9-9dad-0740457cf958 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.355006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc4a14ec-30e5-4ee9-9dad-0740457cf958 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.355857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc4a14ec-30e5-4ee9-9dad-0740457cf958 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.356409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc4a14ec-30e5-4ee9-9dad-0740457cf958 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.356886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc4a14ec-30e5-4ee9-9dad-0740457cf958 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.379384 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:26.676361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bc4a14ec-30e5-4ee9-9dad-0740457cf958 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:26.691581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-31ba1067-491a-4850-91d2-6ccd354799eb req-59562d03-e887-4d10-98a1-1e440509ce59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0decb4-2f46-4f2f-860f-e8ca277f7080", "tag": "2f770f4f-2f9f-4723-a236-5204e36adea7"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:26.699520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bc4a14ec-30e5-4ee9-9dad-0740457cf958 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.372343 Sep 13 19:59:26.726942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 69/147] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:26 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:26.730636 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-31ba1067-491a-4850-91d2-6ccd354799eb req-59562d03-e887-4d10-98a1-1e440509ce59 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.731164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-31ba1067-491a-4850-91d2-6ccd354799eb req-59562d03-e887-4d10-98a1-1e440509ce59 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.731641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-31ba1067-491a-4850-91d2-6ccd354799eb req-59562d03-e887-4d10-98a1-1e440509ce59 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.757650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-31ba1067-491a-4850-91d2-6ccd354799eb req-59562d03-e887-4d10-98a1-1e440509ce59 service nova] Creating event network-changed:2f770f4f-2f9f-4723-a236-5204e36adea7 for instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 on hv-cinder-85427 Sep 13 19:59:26.774937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-31ba1067-491a-4850-91d2-6ccd354799eb req-59562d03-e887-4d10-98a1-1e440509ce59 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085745 Sep 13 19:59:26.775515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 79/148] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:26.850807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-869886c4-9f25-4228-a845-d18f243d8eb9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:26.851467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-869886c4-9f25-4228-a845-d18f243d8eb9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:26.861075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-869886c4-9f25-4228-a845-d18f243d8eb9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.861551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-869886c4-9f25-4228-a845-d18f243d8eb9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.861983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-869886c4-9f25-4228-a845-d18f243d8eb9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.862721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-869886c4-9f25-4228-a845-d18f243d8eb9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.863178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-869886c4-9f25-4228-a845-d18f243d8eb9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.863623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-869886c4-9f25-4228-a845-d18f243d8eb9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.341817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-869886c4-9f25-4228-a845-d18f243d8eb9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:27.351704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-869886c4-9f25-4228-a845-d18f243d8eb9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.507025 Sep 13 19:59:27.363091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 70/149] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:26 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:27.733194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-734b4ac9-1a28-4f19-b5c9-013647341fc4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:27.733902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-734b4ac9-1a28-4f19-b5c9-013647341fc4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:27.750912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-734b4ac9-1a28-4f19-b5c9-013647341fc4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:27.753817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-734b4ac9-1a28-4f19-b5c9-013647341fc4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:27.757505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-734b4ac9-1a28-4f19-b5c9-013647341fc4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.759252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-734b4ac9-1a28-4f19-b5c9-013647341fc4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:27.766546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-734b4ac9-1a28-4f19-b5c9-013647341fc4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:27.778463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-734b4ac9-1a28-4f19-b5c9-013647341fc4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.842402 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8d67da04-4341-47b0-8e7b-d806ec6416c4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:27.843389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8d67da04-4341-47b0-8e7b-d806ec6416c4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:27.850549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d67da04-4341-47b0-8e7b-d806ec6416c4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:27.851461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d67da04-4341-47b0-8e7b-d806ec6416c4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:27.852157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d67da04-4341-47b0-8e7b-d806ec6416c4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.853117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d67da04-4341-47b0-8e7b-d806ec6416c4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:27.853796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d67da04-4341-47b0-8e7b-d806ec6416c4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:27.855034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d67da04-4341-47b0-8e7b-d806ec6416c4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.886189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8d67da04-4341-47b0-8e7b-d806ec6416c4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Going to try to terminate instance {{(pid=120845) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:59:28.087248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8d67da04-4341-47b0-8e7b-d806ec6416c4 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 204 len: 0 microversion: 2.1 time: 0.249144 Sep 13 19:59:28.092431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 71/150] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 19:59:27 2022] DELETE /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 19:59:28.102033 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-daa5f7f4-3b1c-479a-a544-07b8a8391ebf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:28.102866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-daa5f7f4-3b1c-479a-a544-07b8a8391ebf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:28.111814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-daa5f7f4-3b1c-479a-a544-07b8a8391ebf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.112456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-daa5f7f4-3b1c-479a-a544-07b8a8391ebf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.122508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-daa5f7f4-3b1c-479a-a544-07b8a8391ebf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.125204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-daa5f7f4-3b1c-479a-a544-07b8a8391ebf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.126418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-daa5f7f4-3b1c-479a-a544-07b8a8391ebf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.127362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-daa5f7f4-3b1c-479a-a544-07b8a8391ebf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.171281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-734b4ac9-1a28-4f19-b5c9-013647341fc4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:28.182611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-734b4ac9-1a28-4f19-b5c9-013647341fc4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.458100 Sep 13 19:59:28.184548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 80/151] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:27 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:28.190248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-c62acc1c-b6bf-4903-bb17-7be12a33f4ac req-514e2980-0566-471d-acc8-532687f66e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed156643-30e4-4158-b44b-ff8b7b4980e1", "tag": "1e18d8a0-f46d-4e86-a518-83b2588f925f"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:28.201785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-c62acc1c-b6bf-4903-bb17-7be12a33f4ac req-514e2980-0566-471d-acc8-532687f66e2f service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.202806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-c62acc1c-b6bf-4903-bb17-7be12a33f4ac req-514e2980-0566-471d-acc8-532687f66e2f service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.203412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-c62acc1c-b6bf-4903-bb17-7be12a33f4ac req-514e2980-0566-471d-acc8-532687f66e2f service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.217918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-c62acc1c-b6bf-4903-bb17-7be12a33f4ac req-514e2980-0566-471d-acc8-532687f66e2f service nova] Creating event network-changed:1e18d8a0-f46d-4e86-a518-83b2588f925f for instance ed156643-30e4-4158-b44b-ff8b7b4980e1 on hv-cinder-85427 Sep 13 19:59:28.231505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-c62acc1c-b6bf-4903-bb17-7be12a33f4ac req-514e2980-0566-471d-acc8-532687f66e2f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044627 Sep 13 19:59:28.234091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 81/152] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:28.368192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-daa5f7f4-3b1c-479a-a544-07b8a8391ebf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:28.377963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-daa5f7f4-3b1c-479a-a544-07b8a8391ebf tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1553 microversion: 2.1 time: 0.281063 Sep 13 19:59:28.378608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 72/153] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:28 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1553 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:28.386390 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7658de2e-9a11-437f-b239-b52bb835631c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:28.387239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7658de2e-9a11-437f-b239-b52bb835631c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:28.394963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7658de2e-9a11-437f-b239-b52bb835631c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.395734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7658de2e-9a11-437f-b239-b52bb835631c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.396252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7658de2e-9a11-437f-b239-b52bb835631c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.397054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7658de2e-9a11-437f-b239-b52bb835631c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.397593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7658de2e-9a11-437f-b239-b52bb835631c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.398099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7658de2e-9a11-437f-b239-b52bb835631c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.539310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7658de2e-9a11-437f-b239-b52bb835631c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:28.549078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7658de2e-9a11-437f-b239-b52bb835631c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.166887 Sep 13 19:59:28.549999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 82/154] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:28 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:29.205439 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-727bc308-8d39-4e20-bbdb-845e52554f47 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:29.205950 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-727bc308-8d39-4e20-bbdb-845e52554f47 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:29.212913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-727bc308-8d39-4e20-bbdb-845e52554f47 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:29.213395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-727bc308-8d39-4e20-bbdb-845e52554f47 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:29.213861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-727bc308-8d39-4e20-bbdb-845e52554f47 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:29.214606 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-727bc308-8d39-4e20-bbdb-845e52554f47 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:29.215053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-727bc308-8d39-4e20-bbdb-845e52554f47 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:29.215834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-727bc308-8d39-4e20-bbdb-845e52554f47 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:29.357694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-727bc308-8d39-4e20-bbdb-845e52554f47 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:29.368431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-727bc308-8d39-4e20-bbdb-845e52554f47 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.167007 Sep 13 19:59:29.371992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 73/155] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:29 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:29.412030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-eaf7f308-107d-4ecc-a5f6-86bfdbb410a5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:29.412593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-eaf7f308-107d-4ecc-a5f6-86bfdbb410a5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:29.419214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eaf7f308-107d-4ecc-a5f6-86bfdbb410a5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:29.419688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eaf7f308-107d-4ecc-a5f6-86bfdbb410a5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:29.420104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eaf7f308-107d-4ecc-a5f6-86bfdbb410a5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:29.420770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eaf7f308-107d-4ecc-a5f6-86bfdbb410a5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:29.421249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eaf7f308-107d-4ecc-a5f6-86bfdbb410a5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:29.421657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eaf7f308-107d-4ecc-a5f6-86bfdbb410a5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:29.561872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-eaf7f308-107d-4ecc-a5f6-86bfdbb410a5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:29.570741 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-eaf7f308-107d-4ecc-a5f6-86bfdbb410a5 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1553 microversion: 2.1 time: 0.162443 Sep 13 19:59:29.571321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 83/156] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:29 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:29.576811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c939c174-761c-46b5-b7e4-ccad47f836b6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:29.577538 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c939c174-761c-46b5-b7e4-ccad47f836b6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:29.584376 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c939c174-761c-46b5-b7e4-ccad47f836b6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:29.584843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c939c174-761c-46b5-b7e4-ccad47f836b6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:29.585257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c939c174-761c-46b5-b7e4-ccad47f836b6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:29.585936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c939c174-761c-46b5-b7e4-ccad47f836b6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:29.586403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c939c174-761c-46b5-b7e4-ccad47f836b6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:29.586841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c939c174-761c-46b5-b7e4-ccad47f836b6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:29.726759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c939c174-761c-46b5-b7e4-ccad47f836b6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:29.738412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c939c174-761c-46b5-b7e4-ccad47f836b6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.165189 Sep 13 19:59:29.739186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 74/157] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:29 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:30.391499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-75157dbb-be90-4dc7-a1fa-0064047f9d7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:30.392127 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-75157dbb-be90-4dc7-a1fa-0064047f9d7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:30.398288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75157dbb-be90-4dc7-a1fa-0064047f9d7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.398816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75157dbb-be90-4dc7-a1fa-0064047f9d7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.399223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75157dbb-be90-4dc7-a1fa-0064047f9d7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.399905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75157dbb-be90-4dc7-a1fa-0064047f9d7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.400344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75157dbb-be90-4dc7-a1fa-0064047f9d7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.400805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75157dbb-be90-4dc7-a1fa-0064047f9d7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.543602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-75157dbb-be90-4dc7-a1fa-0064047f9d7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:30.551866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-75157dbb-be90-4dc7-a1fa-0064047f9d7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.164540 Sep 13 19:59:30.552435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 84/158] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:30 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:30.594278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-57ae1c4b-cef4-4147-868d-aace22157e4e tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:30.594938 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-57ae1c4b-cef4-4147-868d-aace22157e4e tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:30.601620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-57ae1c4b-cef4-4147-868d-aace22157e4e tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.602110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-57ae1c4b-cef4-4147-868d-aace22157e4e tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.602656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-57ae1c4b-cef4-4147-868d-aace22157e4e tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.603359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-57ae1c4b-cef4-4147-868d-aace22157e4e tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.603812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-57ae1c4b-cef4-4147-868d-aace22157e4e tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.604196 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-57ae1c4b-cef4-4147-868d-aace22157e4e tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.754361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-57ae1c4b-cef4-4147-868d-aace22157e4e tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:30.763259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b3489789-56bc-467a-a171-bc0caf24fe68 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:30.763897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b3489789-56bc-467a-a171-bc0caf24fe68 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:30.766581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-57ae1c4b-cef4-4147-868d-aace22157e4e tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1553 microversion: 2.1 time: 0.176674 Sep 13 19:59:30.767228 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 75/159] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:30 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:30.771066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3489789-56bc-467a-a171-bc0caf24fe68 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.771553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3489789-56bc-467a-a171-bc0caf24fe68 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.772024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3489789-56bc-467a-a171-bc0caf24fe68 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.772720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3489789-56bc-467a-a171-bc0caf24fe68 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.773173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3489789-56bc-467a-a171-bc0caf24fe68 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.773584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3489789-56bc-467a-a171-bc0caf24fe68 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.911425 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b3489789-56bc-467a-a171-bc0caf24fe68 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:30.919316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b3489789-56bc-467a-a171-bc0caf24fe68 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.161324 Sep 13 19:59:30.919891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 85/160] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:30 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:31.577398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a458488e-0dee-4500-9f10-3c62e1296c0f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:31.578105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a458488e-0dee-4500-9f10-3c62e1296c0f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:31.584906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a458488e-0dee-4500-9f10-3c62e1296c0f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.585424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a458488e-0dee-4500-9f10-3c62e1296c0f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.585850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a458488e-0dee-4500-9f10-3c62e1296c0f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.586691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a458488e-0dee-4500-9f10-3c62e1296c0f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.587293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a458488e-0dee-4500-9f10-3c62e1296c0f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.605265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a458488e-0dee-4500-9f10-3c62e1296c0f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.762288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a458488e-0dee-4500-9f10-3c62e1296c0f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:31.770663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a458488e-0dee-4500-9f10-3c62e1296c0f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.197630 Sep 13 19:59:31.771160 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 76/161] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:31 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:31.790504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-92377795-7776-4e58-9409-459c3a2fd65d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:31.792106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-92377795-7776-4e58-9409-459c3a2fd65d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:31.799879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92377795-7776-4e58-9409-459c3a2fd65d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.800599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92377795-7776-4e58-9409-459c3a2fd65d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.801156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92377795-7776-4e58-9409-459c3a2fd65d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.802690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92377795-7776-4e58-9409-459c3a2fd65d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.803301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92377795-7776-4e58-9409-459c3a2fd65d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.803820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92377795-7776-4e58-9409-459c3a2fd65d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.945034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5f833ec2-6d44-493f-b6d8-0e8298609e47 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:31.945656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5f833ec2-6d44-493f-b6d8-0e8298609e47 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:31.953550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f833ec2-6d44-493f-b6d8-0e8298609e47 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.954231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f833ec2-6d44-493f-b6d8-0e8298609e47 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.955392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f833ec2-6d44-493f-b6d8-0e8298609e47 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.956147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-92377795-7776-4e58-9409-459c3a2fd65d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:31.957296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f833ec2-6d44-493f-b6d8-0e8298609e47 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.957920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f833ec2-6d44-493f-b6d8-0e8298609e47 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.958581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f833ec2-6d44-493f-b6d8-0e8298609e47 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.971891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-92377795-7776-4e58-9409-459c3a2fd65d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1553 microversion: 2.1 time: 0.185513 Sep 13 19:59:31.981384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 86/162] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:31 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:32.185421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5f833ec2-6d44-493f-b6d8-0e8298609e47 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:32.194340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5f833ec2-6d44-493f-b6d8-0e8298609e47 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.255081 Sep 13 19:59:32.194958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 77/163] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:31 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:32.797074 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9927eca1-059a-4e55-ab82-cae4e6f1d3c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:32.798460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9927eca1-059a-4e55-ab82-cae4e6f1d3c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:32.806558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9927eca1-059a-4e55-ab82-cae4e6f1d3c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:32.807504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9927eca1-059a-4e55-ab82-cae4e6f1d3c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:32.808431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9927eca1-059a-4e55-ab82-cae4e6f1d3c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:32.809611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9927eca1-059a-4e55-ab82-cae4e6f1d3c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:32.810575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9927eca1-059a-4e55-ab82-cae4e6f1d3c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:32.811375 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9927eca1-059a-4e55-ab82-cae4e6f1d3c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:32.997416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8da72356-a1ff-4dec-92ca-3e61c408717c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:32.999123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8da72356-a1ff-4dec-92ca-3e61c408717c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:33.009217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8da72356-a1ff-4dec-92ca-3e61c408717c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.010701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8da72356-a1ff-4dec-92ca-3e61c408717c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.011486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8da72356-a1ff-4dec-92ca-3e61c408717c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.012809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8da72356-a1ff-4dec-92ca-3e61c408717c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.014261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9927eca1-059a-4e55-ab82-cae4e6f1d3c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:33.014825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8da72356-a1ff-4dec-92ca-3e61c408717c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.015698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8da72356-a1ff-4dec-92ca-3e61c408717c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.023429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9927eca1-059a-4e55-ab82-cae4e6f1d3c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.231076 Sep 13 19:59:33.024009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 87/164] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:32 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:33.219647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-60de7d3f-0e84-4c48-8193-92f2e766ff9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:33.220995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-60de7d3f-0e84-4c48-8193-92f2e766ff9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:33.227856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60de7d3f-0e84-4c48-8193-92f2e766ff9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.228347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60de7d3f-0e84-4c48-8193-92f2e766ff9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.229139 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60de7d3f-0e84-4c48-8193-92f2e766ff9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.230003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60de7d3f-0e84-4c48-8193-92f2e766ff9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.230500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60de7d3f-0e84-4c48-8193-92f2e766ff9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.230918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60de7d3f-0e84-4c48-8193-92f2e766ff9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.391743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-60de7d3f-0e84-4c48-8193-92f2e766ff9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:33.398103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:33.408348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-60de7d3f-0e84-4c48-8193-92f2e766ff9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.192739 Sep 13 19:59:33.410431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 88/165] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:33 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:33.570401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8da72356-a1ff-4dec-92ca-3e61c408717c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:33.580300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8da72356-a1ff-4dec-92ca-3e61c408717c tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1553 microversion: 2.1 time: 0.586828 Sep 13 19:59:33.581354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 78/166] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:32 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1553 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:34.047308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e4018ed4-580f-4f6d-94ca-47be5225b1e4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:34.048933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e4018ed4-580f-4f6d-94ca-47be5225b1e4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:34.056900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e4018ed4-580f-4f6d-94ca-47be5225b1e4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.057468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e4018ed4-580f-4f6d-94ca-47be5225b1e4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.057958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e4018ed4-580f-4f6d-94ca-47be5225b1e4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.058768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e4018ed4-580f-4f6d-94ca-47be5225b1e4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.059616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e4018ed4-580f-4f6d-94ca-47be5225b1e4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.060721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e4018ed4-580f-4f6d-94ca-47be5225b1e4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.281751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e4018ed4-580f-4f6d-94ca-47be5225b1e4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:34.315862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e4018ed4-580f-4f6d-94ca-47be5225b1e4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.272333 Sep 13 19:59:34.316493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 89/167] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:34 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:34.432730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4ea978fc-b233-40d9-93a5-3e68a2aeb81f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:34.433610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4ea978fc-b233-40d9-93a5-3e68a2aeb81f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:34.440963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ea978fc-b233-40d9-93a5-3e68a2aeb81f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.441441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ea978fc-b233-40d9-93a5-3e68a2aeb81f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.442046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ea978fc-b233-40d9-93a5-3e68a2aeb81f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.443281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ea978fc-b233-40d9-93a5-3e68a2aeb81f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.443744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ea978fc-b233-40d9-93a5-3e68a2aeb81f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.444154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ea978fc-b233-40d9-93a5-3e68a2aeb81f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.468593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-c746d141-4bf3-4b36-ae81-234ce2a0cfd9 req-da636a7e-e38c-4359-b158-1502cc899869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9023a0ae-81d4-4d4b-b223-340bc286c78d", "name": "network-vif-deleted", "tag": "183c0c24-2522-4f2c-ab0d-0148986b5686"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:34.482311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-c746d141-4bf3-4b36-ae81-234ce2a0cfd9 req-da636a7e-e38c-4359-b158-1502cc899869 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.483050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-c746d141-4bf3-4b36-ae81-234ce2a0cfd9 req-da636a7e-e38c-4359-b158-1502cc899869 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.483741 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-c746d141-4bf3-4b36-ae81-234ce2a0cfd9 req-da636a7e-e38c-4359-b158-1502cc899869 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.498260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-c746d141-4bf3-4b36-ae81-234ce2a0cfd9 req-da636a7e-e38c-4359-b158-1502cc899869 service nova] Creating event network-vif-deleted:183c0c24-2522-4f2c-ab0d-0148986b5686 for instance 9023a0ae-81d4-4d4b-b223-340bc286c78d on hv-cinder-85427 Sep 13 19:59:34.505362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-c746d141-4bf3-4b36-ae81-234ce2a0cfd9 req-da636a7e-e38c-4359-b158-1502cc899869 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041439 Sep 13 19:59:34.506879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 90/168] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:34.607449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7c32cf16-e9f2-422b-8e98-f1938a15644b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:34.608649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7c32cf16-e9f2-422b-8e98-f1938a15644b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:34.616674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7c32cf16-e9f2-422b-8e98-f1938a15644b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.617285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7c32cf16-e9f2-422b-8e98-f1938a15644b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.617768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7c32cf16-e9f2-422b-8e98-f1938a15644b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.618656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7c32cf16-e9f2-422b-8e98-f1938a15644b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.620031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7c32cf16-e9f2-422b-8e98-f1938a15644b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.620031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7c32cf16-e9f2-422b-8e98-f1938a15644b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.664156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4ea978fc-b233-40d9-93a5-3e68a2aeb81f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:34.684001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4ea978fc-b233-40d9-93a5-3e68a2aeb81f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.255252 Sep 13 19:59:34.684699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 79/169] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:34 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:34.690155 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7c32cf16-e9f2-422b-8e98-f1938a15644b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:34.699980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7c32cf16-e9f2-422b-8e98-f1938a15644b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1511 microversion: 2.1 time: 0.098211 Sep 13 19:59:34.700550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 91/170] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:34 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1511 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:35.340874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a84ff751-d430-4800-af6d-b85329669e45 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:35.341738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a84ff751-d430-4800-af6d-b85329669e45 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:35.349192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a84ff751-d430-4800-af6d-b85329669e45 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.349623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a84ff751-d430-4800-af6d-b85329669e45 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.350043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a84ff751-d430-4800-af6d-b85329669e45 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.350821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a84ff751-d430-4800-af6d-b85329669e45 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.351449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a84ff751-d430-4800-af6d-b85329669e45 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.351861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a84ff751-d430-4800-af6d-b85329669e45 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.526660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a84ff751-d430-4800-af6d-b85329669e45 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:35.536755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a84ff751-d430-4800-af6d-b85329669e45 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.200024 Sep 13 19:59:35.551356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 80/171] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:35 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:35.722700 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2e820828-e703-4146-8f5f-f18906d45dc9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:35.724210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2e820828-e703-4146-8f5f-f18906d45dc9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:35.726414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fd095a31-7070-4d59-990b-969da73bce3b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:35.727086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fd095a31-7070-4d59-990b-969da73bce3b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:35.732846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e820828-e703-4146-8f5f-f18906d45dc9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.733945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e820828-e703-4146-8f5f-f18906d45dc9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.734691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e820828-e703-4146-8f5f-f18906d45dc9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.735641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e820828-e703-4146-8f5f-f18906d45dc9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.736322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e820828-e703-4146-8f5f-f18906d45dc9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.736523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd095a31-7070-4d59-990b-969da73bce3b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.737239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd095a31-7070-4d59-990b-969da73bce3b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.737776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e820828-e703-4146-8f5f-f18906d45dc9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.737900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd095a31-7070-4d59-990b-969da73bce3b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.738627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd095a31-7070-4d59-990b-969da73bce3b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.739111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd095a31-7070-4d59-990b-969da73bce3b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.739851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd095a31-7070-4d59-990b-969da73bce3b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.831230 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fd095a31-7070-4d59-990b-969da73bce3b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:35.843005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fd095a31-7070-4d59-990b-969da73bce3b tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1345 microversion: 2.1 time: 0.122638 Sep 13 19:59:35.843991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 81/172] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:35 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:35.915356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2e820828-e703-4146-8f5f-f18906d45dc9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:35.926517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2e820828-e703-4146-8f5f-f18906d45dc9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.209862 Sep 13 19:59:35.927573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 92/173] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:35 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:36.567846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-24fa0bfc-57c8-4c9a-92fe-222611000184 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:36.570352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-24fa0bfc-57c8-4c9a-92fe-222611000184 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:36.579487 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24fa0bfc-57c8-4c9a-92fe-222611000184 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.579991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24fa0bfc-57c8-4c9a-92fe-222611000184 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.580508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24fa0bfc-57c8-4c9a-92fe-222611000184 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.581604 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24fa0bfc-57c8-4c9a-92fe-222611000184 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.582607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24fa0bfc-57c8-4c9a-92fe-222611000184 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.583693 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24fa0bfc-57c8-4c9a-92fe-222611000184 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.772356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-24fa0bfc-57c8-4c9a-92fe-222611000184 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:36.785161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-24fa0bfc-57c8-4c9a-92fe-222611000184 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.225757 Sep 13 19:59:36.787081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 82/174] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:36 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:36.870885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:36.871656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:36.883237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.883237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.883515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.884938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.885710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.886292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.930098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.930885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.931649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.932462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lazy-loading 'fault' on Instance uuid 9023a0ae-81d4-4d4b-b223-340bc286c78d {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:59:36.956822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7189c0b0-eff2-4419-b69c-7f0d3704d32b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:36.958350 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7189c0b0-eff2-4419-b69c-7f0d3704d32b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:36.983131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7189c0b0-eff2-4419-b69c-7f0d3704d32b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.984349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7189c0b0-eff2-4419-b69c-7f0d3704d32b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.987543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7189c0b0-eff2-4419-b69c-7f0d3704d32b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.988401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7189c0b0-eff2-4419-b69c-7f0d3704d32b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.989667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7189c0b0-eff2-4419-b69c-7f0d3704d32b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.991156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7189c0b0-eff2-4419-b69c-7f0d3704d32b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:37.025591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd55568bf88346b794922ef8555f9654', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3cf4af51e419c848daba7adc86024', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:37.037069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6c521c75-5c6e-484d-bb6e-57eb53e3fab6 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 200 len: 1350 microversion: 2.1 time: 0.173645 Sep 13 19:59:37.041010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 93/175] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:36 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 1350 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:37.259747 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7189c0b0-eff2-4419-b69c-7f0d3704d32b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:37.272240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7189c0b0-eff2-4419-b69c-7f0d3704d32b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.323505 Sep 13 19:59:37.273051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 83/176] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:36 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:37.810107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-300f6cca-dfa2-47db-927a-1f6b0079747e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:37.811957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-300f6cca-dfa2-47db-927a-1f6b0079747e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:37.819930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-300f6cca-dfa2-47db-927a-1f6b0079747e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:37.820290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-300f6cca-dfa2-47db-927a-1f6b0079747e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:37.820977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-300f6cca-dfa2-47db-927a-1f6b0079747e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:37.821858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-300f6cca-dfa2-47db-927a-1f6b0079747e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:37.822712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-300f6cca-dfa2-47db-927a-1f6b0079747e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:37.823386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-300f6cca-dfa2-47db-927a-1f6b0079747e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.015463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-300f6cca-dfa2-47db-927a-1f6b0079747e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:38.026626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-300f6cca-dfa2-47db-927a-1f6b0079747e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.220502 Sep 13 19:59:38.027228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 94/177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:37 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:38.067010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-335d7650-c3fd-4899-b950-7c4ad183ee97 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:38.067626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-335d7650-c3fd-4899-b950-7c4ad183ee97 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:38.074252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-335d7650-c3fd-4899-b950-7c4ad183ee97 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:38.074779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-335d7650-c3fd-4899-b950-7c4ad183ee97 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:38.075216 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-335d7650-c3fd-4899-b950-7c4ad183ee97 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.076153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-335d7650-c3fd-4899-b950-7c4ad183ee97 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:38.076615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-335d7650-c3fd-4899-b950-7c4ad183ee97 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:38.077032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-335d7650-c3fd-4899-b950-7c4ad183ee97 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.099570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-335d7650-c3fd-4899-b950-7c4ad183ee97 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] HTTP exception thrown: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-335d7650-c3fd-4899-b950-7c4ad183ee97 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Request method failure captured: Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d HTTP/1.1 Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIODd0qh-Tw4gqj6V5Y8ZXvR-E8wjtH46-DH7PGEVZhmqNR2aQzTd-4SkEmg_IB2qDqzfBdFabBktFPM9WmUoDVnw1rEQ61zYiyFhzJGQ_MUQO49br7i2tpRYtCcT1BhJUfS7BtISucWvfJGnKtRcQqwj9mZoD8v6o0nX4Va_Vryu_bs Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: 8ac3cf4af51e419c848daba7adc86024 Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-DeleteServersTestJSON-935666580 Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 19:59:38.112603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 19:59:38.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ac3cf4af51e419c848daba7adc86024"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ac3cf4af51e419c848daba7adc86024", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ac3cf4af51e419c848daba7adc86024"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ac3cf4af51e419c848daba7adc86024"}]}] Sep 13 19:59:38.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-DeleteServersTestJSON-935666580 Sep 13 19:59:38.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: 8ac3cf4af51e419c848daba7adc86024 Sep 13 19:59:38.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-DeleteServersTestJSON-935666580 Sep 13 19:59:38.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-DeleteServersTestJSON-935666580-project Sep 13 19:59:38.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 19:59:38.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 19:59:38.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: bd55568bf88346b794922ef8555f9654 Sep 13 19:59:38.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-DeleteServersTestJSON-935666580-project Sep 13 19:59:38.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 19:59:38.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:38.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '9023a0ae-81d4-4d4b-b223-340bc286c78d'} Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:59:38.114639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:38.115707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 19:59:38.116705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-335d7650-c3fd-4899-b950-7c4ad183ee97 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Returning 404 to user: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:59:38.116705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-335d7650-c3fd-4899-b950-7c4ad183ee97 tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 404 len: 111 microversion: 2.1 time: 0.051960 Sep 13 19:59:38.116705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 84/178] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:38 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:59:38.276686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-19104364-e51e-4c2c-b80f-e8105015efef tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:38.281561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-19104364-e51e-4c2c-b80f-e8105015efef tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:38.295708 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-31060f85-3989-4b3c-8791-e6a24ab9d825 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:38.296931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-31060f85-3989-4b3c-8791-e6a24ab9d825 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:38.302925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19104364-e51e-4c2c-b80f-e8105015efef tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:38.303815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19104364-e51e-4c2c-b80f-e8105015efef tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:38.304412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19104364-e51e-4c2c-b80f-e8105015efef tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.307797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19104364-e51e-4c2c-b80f-e8105015efef tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:38.308337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19104364-e51e-4c2c-b80f-e8105015efef tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:38.308769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19104364-e51e-4c2c-b80f-e8105015efef tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.311447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31060f85-3989-4b3c-8791-e6a24ab9d825 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:38.312067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31060f85-3989-4b3c-8791-e6a24ab9d825 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:38.312507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31060f85-3989-4b3c-8791-e6a24ab9d825 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.315595 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31060f85-3989-4b3c-8791-e6a24ab9d825 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:38.316280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31060f85-3989-4b3c-8791-e6a24ab9d825 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:38.316879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31060f85-3989-4b3c-8791-e6a24ab9d825 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.342325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-19104364-e51e-4c2c-b80f-e8105015efef tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] HTTP exception thrown: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:38.352480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-19104364-e51e-4c2c-b80f-e8105015efef tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Request method failure captured: Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d/os-volume_attachments HTTP/1.1 Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIODd0qh-Tw4gqj6V5Y8ZXvR-E8wjtH46-DH7PGEVZhmqNR2aQzTd-4SkEmg_IB2qDqzfBdFabBktFPM9WmUoDVnw1rEQ61zYiyFhzJGQ_MUQO49br7i2tpRYtCcT1BhJUfS7BtISucWvfJGnKtRcQqwj9mZoD8v6o0nX4Va_Vryu_bs Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: 8ac3cf4af51e419c848daba7adc86024 Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-DeleteServersTestJSON-935666580 Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 19:59:38.356630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 19:59:38.358293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ac3cf4af51e419c848daba7adc86024"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ac3cf4af51e419c848daba7adc86024", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ac3cf4af51e419c848daba7adc86024"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ac3cf4af51e419c848daba7adc86024"}]}] Sep 13 19:59:38.358293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-DeleteServersTestJSON-935666580 Sep 13 19:59:38.358293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: 8ac3cf4af51e419c848daba7adc86024 Sep 13 19:59:38.358293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-DeleteServersTestJSON-935666580 Sep 13 19:59:38.358293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-DeleteServersTestJSON-935666580-project Sep 13 19:59:38.358293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 19:59:38.358293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 19:59:38.358293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: bd55568bf88346b794922ef8555f9654 Sep 13 19:59:38.358293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-DeleteServersTestJSON-935666580-project Sep 13 19:59:38.358293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 19:59:38.358293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:38.358293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'server_id': '9023a0ae-81d4-4d4b-b223-340bc286c78d'} Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:59:38.359138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:38.360391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:38.361638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-19104364-e51e-4c2c-b80f-e8105015efef tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Returning 404 to user: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:59:38.361638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-19104364-e51e-4c2c-b80f-e8105015efef tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.091494 Sep 13 19:59:38.361638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 95/179] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:38 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d/os-volume_attachments => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:59:38.625989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-31060f85-3989-4b3c-8791-e6a24ab9d825 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:38.635944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-31060f85-3989-4b3c-8791-e6a24ab9d825 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.343848 Sep 13 19:59:38.638416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 85/180] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:38 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:38.822061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1836384573", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "networks": [{"uuid": "0461f2fa-45b5-48b5-aa22-82ba55bd2663"}]}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:38.885129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.network.neutron [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] validate_networks() for [('0461f2fa-45b5-48b5-aa22-82ba55bd2663', None, None, None, None, None)] {{(pid=120844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:59:39.052717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-61a61ccd-891c-4d89-a1c3-2d66bd31e3a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:39.053716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-61a61ccd-891c-4d89-a1c3-2d66bd31e3a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:39.068283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61a61ccd-891c-4d89-a1c3-2d66bd31e3a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.069093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61a61ccd-891c-4d89-a1c3-2d66bd31e3a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.069462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61a61ccd-891c-4d89-a1c3-2d66bd31e3a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.071497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61a61ccd-891c-4d89-a1c3-2d66bd31e3a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.072020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61a61ccd-891c-4d89-a1c3-2d66bd31e3a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.072516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61a61ccd-891c-4d89-a1c3-2d66bd31e3a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.276955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-61a61ccd-891c-4d89-a1c3-2d66bd31e3a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:39.286669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-61a61ccd-891c-4d89-a1c3-2d66bd31e3a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.240171 Sep 13 19:59:39.287496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 86/181] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:39 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:39.374963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Flavor limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:59:39.376138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Image limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:59:39.376874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Flavor pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:59:39.377478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Image pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:59:39.378095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:59:39.393815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.394291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.394755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.395543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.395921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.396351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.415120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Getting quotas for project a747512840e14dfca8bf507e70623fa5. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:59:39.419889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Getting quotas for user b5b22eed68ce4d879de69b94084f1fb8 and project a747512840e14dfca8bf507e70623fa5. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:59:39.432019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Going to run 1 instances... {{(pid=120844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:59:39.434420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:59:39.491917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5b88ea6c-599b-401e-b8e7-edb9f9b1e838 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673531 Sep 13 19:59:39.494695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 96/182] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 19:59:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:59:39.505922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-72a13c54-2ae3-4b9f-9852-5afde6e19d43 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:39.506576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-72a13c54-2ae3-4b9f-9852-5afde6e19d43 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:39.593942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-72a13c54-2ae3-4b9f-9852-5afde6e19d43 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:39.603893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-72a13c54-2ae3-4b9f-9852-5afde6e19d43 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1214 microversion: 2.1 time: 0.102646 Sep 13 19:59:39.604929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 87/183] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:39 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:39.660867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1c65a0a4-7516-4329-ac3e-3aefc9eb3415 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:39.661355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1c65a0a4-7516-4329-ac3e-3aefc9eb3415 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:39.669085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1c65a0a4-7516-4329-ac3e-3aefc9eb3415 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.669570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1c65a0a4-7516-4329-ac3e-3aefc9eb3415 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.669998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1c65a0a4-7516-4329-ac3e-3aefc9eb3415 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.670720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1c65a0a4-7516-4329-ac3e-3aefc9eb3415 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.673164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1c65a0a4-7516-4329-ac3e-3aefc9eb3415 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.679670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1c65a0a4-7516-4329-ac3e-3aefc9eb3415 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.862020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1c65a0a4-7516-4329-ac3e-3aefc9eb3415 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:39.871945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1c65a0a4-7516-4329-ac3e-3aefc9eb3415 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.217429 Sep 13 19:59:39.872676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 97/184] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:39 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:40.311188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-129cca4a-aef4-4e67-9208-a836b226e43e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:40.311188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-129cca4a-aef4-4e67-9208-a836b226e43e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:40.317713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-129cca4a-aef4-4e67-9208-a836b226e43e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.318198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-129cca4a-aef4-4e67-9208-a836b226e43e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.318685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-129cca4a-aef4-4e67-9208-a836b226e43e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.319387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-129cca4a-aef4-4e67-9208-a836b226e43e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.319831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-129cca4a-aef4-4e67-9208-a836b226e43e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.320244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-129cca4a-aef4-4e67-9208-a836b226e43e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.545663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-129cca4a-aef4-4e67-9208-a836b226e43e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:40.563167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-129cca4a-aef4-4e67-9208-a836b226e43e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.257360 Sep 13 19:59:40.563823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 88/185] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:40 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:40.635161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7a4a4b32-5596-4142-a8a7-1c7d2f862c69 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:40.637022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7a4a4b32-5596-4142-a8a7-1c7d2f862c69 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:40.644358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a4a4b32-5596-4142-a8a7-1c7d2f862c69 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.644841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a4a4b32-5596-4142-a8a7-1c7d2f862c69 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.645295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a4a4b32-5596-4142-a8a7-1c7d2f862c69 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.645990 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a4a4b32-5596-4142-a8a7-1c7d2f862c69 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.646635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a4a4b32-5596-4142-a8a7-1c7d2f862c69 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.647054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7a4a4b32-5596-4142-a8a7-1c7d2f862c69 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.719886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7a4a4b32-5596-4142-a8a7-1c7d2f862c69 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:40.729217 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7a4a4b32-5596-4142-a8a7-1c7d2f862c69 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1218 microversion: 2.1 time: 0.101051 Sep 13 19:59:40.743325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 98/186] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:40 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:40.906341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d143348e-60df-423a-90c3-498ebfe97707 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:40.907219 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d143348e-60df-423a-90c3-498ebfe97707 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:40.914142 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d143348e-60df-423a-90c3-498ebfe97707 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.914935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d143348e-60df-423a-90c3-498ebfe97707 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.915478 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d143348e-60df-423a-90c3-498ebfe97707 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.916198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d143348e-60df-423a-90c3-498ebfe97707 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.916775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d143348e-60df-423a-90c3-498ebfe97707 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.917306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d143348e-60df-423a-90c3-498ebfe97707 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.064812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d143348e-60df-423a-90c3-498ebfe97707 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:41.078534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d143348e-60df-423a-90c3-498ebfe97707 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.172942 Sep 13 19:59:41.078534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 89/187] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:40 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:41.586448 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e8061a51-3d79-47a6-8f90-68dde26c0bf1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:41.587216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e8061a51-3d79-47a6-8f90-68dde26c0bf1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:41.595050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8061a51-3d79-47a6-8f90-68dde26c0bf1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.595532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8061a51-3d79-47a6-8f90-68dde26c0bf1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.595967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8061a51-3d79-47a6-8f90-68dde26c0bf1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.596666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8061a51-3d79-47a6-8f90-68dde26c0bf1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.602604 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8061a51-3d79-47a6-8f90-68dde26c0bf1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.603324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8061a51-3d79-47a6-8f90-68dde26c0bf1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.764087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a216a5f4-8139-4470-88b7-e37f424fe4b2 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:41.765786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a216a5f4-8139-4470-88b7-e37f424fe4b2 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:41.790805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a216a5f4-8139-4470-88b7-e37f424fe4b2 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.791298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a216a5f4-8139-4470-88b7-e37f424fe4b2 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.791744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a216a5f4-8139-4470-88b7-e37f424fe4b2 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.792459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a216a5f4-8139-4470-88b7-e37f424fe4b2 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.794511 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a216a5f4-8139-4470-88b7-e37f424fe4b2 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.794939 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a216a5f4-8139-4470-88b7-e37f424fe4b2 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.813188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e8061a51-3d79-47a6-8f90-68dde26c0bf1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:41.835068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e8061a51-3d79-47a6-8f90-68dde26c0bf1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.252299 Sep 13 19:59:41.836872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 99/188] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:41 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:41.886984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c31e637c-0827-48cb-95cd-19047cb0f15d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:41.887477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c31e637c-0827-48cb-95cd-19047cb0f15d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:41.894068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c31e637c-0827-48cb-95cd-19047cb0f15d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.894585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c31e637c-0827-48cb-95cd-19047cb0f15d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.895316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c31e637c-0827-48cb-95cd-19047cb0f15d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.896092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c31e637c-0827-48cb-95cd-19047cb0f15d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.896536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c31e637c-0827-48cb-95cd-19047cb0f15d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.896949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c31e637c-0827-48cb-95cd-19047cb0f15d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.912701 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-c31e637c-0827-48cb-95cd-19047cb0f15d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] HTTP exception thrown: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c31e637c-0827-48cb-95cd-19047cb0f15d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Request method failure captured: Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: DELETE /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d HTTP/1.1 Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIODd0qh-Tw4gqj6V5Y8ZXvR-E8wjtH46-DH7PGEVZhmqNR2aQzTd-4SkEmg_IB2qDqzfBdFabBktFPM9WmUoDVnw1rEQ61zYiyFhzJGQ_MUQO49br7i2tpRYtCcT1BhJUfS7BtISucWvfJGnKtRcQqwj9mZoD8v6o0nX4Va_Vryu_bs Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: 8ac3cf4af51e419c848daba7adc86024 Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-DeleteServersTestJSON-935666580 Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 19:59:41.915212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 19:59:41.916385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ac3cf4af51e419c848daba7adc86024"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ac3cf4af51e419c848daba7adc86024", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ac3cf4af51e419c848daba7adc86024"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ac3cf4af51e419c848daba7adc86024"}]}] Sep 13 19:59:41.916385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-DeleteServersTestJSON-935666580 Sep 13 19:59:41.916385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: 8ac3cf4af51e419c848daba7adc86024 Sep 13 19:59:41.916385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-DeleteServersTestJSON-935666580 Sep 13 19:59:41.916385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-DeleteServersTestJSON-935666580-project Sep 13 19:59:41.916385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 19:59:41.916385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 19:59:41.916385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: bd55568bf88346b794922ef8555f9654 Sep 13 19:59:41.916385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-DeleteServersTestJSON-935666580-project Sep 13 19:59:41.916385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 19:59:41.916385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:41.916385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '9023a0ae-81d4-4d4b-b223-340bc286c78d'} Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:59:41.917006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:41.918010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:41.919874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a216a5f4-8139-4470-88b7-e37f424fe4b2 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:41.920762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c31e637c-0827-48cb-95cd-19047cb0f15d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Returning 404 to user: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:59:41.921899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c31e637c-0827-48cb-95cd-19047cb0f15d tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 404 len: 111 microversion: 2.1 time: 0.039560 Sep 13 19:59:41.922715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 100/189] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 19:59:41 2022] DELETE /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 19:59:41.930946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-36dc54b9-af44-4254-b408-6b75a3ad4fab tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:41.931560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-36dc54b9-af44-4254-b408-6b75a3ad4fab tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] [instance: 9023a0ae-81d4-4d4b-b223-340bc286c78d] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:41.939509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36dc54b9-af44-4254-b408-6b75a3ad4fab tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.939722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36dc54b9-af44-4254-b408-6b75a3ad4fab tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.940134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36dc54b9-af44-4254-b408-6b75a3ad4fab tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.940850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36dc54b9-af44-4254-b408-6b75a3ad4fab tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.941392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36dc54b9-af44-4254-b408-6b75a3ad4fab tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.941816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36dc54b9-af44-4254-b408-6b75a3ad4fab tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.950859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a216a5f4-8139-4470-88b7-e37f424fe4b2 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1266 microversion: 2.1 time: 0.193162 Sep 13 19:59:41.958728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 90/190] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:41 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:41.963095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-36dc54b9-af44-4254-b408-6b75a3ad4fab tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] HTTP exception thrown: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-36dc54b9-af44-4254-b408-6b75a3ad4fab tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Request method failure captured: Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d HTTP/1.1 Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIODd0qh-Tw4gqj6V5Y8ZXvR-E8wjtH46-DH7PGEVZhmqNR2aQzTd-4SkEmg_IB2qDqzfBdFabBktFPM9WmUoDVnw1rEQ61zYiyFhzJGQ_MUQO49br7i2tpRYtCcT1BhJUfS7BtISucWvfJGnKtRcQqwj9mZoD8v6o0nX4Va_Vryu_bs Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: 8ac3cf4af51e419c848daba7adc86024 Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-DeleteServersTestJSON-935666580 Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 19:59:41.964673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 19:59:41.966167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ac3cf4af51e419c848daba7adc86024"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ac3cf4af51e419c848daba7adc86024", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ac3cf4af51e419c848daba7adc86024"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ac3cf4af51e419c848daba7adc86024"}]}] Sep 13 19:59:41.966167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-DeleteServersTestJSON-935666580 Sep 13 19:59:41.966167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: 8ac3cf4af51e419c848daba7adc86024 Sep 13 19:59:41.966167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-DeleteServersTestJSON-935666580 Sep 13 19:59:41.966167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-DeleteServersTestJSON-935666580-project Sep 13 19:59:41.966167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 19:59:41.966167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 19:59:41.966167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: bd55568bf88346b794922ef8555f9654 Sep 13 19:59:41.966167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-DeleteServersTestJSON-935666580-project Sep 13 19:59:41.966167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 19:59:41.966167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:41.966167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '9023a0ae-81d4-4d4b-b223-340bc286c78d'} Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:59:41.966833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. Sep 13 19:59:41.971418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 19:59:41.972420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-36dc54b9-af44-4254-b408-6b75a3ad4fab tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] Returning 404 to user: Instance 9023a0ae-81d4-4d4b-b223-340bc286c78d could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:59:41.972420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-36dc54b9-af44-4254-b408-6b75a3ad4fab tempest-DeleteServersTestJSON-935666580 tempest-DeleteServersTestJSON-935666580-project] 10.222.0.52 "GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d" status: 404 len: 111 microversion: 2.1 time: 0.039570 Sep 13 19:59:41.972420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 101/191] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:41 2022] GET /compute/v2.1/servers/9023a0ae-81d4-4d4b-b223-340bc286c78d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 19:59:42.104178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c1097513-f444-438a-a24b-2209d4bbf016 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:42.104908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c1097513-f444-438a-a24b-2209d4bbf016 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:42.111811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c1097513-f444-438a-a24b-2209d4bbf016 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.112407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c1097513-f444-438a-a24b-2209d4bbf016 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.112856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c1097513-f444-438a-a24b-2209d4bbf016 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.113743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c1097513-f444-438a-a24b-2209d4bbf016 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.115091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c1097513-f444-438a-a24b-2209d4bbf016 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.115688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c1097513-f444-438a-a24b-2209d4bbf016 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.274923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c1097513-f444-438a-a24b-2209d4bbf016 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:42.284136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c1097513-f444-438a-a24b-2209d4bbf016 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.183660 Sep 13 19:59:42.284754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 91/192] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:42 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:42.867931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0185603e-e1ec-4349-8e25-e5c67753ba4a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:42.868566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0185603e-e1ec-4349-8e25-e5c67753ba4a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:42.876263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0185603e-e1ec-4349-8e25-e5c67753ba4a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.876876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0185603e-e1ec-4349-8e25-e5c67753ba4a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.877318 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0185603e-e1ec-4349-8e25-e5c67753ba4a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.878417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0185603e-e1ec-4349-8e25-e5c67753ba4a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.878861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0185603e-e1ec-4349-8e25-e5c67753ba4a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.879678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0185603e-e1ec-4349-8e25-e5c67753ba4a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.990646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0cc3d9df-c242-40ee-8ab4-84ba07b16383 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:42.992490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0cc3d9df-c242-40ee-8ab4-84ba07b16383 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:43.006190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0cc3d9df-c242-40ee-8ab4-84ba07b16383 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:43.006996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0cc3d9df-c242-40ee-8ab4-84ba07b16383 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:43.007646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0cc3d9df-c242-40ee-8ab4-84ba07b16383 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:43.008442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0cc3d9df-c242-40ee-8ab4-84ba07b16383 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:43.009358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0cc3d9df-c242-40ee-8ab4-84ba07b16383 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:43.010002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0cc3d9df-c242-40ee-8ab4-84ba07b16383 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:43.083609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0cc3d9df-c242-40ee-8ab4-84ba07b16383 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:43.093624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0cc3d9df-c242-40ee-8ab4-84ba07b16383 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1266 microversion: 2.1 time: 0.106849 Sep 13 19:59:43.094542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 92/193] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:42 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:43.096622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0185603e-e1ec-4349-8e25-e5c67753ba4a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:43.110895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0185603e-e1ec-4349-8e25-e5c67753ba4a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.247022 Sep 13 19:59:43.111475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 102/194] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:42 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:43.308110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d146dd13-aff3-45d0-8db3-e5662104f08e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:43.309053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d146dd13-aff3-45d0-8db3-e5662104f08e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:43.315502 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d146dd13-aff3-45d0-8db3-e5662104f08e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:43.315914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d146dd13-aff3-45d0-8db3-e5662104f08e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:43.316342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d146dd13-aff3-45d0-8db3-e5662104f08e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:43.317081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d146dd13-aff3-45d0-8db3-e5662104f08e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:43.317546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d146dd13-aff3-45d0-8db3-e5662104f08e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:43.317957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d146dd13-aff3-45d0-8db3-e5662104f08e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:43.488350 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d146dd13-aff3-45d0-8db3-e5662104f08e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:43.498788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d146dd13-aff3-45d0-8db3-e5662104f08e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.194522 Sep 13 19:59:43.499665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 93/195] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:43 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:44.116380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-980e0217-2fa3-4a79-ab9a-f49ed7ac799c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:44.116888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-980e0217-2fa3-4a79-ab9a-f49ed7ac799c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:44.123111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-980e0217-2fa3-4a79-ab9a-f49ed7ac799c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.123581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-980e0217-2fa3-4a79-ab9a-f49ed7ac799c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.124323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-980e0217-2fa3-4a79-ab9a-f49ed7ac799c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.125218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-980e0217-2fa3-4a79-ab9a-f49ed7ac799c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.125995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-980e0217-2fa3-4a79-ab9a-f49ed7ac799c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.126234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-980e0217-2fa3-4a79-ab9a-f49ed7ac799c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.137054 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-610dd908-48da-4a02-ad9c-d406a24c0289 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:44.137666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-610dd908-48da-4a02-ad9c-d406a24c0289 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:44.145073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-610dd908-48da-4a02-ad9c-d406a24c0289 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.146145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-610dd908-48da-4a02-ad9c-d406a24c0289 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.147589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-610dd908-48da-4a02-ad9c-d406a24c0289 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.148687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-610dd908-48da-4a02-ad9c-d406a24c0289 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.149489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-610dd908-48da-4a02-ad9c-d406a24c0289 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.150214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-610dd908-48da-4a02-ad9c-d406a24c0289 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.248634 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-980e0217-2fa3-4a79-ab9a-f49ed7ac799c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:44.256583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-980e0217-2fa3-4a79-ab9a-f49ed7ac799c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1266 microversion: 2.1 time: 0.144071 Sep 13 19:59:44.257392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 103/196] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:44 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:44.298419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-610dd908-48da-4a02-ad9c-d406a24c0289 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:44.306824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-610dd908-48da-4a02-ad9c-d406a24c0289 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.177128 Sep 13 19:59:44.322912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 94/197] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:44 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:44.525577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cab63dbd-f3c5-49a6-9c7b-9e30b2a9ec4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:44.526184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cab63dbd-f3c5-49a6-9c7b-9e30b2a9ec4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:44.532878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cab63dbd-f3c5-49a6-9c7b-9e30b2a9ec4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.533366 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cab63dbd-f3c5-49a6-9c7b-9e30b2a9ec4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.533801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cab63dbd-f3c5-49a6-9c7b-9e30b2a9ec4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.534558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cab63dbd-f3c5-49a6-9c7b-9e30b2a9ec4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.535010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cab63dbd-f3c5-49a6-9c7b-9e30b2a9ec4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.535455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cab63dbd-f3c5-49a6-9c7b-9e30b2a9ec4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.753185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cab63dbd-f3c5-49a6-9c7b-9e30b2a9ec4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:44.764748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cab63dbd-f3c5-49a6-9c7b-9e30b2a9ec4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.243121 Sep 13 19:59:44.765528 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 104/198] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:44 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:45.280573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d53c4270-9161-470b-b270-d2588b374790 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:45.281388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d53c4270-9161-470b-b270-d2588b374790 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:45.288336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d53c4270-9161-470b-b270-d2588b374790 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.288914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d53c4270-9161-470b-b270-d2588b374790 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.289335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d53c4270-9161-470b-b270-d2588b374790 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.290138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d53c4270-9161-470b-b270-d2588b374790 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.294720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d53c4270-9161-470b-b270-d2588b374790 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.295373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d53c4270-9161-470b-b270-d2588b374790 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.337676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4727118f-40a0-4081-ab4c-50d9f01b2822 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:45.339473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4727118f-40a0-4081-ab4c-50d9f01b2822 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:45.359165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4727118f-40a0-4081-ab4c-50d9f01b2822 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.361184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4727118f-40a0-4081-ab4c-50d9f01b2822 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.362493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4727118f-40a0-4081-ab4c-50d9f01b2822 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.363690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4727118f-40a0-4081-ab4c-50d9f01b2822 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.364396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4727118f-40a0-4081-ab4c-50d9f01b2822 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.365035 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4727118f-40a0-4081-ab4c-50d9f01b2822 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.385408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d53c4270-9161-470b-b270-d2588b374790 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:45.398124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d53c4270-9161-470b-b270-d2588b374790 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1266 microversion: 2.1 time: 0.118422 Sep 13 19:59:45.399038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 95/199] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:45 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:45.797898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-58ca5fb5-4465-45ea-a436-0e5ef9350e91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:45.801041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-58ca5fb5-4465-45ea-a436-0e5ef9350e91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:45.829003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58ca5fb5-4465-45ea-a436-0e5ef9350e91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.831006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58ca5fb5-4465-45ea-a436-0e5ef9350e91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.831006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58ca5fb5-4465-45ea-a436-0e5ef9350e91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.832143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58ca5fb5-4465-45ea-a436-0e5ef9350e91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.833773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58ca5fb5-4465-45ea-a436-0e5ef9350e91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.833773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58ca5fb5-4465-45ea-a436-0e5ef9350e91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.974726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4727118f-40a0-4081-ab4c-50d9f01b2822 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:45.989205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4727118f-40a0-4081-ab4c-50d9f01b2822 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.661082 Sep 13 19:59:46.009122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 105/200] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:45 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:46.144734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-58ca5fb5-4465-45ea-a436-0e5ef9350e91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:46.194393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-58ca5fb5-4465-45ea-a436-0e5ef9350e91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.403917 Sep 13 19:59:46.196599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 96/201] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:45 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:46.422061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e91839a3-2e20-46af-bff4-61d62c7f2078 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:46.423321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e91839a3-2e20-46af-bff4-61d62c7f2078 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:46.439551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e91839a3-2e20-46af-bff4-61d62c7f2078 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:46.439978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e91839a3-2e20-46af-bff4-61d62c7f2078 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:46.440785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e91839a3-2e20-46af-bff4-61d62c7f2078 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:46.441777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e91839a3-2e20-46af-bff4-61d62c7f2078 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:46.442332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e91839a3-2e20-46af-bff4-61d62c7f2078 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:46.442910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e91839a3-2e20-46af-bff4-61d62c7f2078 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:46.467914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-d4cb918c-df00-463d-983d-2a34176cbea7 req-3dc04478-22dd-4980-ba8a-99ace4429824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed156643-30e4-4158-b44b-ff8b7b4980e1", "name": "network-vif-plugged", "status": "completed", "tag": "1e18d8a0-f46d-4e86-a518-83b2588f925f"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:46.496193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-d4cb918c-df00-463d-983d-2a34176cbea7 req-3dc04478-22dd-4980-ba8a-99ace4429824 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:46.496193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-d4cb918c-df00-463d-983d-2a34176cbea7 req-3dc04478-22dd-4980-ba8a-99ace4429824 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:46.496193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-d4cb918c-df00-463d-983d-2a34176cbea7 req-3dc04478-22dd-4980-ba8a-99ace4429824 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:46.515360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-d4cb918c-df00-463d-983d-2a34176cbea7 req-3dc04478-22dd-4980-ba8a-99ace4429824 service nova] Creating event network-vif-plugged:1e18d8a0-f46d-4e86-a518-83b2588f925f for instance ed156643-30e4-4158-b44b-ff8b7b4980e1 on hv-cinder-85427 Sep 13 19:59:46.525528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-d4cb918c-df00-463d-983d-2a34176cbea7 req-3dc04478-22dd-4980-ba8a-99ace4429824 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061490 Sep 13 19:59:46.527882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 97/202] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:46.585722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e91839a3-2e20-46af-bff4-61d62c7f2078 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:46.598814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e91839a3-2e20-46af-bff4-61d62c7f2078 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1272 microversion: 2.1 time: 0.181090 Sep 13 19:59:46.607397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 106/203] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:46 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:47.016010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4c319d3e-8c87-4525-98e9-d78e86ff7126 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:47.016700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4c319d3e-8c87-4525-98e9-d78e86ff7126 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:47.023165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c319d3e-8c87-4525-98e9-d78e86ff7126 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.024065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c319d3e-8c87-4525-98e9-d78e86ff7126 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.024065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c319d3e-8c87-4525-98e9-d78e86ff7126 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.024720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c319d3e-8c87-4525-98e9-d78e86ff7126 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.025155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c319d3e-8c87-4525-98e9-d78e86ff7126 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.025609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c319d3e-8c87-4525-98e9-d78e86ff7126 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.219964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c95505a4-bf2b-459c-a9ae-7400fbf50537 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:47.221272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c95505a4-bf2b-459c-a9ae-7400fbf50537 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:47.225935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4c319d3e-8c87-4525-98e9-d78e86ff7126 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:47.229334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c95505a4-bf2b-459c-a9ae-7400fbf50537 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.230138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c95505a4-bf2b-459c-a9ae-7400fbf50537 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.231385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c95505a4-bf2b-459c-a9ae-7400fbf50537 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.232510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c95505a4-bf2b-459c-a9ae-7400fbf50537 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.233149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c95505a4-bf2b-459c-a9ae-7400fbf50537 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.233848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c95505a4-bf2b-459c-a9ae-7400fbf50537 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.247600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4c319d3e-8c87-4525-98e9-d78e86ff7126 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.235730 Sep 13 19:59:47.249787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 98/204] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:47 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:47.444106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c95505a4-bf2b-459c-a9ae-7400fbf50537 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:47.452592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c95505a4-bf2b-459c-a9ae-7400fbf50537 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.236449 Sep 13 19:59:47.453262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 107/205] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:47 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:47.636027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e8eb694f-8a16-4e2a-8c75-16a356b89c42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:47.638765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e8eb694f-8a16-4e2a-8c75-16a356b89c42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:47.645408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8eb694f-8a16-4e2a-8c75-16a356b89c42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.646000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8eb694f-8a16-4e2a-8c75-16a356b89c42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.646460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8eb694f-8a16-4e2a-8c75-16a356b89c42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.647775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8eb694f-8a16-4e2a-8c75-16a356b89c42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.648584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8eb694f-8a16-4e2a-8c75-16a356b89c42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.649037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8eb694f-8a16-4e2a-8c75-16a356b89c42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.833593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e8eb694f-8a16-4e2a-8c75-16a356b89c42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:47.841933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e8eb694f-8a16-4e2a-8c75-16a356b89c42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.211317 Sep 13 19:59:47.842777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 99/206] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:47 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:48.275691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b98d27e5-969b-4ff7-96a3-c92c778a1de2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:48.276612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b98d27e5-969b-4ff7-96a3-c92c778a1de2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:48.286578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b98d27e5-969b-4ff7-96a3-c92c778a1de2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.287157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b98d27e5-969b-4ff7-96a3-c92c778a1de2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.287621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b98d27e5-969b-4ff7-96a3-c92c778a1de2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.288472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b98d27e5-969b-4ff7-96a3-c92c778a1de2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.288916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b98d27e5-969b-4ff7-96a3-c92c778a1de2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.289355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b98d27e5-969b-4ff7-96a3-c92c778a1de2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.311260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:48.439832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b98d27e5-969b-4ff7-96a3-c92c778a1de2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:48.449879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b98d27e5-969b-4ff7-96a3-c92c778a1de2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.180002 Sep 13 19:59:48.450543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 108/207] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:48 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:48.478862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f33a03bd-22bc-45c3-9167-953192e3ed12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:48.479475 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f33a03bd-22bc-45c3-9167-953192e3ed12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:48.485982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f33a03bd-22bc-45c3-9167-953192e3ed12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.486359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f33a03bd-22bc-45c3-9167-953192e3ed12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.486816 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f33a03bd-22bc-45c3-9167-953192e3ed12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.487608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f33a03bd-22bc-45c3-9167-953192e3ed12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.487962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f33a03bd-22bc-45c3-9167-953192e3ed12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.488407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f33a03bd-22bc-45c3-9167-953192e3ed12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.711532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f33a03bd-22bc-45c3-9167-953192e3ed12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:48.721559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f33a03bd-22bc-45c3-9167-953192e3ed12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.247337 Sep 13 19:59:48.722672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 100/208] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:48 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:48.865268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fe403546-fc64-49c3-b9fa-a8845e47782d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:48.866012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fe403546-fc64-49c3-b9fa-a8845e47782d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:48.872409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe403546-fc64-49c3-b9fa-a8845e47782d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.872898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe403546-fc64-49c3-b9fa-a8845e47782d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.873326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe403546-fc64-49c3-b9fa-a8845e47782d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.874135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe403546-fc64-49c3-b9fa-a8845e47782d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.874623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe403546-fc64-49c3-b9fa-a8845e47782d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.875045 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe403546-fc64-49c3-b9fa-a8845e47782d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.072745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fe403546-fc64-49c3-b9fa-a8845e47782d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:49.083054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fe403546-fc64-49c3-b9fa-a8845e47782d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.221667 Sep 13 19:59:49.084188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 109/209] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:48 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:49.479396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e11044bf-d9dd-42c5-82cb-8d2fce1664c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:49.480819 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e11044bf-d9dd-42c5-82cb-8d2fce1664c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:49.488133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e11044bf-d9dd-42c5-82cb-8d2fce1664c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.488869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e11044bf-d9dd-42c5-82cb-8d2fce1664c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.489609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e11044bf-d9dd-42c5-82cb-8d2fce1664c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.490614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e11044bf-d9dd-42c5-82cb-8d2fce1664c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.491236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e11044bf-d9dd-42c5-82cb-8d2fce1664c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.491903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e11044bf-d9dd-42c5-82cb-8d2fce1664c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.599093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:49.732878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e11044bf-d9dd-42c5-82cb-8d2fce1664c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:49.744385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e11044bf-d9dd-42c5-82cb-8d2fce1664c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.272482 Sep 13 19:59:49.745331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 101/210] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:49 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:49.746516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-eb3c081c-49a6-4472-8cca-5568855468f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:49.747131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-eb3c081c-49a6-4472-8cca-5568855468f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:49.755264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:49.756077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=6 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:49.771652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eb3c081c-49a6-4472-8cca-5568855468f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.772427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eb3c081c-49a6-4472-8cca-5568855468f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.773016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eb3c081c-49a6-4472-8cca-5568855468f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.773907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eb3c081c-49a6-4472-8cca-5568855468f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.774630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eb3c081c-49a6-4472-8cca-5568855468f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.775205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eb3c081c-49a6-4472-8cca-5568855468f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.938353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-eb3c081c-49a6-4472-8cca-5568855468f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:49.952859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-eb3c081c-49a6-4472-8cca-5568855468f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.211082 Sep 13 19:59:49.962440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 110/211] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:49 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:50.113742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-575c514f-4341-47d8-92cb-82d535202137 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:50.114573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-575c514f-4341-47d8-92cb-82d535202137 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:50.121728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-575c514f-4341-47d8-92cb-82d535202137 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:50.122713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-575c514f-4341-47d8-92cb-82d535202137 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:50.123499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-575c514f-4341-47d8-92cb-82d535202137 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:50.124809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-575c514f-4341-47d8-92cb-82d535202137 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:50.125435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-575c514f-4341-47d8-92cb-82d535202137 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:50.126269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-575c514f-4341-47d8-92cb-82d535202137 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:50.790014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-575c514f-4341-47d8-92cb-82d535202137 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:50.795897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b4154c16-b0cc-4cf4-a28f-b0abb79759d2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:50.798722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b4154c16-b0cc-4cf4-a28f-b0abb79759d2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:50.812945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4154c16-b0cc-4cf4-a28f-b0abb79759d2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:50.813980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4154c16-b0cc-4cf4-a28f-b0abb79759d2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:50.814663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4154c16-b0cc-4cf4-a28f-b0abb79759d2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:50.815203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-575c514f-4341-47d8-92cb-82d535202137 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.703362 Sep 13 19:59:50.815960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4154c16-b0cc-4cf4-a28f-b0abb79759d2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:50.816625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4154c16-b0cc-4cf4-a28f-b0abb79759d2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:50.817246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4154c16-b0cc-4cf4-a28f-b0abb79759d2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:50.818530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 102/212] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:50 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:50.983070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-952d1b1c-eb73-4d2d-b3d0-734c0ad199f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:50.984305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-952d1b1c-eb73-4d2d-b3d0-734c0ad199f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:50.993965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-952d1b1c-eb73-4d2d-b3d0-734c0ad199f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:50.994920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-952d1b1c-eb73-4d2d-b3d0-734c0ad199f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:50.995532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-952d1b1c-eb73-4d2d-b3d0-734c0ad199f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:50.997608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-952d1b1c-eb73-4d2d-b3d0-734c0ad199f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:50.998395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-952d1b1c-eb73-4d2d-b3d0-734c0ad199f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:50.999043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-952d1b1c-eb73-4d2d-b3d0-734c0ad199f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:51.072814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:51.134323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b4154c16-b0cc-4cf4-a28f-b0abb79759d2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:51.145055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b4154c16-b0cc-4cf4-a28f-b0abb79759d2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.372537 Sep 13 19:59:51.159401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 111/213] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:50 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:51.492417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-952d1b1c-eb73-4d2d-b3d0-734c0ad199f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:51.500855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-952d1b1c-eb73-4d2d-b3d0-734c0ad199f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.523000 Sep 13 19:59:51.501442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 103/214] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:50 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:51.850065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a0ba147a-668b-4a03-ac30-d9920124e26b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:51.852381 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a0ba147a-668b-4a03-ac30-d9920124e26b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:51.864153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0ba147a-668b-4a03-ac30-d9920124e26b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:51.865491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0ba147a-668b-4a03-ac30-d9920124e26b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:51.866819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0ba147a-668b-4a03-ac30-d9920124e26b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:51.868747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0ba147a-668b-4a03-ac30-d9920124e26b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:51.869323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0ba147a-668b-4a03-ac30-d9920124e26b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:51.869867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0ba147a-668b-4a03-ac30-d9920124e26b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.031864 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-bcf2c6bb-3d01-4ff7-85b0-4adb647b64c9 req-8af75323-a823-4e19-8747-0c6750e4a372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19", "tag": "0fe03322-5617-4899-bcc3-1784fa57edc8"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:52.058337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:52.062199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-bcf2c6bb-3d01-4ff7-85b0-4adb647b64c9 req-8af75323-a823-4e19-8747-0c6750e4a372 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.062911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-bcf2c6bb-3d01-4ff7-85b0-4adb647b64c9 req-8af75323-a823-4e19-8747-0c6750e4a372 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.063605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-bcf2c6bb-3d01-4ff7-85b0-4adb647b64c9 req-8af75323-a823-4e19-8747-0c6750e4a372 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.069215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a0ba147a-668b-4a03-ac30-d9920124e26b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:52.082981 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a0ba147a-668b-4a03-ac30-d9920124e26b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.237971 Sep 13 19:59:52.092272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 112/215] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:51 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:52.100563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-bcf2c6bb-3d01-4ff7-85b0-4adb647b64c9 req-8af75323-a823-4e19-8747-0c6750e4a372 service nova] Creating event network-changed:0fe03322-5617-4899-bcc3-1784fa57edc8 for instance 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 on hv-cinder-85427 Sep 13 19:59:52.111946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-bcf2c6bb-3d01-4ff7-85b0-4adb647b64c9 req-8af75323-a823-4e19-8747-0c6750e4a372 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086566 Sep 13 19:59:52.113444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 104/216] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:52.173214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1f784007-47f2-4a40-8e66-072a6c411639 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:52.173922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1f784007-47f2-4a40-8e66-072a6c411639 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:52.180390 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f784007-47f2-4a40-8e66-072a6c411639 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.181068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f784007-47f2-4a40-8e66-072a6c411639 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.181600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f784007-47f2-4a40-8e66-072a6c411639 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.182433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f784007-47f2-4a40-8e66-072a6c411639 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.183109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f784007-47f2-4a40-8e66-072a6c411639 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.183629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f784007-47f2-4a40-8e66-072a6c411639 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.367672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1f784007-47f2-4a40-8e66-072a6c411639 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:52.381883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1f784007-47f2-4a40-8e66-072a6c411639 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1318 microversion: 2.1 time: 0.216221 Sep 13 19:59:52.382774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 113/217] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:52 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:52.543309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e28aefeb-74c5-4b72-9057-722b69d9bb22 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:52.549144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e28aefeb-74c5-4b72-9057-722b69d9bb22 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:52.557985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e28aefeb-74c5-4b72-9057-722b69d9bb22 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.558454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e28aefeb-74c5-4b72-9057-722b69d9bb22 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.559238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e28aefeb-74c5-4b72-9057-722b69d9bb22 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.560275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e28aefeb-74c5-4b72-9057-722b69d9bb22 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.561157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e28aefeb-74c5-4b72-9057-722b69d9bb22 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.561951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e28aefeb-74c5-4b72-9057-722b69d9bb22 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:53.108196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b4a08d99-ce60-44a3-921e-9bad935071cc tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:53.109702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b4a08d99-ce60-44a3-921e-9bad935071cc tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:53.112859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:53.119538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4a08d99-ce60-44a3-921e-9bad935071cc tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:53.120172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4a08d99-ce60-44a3-921e-9bad935071cc tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:53.120868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4a08d99-ce60-44a3-921e-9bad935071cc tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:53.121934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4a08d99-ce60-44a3-921e-9bad935071cc tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:53.122733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4a08d99-ce60-44a3-921e-9bad935071cc tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:53.123264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4a08d99-ce60-44a3-921e-9bad935071cc tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:53.174734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e28aefeb-74c5-4b72-9057-722b69d9bb22 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:53.183325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e28aefeb-74c5-4b72-9057-722b69d9bb22 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.648912 Sep 13 19:59:53.199146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 105/218] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:52 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:53.336322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b4a08d99-ce60-44a3-921e-9bad935071cc tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:53.344764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b4a08d99-ce60-44a3-921e-9bad935071cc tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.241966 Sep 13 19:59:53.345337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 114/219] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:53 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:53.407099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f939fc78-22bb-48b7-9b2a-27780861c38b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:53.407871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f939fc78-22bb-48b7-9b2a-27780861c38b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:53.413859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f939fc78-22bb-48b7-9b2a-27780861c38b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:53.414446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f939fc78-22bb-48b7-9b2a-27780861c38b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:53.414876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f939fc78-22bb-48b7-9b2a-27780861c38b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:53.415767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f939fc78-22bb-48b7-9b2a-27780861c38b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:53.416173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f939fc78-22bb-48b7-9b2a-27780861c38b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:53.416613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f939fc78-22bb-48b7-9b2a-27780861c38b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:53.760650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f939fc78-22bb-48b7-9b2a-27780861c38b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:53.776160 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f939fc78-22bb-48b7-9b2a-27780861c38b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1506 microversion: 2.1 time: 0.372725 Sep 13 19:59:53.777102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 106/220] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:53 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:54.211750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a5bdbf86-81f2-4f40-9338-c414d231e2c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:54.212545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a5bdbf86-81f2-4f40-9338-c414d231e2c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:54.232922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5bdbf86-81f2-4f40-9338-c414d231e2c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:54.234196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5bdbf86-81f2-4f40-9338-c414d231e2c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:54.241786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5bdbf86-81f2-4f40-9338-c414d231e2c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:54.244210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5bdbf86-81f2-4f40-9338-c414d231e2c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:54.247388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5bdbf86-81f2-4f40-9338-c414d231e2c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:54.257485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5bdbf86-81f2-4f40-9338-c414d231e2c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:54.382240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-08f2f9ef-8440-47dd-b259-c1f964bd3e38 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:54.382931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-08f2f9ef-8440-47dd-b259-c1f964bd3e38 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:54.398632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-08f2f9ef-8440-47dd-b259-c1f964bd3e38 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:54.403480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-08f2f9ef-8440-47dd-b259-c1f964bd3e38 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:54.406708 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-08f2f9ef-8440-47dd-b259-c1f964bd3e38 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:54.411332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-08f2f9ef-8440-47dd-b259-c1f964bd3e38 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:54.411818 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-08f2f9ef-8440-47dd-b259-c1f964bd3e38 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:54.412250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-08f2f9ef-8440-47dd-b259-c1f964bd3e38 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:54.518128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a5bdbf86-81f2-4f40-9338-c414d231e2c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:54.554854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a5bdbf86-81f2-4f40-9338-c414d231e2c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.350960 Sep 13 19:59:54.558600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 115/221] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:54 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:54.916751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-08f2f9ef-8440-47dd-b259-c1f964bd3e38 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:54.927001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-08f2f9ef-8440-47dd-b259-c1f964bd3e38 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.562842 Sep 13 19:59:54.927837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 107/222] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:54 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:55.589696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8145b4a3-0911-4e63-a160-d740deb76753 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:55.591945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8145b4a3-0911-4e63-a160-d740deb76753 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:55.609009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8145b4a3-0911-4e63-a160-d740deb76753 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:55.611598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8145b4a3-0911-4e63-a160-d740deb76753 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:55.612238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8145b4a3-0911-4e63-a160-d740deb76753 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:55.613982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8145b4a3-0911-4e63-a160-d740deb76753 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:55.616022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8145b4a3-0911-4e63-a160-d740deb76753 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:55.618251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8145b4a3-0911-4e63-a160-d740deb76753 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:55.941454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8145b4a3-0911-4e63-a160-d740deb76753 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:55.954876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8145b4a3-0911-4e63-a160-d740deb76753 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.373778 Sep 13 19:59:55.955481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 116/223] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:55 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:55.967882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0285f299-5388-4f5d-8ed6-af723608ce85 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:55.968653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0285f299-5388-4f5d-8ed6-af723608ce85 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:55.990295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0285f299-5388-4f5d-8ed6-af723608ce85 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:55.991817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0285f299-5388-4f5d-8ed6-af723608ce85 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:55.992450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0285f299-5388-4f5d-8ed6-af723608ce85 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:55.994543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0285f299-5388-4f5d-8ed6-af723608ce85 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:55.996161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0285f299-5388-4f5d-8ed6-af723608ce85 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:55.996768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0285f299-5388-4f5d-8ed6-af723608ce85 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:56.243772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0285f299-5388-4f5d-8ed6-af723608ce85 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:56.256619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0285f299-5388-4f5d-8ed6-af723608ce85 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.304512 Sep 13 19:59:56.258556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 108/224] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:55 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:56.329145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f72c8eec-849a-4ef2-a22c-8325b942c107 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Action: 'create', calling method: .version_select at 0x7f98467700d0>, body: {"keypair": {"name": "tempest-keypair-1519092093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA60ZGhWfZgfpdGBfaiamXDQegN8XkBOnMqUFe/8XO/6ZlZAKsDc+EhSWpCmzQJe/MDO0FPVkpalOY/EKILQZwiKqn0amf8dZt7+gmeRjIAr2AbVGmW4RToPl6bdeTYYw=="}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:56.346513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-f72c8eec-849a-4ef2-a22c-8325b942c107 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Getting quotas for project b3fa762826924accaa8012d7ceaf17eb. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:59:56.351106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-f72c8eec-849a-4ef2-a22c-8325b942c107 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Getting quotas for user 87c4f9c4b9334b66ac89e01a278436bc and project b3fa762826924accaa8012d7ceaf17eb. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:59:56.384430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f72c8eec-849a-4ef2-a22c-8325b942c107 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.237296 Sep 13 19:59:56.386700 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 117/225] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 13 19:59:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:56.982170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d33db379-0ad1-4dbd-afa1-8f3cc6e72ad6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:56.983464 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d33db379-0ad1-4dbd-afa1-8f3cc6e72ad6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:56.989707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d33db379-0ad1-4dbd-afa1-8f3cc6e72ad6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:56.990447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d33db379-0ad1-4dbd-afa1-8f3cc6e72ad6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:56.991036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d33db379-0ad1-4dbd-afa1-8f3cc6e72ad6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:56.991742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d33db379-0ad1-4dbd-afa1-8f3cc6e72ad6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:56.992187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d33db379-0ad1-4dbd-afa1-8f3cc6e72ad6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:56.992759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d33db379-0ad1-4dbd-afa1-8f3cc6e72ad6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:57.230199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d33db379-0ad1-4dbd-afa1-8f3cc6e72ad6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:57.238882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d33db379-0ad1-4dbd-afa1-8f3cc6e72ad6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.261806 Sep 13 19:59:57.254344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 109/226] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:56 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:57.282409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b51c48a6-2c99-43e3-ab34-f0b128c80e25 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:57.283713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b51c48a6-2c99-43e3-ab34-f0b128c80e25 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:57.295663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b51c48a6-2c99-43e3-ab34-f0b128c80e25 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:57.298628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b51c48a6-2c99-43e3-ab34-f0b128c80e25 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:57.299746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b51c48a6-2c99-43e3-ab34-f0b128c80e25 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:57.302406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b51c48a6-2c99-43e3-ab34-f0b128c80e25 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:57.303338 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b51c48a6-2c99-43e3-ab34-f0b128c80e25 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:57.304251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b51c48a6-2c99-43e3-ab34-f0b128c80e25 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:57.499736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b51c48a6-2c99-43e3-ab34-f0b128c80e25 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:57.511565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b51c48a6-2c99-43e3-ab34-f0b128c80e25 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.233295 Sep 13 19:59:57.512652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 118/227] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:57 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:58.249117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1455060516", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "990730b3-824d-4a88-9c88-3fdb4c9e239c"}], "security_groups": [{"name": "tempest-securitygroup--499705686"}], "key_name": "tempest-keypair-1519092093", "user_data": "}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:58.263526 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-aa78046e-a49c-42ff-8a2b-43c377807d48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:58.264346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-aa78046e-a49c-42ff-8a2b-43c377807d48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:58.272773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa78046e-a49c-42ff-8a2b-43c377807d48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:58.273576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa78046e-a49c-42ff-8a2b-43c377807d48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:58.274079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa78046e-a49c-42ff-8a2b-43c377807d48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:58.274873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa78046e-a49c-42ff-8a2b-43c377807d48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:58.275325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa78046e-a49c-42ff-8a2b-43c377807d48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:58.275744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa78046e-a49c-42ff-8a2b-43c377807d48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:58.438761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-aa78046e-a49c-42ff-8a2b-43c377807d48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:58.447837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-aa78046e-a49c-42ff-8a2b-43c377807d48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.188892 Sep 13 19:59:58.448434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 119/228] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:58 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:58.535451 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-06f7ee9d-3bd3-4155-826c-eece3aa99177 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:58.536169 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-06f7ee9d-3bd3-4155-826c-eece3aa99177 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:58.542545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06f7ee9d-3bd3-4155-826c-eece3aa99177 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:58.543018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06f7ee9d-3bd3-4155-826c-eece3aa99177 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:58.543436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06f7ee9d-3bd3-4155-826c-eece3aa99177 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:58.544174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06f7ee9d-3bd3-4155-826c-eece3aa99177 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:58.544786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06f7ee9d-3bd3-4155-826c-eece3aa99177 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:58.545388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06f7ee9d-3bd3-4155-826c-eece3aa99177 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:58.699254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-06f7ee9d-3bd3-4155-826c-eece3aa99177 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:58.707861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-06f7ee9d-3bd3-4155-826c-eece3aa99177 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.176102 Sep 13 19:59:58.708445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 120/229] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:58 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:59.470292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0a89843a-dd56-4bc2-a86c-3dbfd442870f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:59.470903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0a89843a-dd56-4bc2-a86c-3dbfd442870f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:59.477917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a89843a-dd56-4bc2-a86c-3dbfd442870f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:59.478398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a89843a-dd56-4bc2-a86c-3dbfd442870f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:59.478870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a89843a-dd56-4bc2-a86c-3dbfd442870f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:59.479544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a89843a-dd56-4bc2-a86c-3dbfd442870f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:59.479982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a89843a-dd56-4bc2-a86c-3dbfd442870f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:59.480391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a89843a-dd56-4bc2-a86c-3dbfd442870f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:59.626769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0a89843a-dd56-4bc2-a86c-3dbfd442870f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:59.637853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0a89843a-dd56-4bc2-a86c-3dbfd442870f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.170599 Sep 13 19:59:59.638355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 121/230] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:59 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:59.732801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-17eb8355-0ddf-493b-8adb-1930f872fdc9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:59.733498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-17eb8355-0ddf-493b-8adb-1930f872fdc9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:59.740016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17eb8355-0ddf-493b-8adb-1930f872fdc9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:59.740506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17eb8355-0ddf-493b-8adb-1930f872fdc9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:59.740995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17eb8355-0ddf-493b-8adb-1930f872fdc9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:59.741719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17eb8355-0ddf-493b-8adb-1930f872fdc9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:59.742167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17eb8355-0ddf-493b-8adb-1930f872fdc9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:59.742642 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17eb8355-0ddf-493b-8adb-1930f872fdc9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:59.882214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17eb8355-0ddf-493b-8adb-1930f872fdc9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:59.890284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-17eb8355-0ddf-493b-8adb-1930f872fdc9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.162082 Sep 13 19:59:59.890880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 122/231] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:59 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:00.667163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-85eededa-2885-497b-8af6-765ca17db879 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:00.667820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-85eededa-2885-497b-8af6-765ca17db879 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:00.674691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85eededa-2885-497b-8af6-765ca17db879 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:00.675175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85eededa-2885-497b-8af6-765ca17db879 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:00.675606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85eededa-2885-497b-8af6-765ca17db879 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:00.676292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85eededa-2885-497b-8af6-765ca17db879 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:00.676719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85eededa-2885-497b-8af6-765ca17db879 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:00.677163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85eededa-2885-497b-8af6-765ca17db879 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:00.819593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-85eededa-2885-497b-8af6-765ca17db879 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:00.828240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-85eededa-2885-497b-8af6-765ca17db879 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.165144 Sep 13 20:00:00.828863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 123/232] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:00 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:00.912634 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-13680aa1-d03c-401d-97ed-3178db4022d9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:00.913236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-13680aa1-d03c-401d-97ed-3178db4022d9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:00.919727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-13680aa1-d03c-401d-97ed-3178db4022d9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:00.920252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-13680aa1-d03c-401d-97ed-3178db4022d9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:00.920661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-13680aa1-d03c-401d-97ed-3178db4022d9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:00.921397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-13680aa1-d03c-401d-97ed-3178db4022d9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:00.921837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-13680aa1-d03c-401d-97ed-3178db4022d9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:00.922495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-13680aa1-d03c-401d-97ed-3178db4022d9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:01.061267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-13680aa1-d03c-401d-97ed-3178db4022d9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:01.069433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-13680aa1-d03c-401d-97ed-3178db4022d9 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.160531 Sep 13 20:00:01.070020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 124/233] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:00 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:01.858455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-06ad6577-8c88-496c-90c0-fe8a20a0000d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:01.859158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-06ad6577-8c88-496c-90c0-fe8a20a0000d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:01.867250 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06ad6577-8c88-496c-90c0-fe8a20a0000d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:01.867734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06ad6577-8c88-496c-90c0-fe8a20a0000d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:01.868176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06ad6577-8c88-496c-90c0-fe8a20a0000d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:01.868915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06ad6577-8c88-496c-90c0-fe8a20a0000d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:01.869460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06ad6577-8c88-496c-90c0-fe8a20a0000d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:01.869998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06ad6577-8c88-496c-90c0-fe8a20a0000d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:02.029295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-06ad6577-8c88-496c-90c0-fe8a20a0000d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:02.042041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-06ad6577-8c88-496c-90c0-fe8a20a0000d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.189271 Sep 13 20:00:02.043295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 125/234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:01 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:02.111094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-59d1be2f-bf07-4352-880a-d88b3507b511 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:02.111896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-59d1be2f-bf07-4352-880a-d88b3507b511 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:02.119055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59d1be2f-bf07-4352-880a-d88b3507b511 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:02.119643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59d1be2f-bf07-4352-880a-d88b3507b511 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:02.120317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59d1be2f-bf07-4352-880a-d88b3507b511 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:02.121257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59d1be2f-bf07-4352-880a-d88b3507b511 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:02.121870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59d1be2f-bf07-4352-880a-d88b3507b511 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:02.122574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59d1be2f-bf07-4352-880a-d88b3507b511 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:02.128567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:02.264351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-59d1be2f-bf07-4352-880a-d88b3507b511 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:02.276194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-59d1be2f-bf07-4352-880a-d88b3507b511 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.178841 Sep 13 20:00:02.276999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 126/235] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:02 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:03.066180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-518da93a-9037-4ae4-9047-3cfb4c9a2db4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:03.066843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-518da93a-9037-4ae4-9047-3cfb4c9a2db4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:03.073603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-518da93a-9037-4ae4-9047-3cfb4c9a2db4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:03.074088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-518da93a-9037-4ae4-9047-3cfb4c9a2db4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:03.074565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-518da93a-9037-4ae4-9047-3cfb4c9a2db4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:03.075257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-518da93a-9037-4ae4-9047-3cfb4c9a2db4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:03.075706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-518da93a-9037-4ae4-9047-3cfb4c9a2db4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:03.076125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-518da93a-9037-4ae4-9047-3cfb4c9a2db4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:03.217458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-518da93a-9037-4ae4-9047-3cfb4c9a2db4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:03.226041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-518da93a-9037-4ae4-9047-3cfb4c9a2db4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.164320 Sep 13 20:00:03.226663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 127/236] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:03 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:03.298593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-63cc5656-0b82-4bd1-b730-1d73e8ee7b42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:03.299658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-63cc5656-0b82-4bd1-b730-1d73e8ee7b42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:03.305919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-63cc5656-0b82-4bd1-b730-1d73e8ee7b42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:03.306732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-63cc5656-0b82-4bd1-b730-1d73e8ee7b42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:03.307358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-63cc5656-0b82-4bd1-b730-1d73e8ee7b42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:03.308079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-63cc5656-0b82-4bd1-b730-1d73e8ee7b42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:03.308552 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-63cc5656-0b82-4bd1-b730-1d73e8ee7b42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:03.308946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-63cc5656-0b82-4bd1-b730-1d73e8ee7b42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:03.459068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-63cc5656-0b82-4bd1-b730-1d73e8ee7b42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:03.467813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-63cc5656-0b82-4bd1-b730-1d73e8ee7b42 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.173457 Sep 13 20:00:03.468487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 128/237] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:03 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:03.508961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-271d99e8-381e-42a1-ac97-afc9f48d6ec0 req-256fb243-e2a8-4f29-9654-f01055329dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19", "name": "network-vif-plugged", "status": "completed", "tag": "0fe03322-5617-4899-bcc3-1784fa57edc8"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:03.520374 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-271d99e8-381e-42a1-ac97-afc9f48d6ec0 req-256fb243-e2a8-4f29-9654-f01055329dd5 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:03.521559 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-271d99e8-381e-42a1-ac97-afc9f48d6ec0 req-256fb243-e2a8-4f29-9654-f01055329dd5 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:03.522237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-271d99e8-381e-42a1-ac97-afc9f48d6ec0 req-256fb243-e2a8-4f29-9654-f01055329dd5 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:03.539313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-271d99e8-381e-42a1-ac97-afc9f48d6ec0 req-256fb243-e2a8-4f29-9654-f01055329dd5 service nova] Creating event network-vif-plugged:0fe03322-5617-4899-bcc3-1784fa57edc8 for instance 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 on hv-cinder-85427 Sep 13 20:00:03.547924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-271d99e8-381e-42a1-ac97-afc9f48d6ec0 req-256fb243-e2a8-4f29-9654-f01055329dd5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043408 Sep 13 20:00:03.548898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 129/238] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:04.250142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3cfbb30c-4faf-41c7-8aeb-c5ea841f3dca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:04.251111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3cfbb30c-4faf-41c7-8aeb-c5ea841f3dca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:04.257371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3cfbb30c-4faf-41c7-8aeb-c5ea841f3dca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:04.257937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3cfbb30c-4faf-41c7-8aeb-c5ea841f3dca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:04.258457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3cfbb30c-4faf-41c7-8aeb-c5ea841f3dca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:04.259213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3cfbb30c-4faf-41c7-8aeb-c5ea841f3dca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:04.259727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3cfbb30c-4faf-41c7-8aeb-c5ea841f3dca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:04.260145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3cfbb30c-4faf-41c7-8aeb-c5ea841f3dca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:04.404014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3cfbb30c-4faf-41c7-8aeb-c5ea841f3dca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:04.414592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3cfbb30c-4faf-41c7-8aeb-c5ea841f3dca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.169464 Sep 13 20:00:04.415231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 130/239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:04 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:04.493591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c7bede51-7146-43cd-a591-35074138bff8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:04.494206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c7bede51-7146-43cd-a591-35074138bff8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:04.501049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c7bede51-7146-43cd-a591-35074138bff8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:04.501510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c7bede51-7146-43cd-a591-35074138bff8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:04.502155 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c7bede51-7146-43cd-a591-35074138bff8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:04.502891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c7bede51-7146-43cd-a591-35074138bff8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:04.503327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c7bede51-7146-43cd-a591-35074138bff8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:04.503810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c7bede51-7146-43cd-a591-35074138bff8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:04.652704 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c7bede51-7146-43cd-a591-35074138bff8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:04.661050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c7bede51-7146-43cd-a591-35074138bff8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.171497 Sep 13 20:00:04.661682 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 131/240] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:04 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:05.439053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c46332e0-22d0-408a-a9e3-784078feb4c0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:05.443343 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c46332e0-22d0-408a-a9e3-784078feb4c0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:05.454690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c46332e0-22d0-408a-a9e3-784078feb4c0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:05.455446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c46332e0-22d0-408a-a9e3-784078feb4c0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:05.455941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c46332e0-22d0-408a-a9e3-784078feb4c0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:05.456801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c46332e0-22d0-408a-a9e3-784078feb4c0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:05.457249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c46332e0-22d0-408a-a9e3-784078feb4c0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:05.457665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c46332e0-22d0-408a-a9e3-784078feb4c0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:05.618779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c46332e0-22d0-408a-a9e3-784078feb4c0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:05.626972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c46332e0-22d0-408a-a9e3-784078feb4c0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.192299 Sep 13 20:00:05.627664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 132/241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:05 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:05.685376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a85dbf99-f658-4e75-b41a-c59a77e75c2f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:05.685980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a85dbf99-f658-4e75-b41a-c59a77e75c2f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:05.692072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a85dbf99-f658-4e75-b41a-c59a77e75c2f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:05.692546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a85dbf99-f658-4e75-b41a-c59a77e75c2f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:05.692979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a85dbf99-f658-4e75-b41a-c59a77e75c2f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:05.693769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a85dbf99-f658-4e75-b41a-c59a77e75c2f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:05.694310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a85dbf99-f658-4e75-b41a-c59a77e75c2f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:05.694877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a85dbf99-f658-4e75-b41a-c59a77e75c2f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:05.840632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] validate_networks() for [('990730b3-824d-4a88-9c88-3fdb4c9e239c', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:00:06.068223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a85dbf99-f658-4e75-b41a-c59a77e75c2f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:06.083110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a85dbf99-f658-4e75-b41a-c59a77e75c2f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1314 microversion: 2.1 time: 0.401147 Sep 13 20:00:06.084112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 133/242] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:05 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:06.333880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:00:06.335012 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:00:06.335012 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:00:06.335327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:00:06.335621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:00:06.351419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.351913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.352649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.353620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.354225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.354824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.375579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Getting quotas for project b3fa762826924accaa8012d7ceaf17eb. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:00:06.380618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Getting quotas for user 87c4f9c4b9334b66ac89e01a278436bc and project b3fa762826924accaa8012d7ceaf17eb. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:00:06.398927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:00:06.401847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:00:06.460105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-addc0d80-c984-455d-b0f8-07d8ece98f44 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 8.215237 Sep 13 20:00:06.461252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 110/243] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 19:59:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 8217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:00:06.472511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5682a4c3-c7f8-4cf5-9b77-44d60e725e54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:06.473426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5682a4c3-c7f8-4cf5-9b77-44d60e725e54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:06.475439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=4 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:06.580959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5682a4c3-c7f8-4cf5-9b77-44d60e725e54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:06.590080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5682a4c3-c7f8-4cf5-9b77-44d60e725e54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1238 microversion: 2.1 time: 0.121453 Sep 13 20:00:06.590999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 134/244] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1238 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:06.656130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5280cb5a-cdb5-4358-a0c8-26ca284e20e2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:06.661720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5280cb5a-cdb5-4358-a0c8-26ca284e20e2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:06.673778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5280cb5a-cdb5-4358-a0c8-26ca284e20e2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.674359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5280cb5a-cdb5-4358-a0c8-26ca284e20e2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.674989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5280cb5a-cdb5-4358-a0c8-26ca284e20e2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.675686 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5280cb5a-cdb5-4358-a0c8-26ca284e20e2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.676202 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5280cb5a-cdb5-4358-a0c8-26ca284e20e2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.676982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5280cb5a-cdb5-4358-a0c8-26ca284e20e2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.868528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5280cb5a-cdb5-4358-a0c8-26ca284e20e2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:06.877201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5280cb5a-cdb5-4358-a0c8-26ca284e20e2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.224936 Sep 13 20:00:06.877957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 111/245] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:06 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:07.107465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e1a97042-a471-4aa7-82de-3c7f0674c252 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:07.108378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e1a97042-a471-4aa7-82de-3c7f0674c252 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:07.121203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1a97042-a471-4aa7-82de-3c7f0674c252 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.121956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1a97042-a471-4aa7-82de-3c7f0674c252 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.122578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1a97042-a471-4aa7-82de-3c7f0674c252 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:07.123454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1a97042-a471-4aa7-82de-3c7f0674c252 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.124051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1a97042-a471-4aa7-82de-3c7f0674c252 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.124638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1a97042-a471-4aa7-82de-3c7f0674c252 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:07.336405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e1a97042-a471-4aa7-82de-3c7f0674c252 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:07.345310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e1a97042-a471-4aa7-82de-3c7f0674c252 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1498 microversion: 2.1 time: 0.242023 Sep 13 20:00:07.352756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 135/246] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:07 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1498 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:07.615855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-419a91bf-da8d-4e6f-9dfa-1330f169b03a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:07.616404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-419a91bf-da8d-4e6f-9dfa-1330f169b03a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:07.625493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-419a91bf-da8d-4e6f-9dfa-1330f169b03a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.625984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-419a91bf-da8d-4e6f-9dfa-1330f169b03a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.627602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-419a91bf-da8d-4e6f-9dfa-1330f169b03a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:07.628354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-419a91bf-da8d-4e6f-9dfa-1330f169b03a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.628802 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-419a91bf-da8d-4e6f-9dfa-1330f169b03a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.629437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-419a91bf-da8d-4e6f-9dfa-1330f169b03a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:07.718640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-419a91bf-da8d-4e6f-9dfa-1330f169b03a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:07.726231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-419a91bf-da8d-4e6f-9dfa-1330f169b03a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1234 microversion: 2.1 time: 0.114666 Sep 13 20:00:07.726973 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 112/247] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1234 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:07.901220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b8e3b50f-b49d-4305-98a2-e448a6f11e49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:07.903231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b8e3b50f-b49d-4305-98a2-e448a6f11e49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:07.911770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b8e3b50f-b49d-4305-98a2-e448a6f11e49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.912603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b8e3b50f-b49d-4305-98a2-e448a6f11e49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.913306 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b8e3b50f-b49d-4305-98a2-e448a6f11e49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:07.914694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b8e3b50f-b49d-4305-98a2-e448a6f11e49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.915371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b8e3b50f-b49d-4305-98a2-e448a6f11e49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.915992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b8e3b50f-b49d-4305-98a2-e448a6f11e49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.106142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b8e3b50f-b49d-4305-98a2-e448a6f11e49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:08.125961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b8e3b50f-b49d-4305-98a2-e448a6f11e49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.228807 Sep 13 20:00:08.142084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 136/248] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:07 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:08.207114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-686cdcf3-ae24-4ab2-940f-2e7e0002626d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:08.207612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-686cdcf3-ae24-4ab2-940f-2e7e0002626d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:08.217285 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-686cdcf3-ae24-4ab2-940f-2e7e0002626d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.217784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-686cdcf3-ae24-4ab2-940f-2e7e0002626d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.218220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-686cdcf3-ae24-4ab2-940f-2e7e0002626d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.218961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-686cdcf3-ae24-4ab2-940f-2e7e0002626d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.219493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-686cdcf3-ae24-4ab2-940f-2e7e0002626d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.219917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-686cdcf3-ae24-4ab2-940f-2e7e0002626d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.267944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-686cdcf3-ae24-4ab2-940f-2e7e0002626d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Going to try to terminate instance {{(pid=120845) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:00:08.358862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-686cdcf3-ae24-4ab2-940f-2e7e0002626d tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 204 len: 0 microversion: 2.1 time: 0.156725 Sep 13 20:00:08.359638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 113/249] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:00:08 2022] DELETE /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:00:08.369919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-04e73bfd-ebb4-4080-aaa6-69a51c2612de tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:08.370572 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-04e73bfd-ebb4-4080-aaa6-69a51c2612de tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:08.378886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-04e73bfd-ebb4-4080-aaa6-69a51c2612de tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.378886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-04e73bfd-ebb4-4080-aaa6-69a51c2612de tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.378886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-04e73bfd-ebb4-4080-aaa6-69a51c2612de tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.379288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-04e73bfd-ebb4-4080-aaa6-69a51c2612de tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.379737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-04e73bfd-ebb4-4080-aaa6-69a51c2612de tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.380065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-04e73bfd-ebb4-4080-aaa6-69a51c2612de tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.564142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-04e73bfd-ebb4-4080-aaa6-69a51c2612de tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:08.580664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-04e73bfd-ebb4-4080-aaa6-69a51c2612de tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1504 microversion: 2.1 time: 0.216101 Sep 13 20:00:08.581249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 137/250] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:08 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:08.752046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dd1ab3ec-2a89-4461-9a32-41a534345d17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:08.753161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dd1ab3ec-2a89-4461-9a32-41a534345d17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:08.760765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd1ab3ec-2a89-4461-9a32-41a534345d17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.761539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd1ab3ec-2a89-4461-9a32-41a534345d17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.762382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd1ab3ec-2a89-4461-9a32-41a534345d17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.763642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd1ab3ec-2a89-4461-9a32-41a534345d17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.764480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd1ab3ec-2a89-4461-9a32-41a534345d17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.765599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd1ab3ec-2a89-4461-9a32-41a534345d17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.878979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dd1ab3ec-2a89-4461-9a32-41a534345d17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:08.890451 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dd1ab3ec-2a89-4461-9a32-41a534345d17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1290 microversion: 2.1 time: 0.144554 Sep 13 20:00:08.892193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 114/251] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1290 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:09.154151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6e584567-9b6b-4684-ba00-0a5625792f36 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:09.154897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6e584567-9b6b-4684-ba00-0a5625792f36 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:09.162676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e584567-9b6b-4684-ba00-0a5625792f36 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.163165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e584567-9b6b-4684-ba00-0a5625792f36 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.163598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e584567-9b6b-4684-ba00-0a5625792f36 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.164459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e584567-9b6b-4684-ba00-0a5625792f36 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.165093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e584567-9b6b-4684-ba00-0a5625792f36 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.165542 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e584567-9b6b-4684-ba00-0a5625792f36 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.371217 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6e584567-9b6b-4684-ba00-0a5625792f36 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:09.380047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6e584567-9b6b-4684-ba00-0a5625792f36 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.230167 Sep 13 20:00:09.380442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 138/252] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:09 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:09.612092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3f130daf-c21a-472d-9ccb-1f0d305a7f16 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:09.613713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3f130daf-c21a-472d-9ccb-1f0d305a7f16 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:09.620006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f130daf-c21a-472d-9ccb-1f0d305a7f16 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.620485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f130daf-c21a-472d-9ccb-1f0d305a7f16 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.621273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f130daf-c21a-472d-9ccb-1f0d305a7f16 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.622134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f130daf-c21a-472d-9ccb-1f0d305a7f16 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.622715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f130daf-c21a-472d-9ccb-1f0d305a7f16 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.623257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f130daf-c21a-472d-9ccb-1f0d305a7f16 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.917313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3f130daf-c21a-472d-9ccb-1f0d305a7f16 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:09.933522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3ecf4654-abf3-4fe7-942d-767667736f99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:09.933522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3ecf4654-abf3-4fe7-942d-767667736f99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:09.933790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3f130daf-c21a-472d-9ccb-1f0d305a7f16 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1504 microversion: 2.1 time: 0.324664 Sep 13 20:00:09.933790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 115/253] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:09 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:09.937719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ecf4654-abf3-4fe7-942d-767667736f99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.938247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ecf4654-abf3-4fe7-942d-767667736f99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.938734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ecf4654-abf3-4fe7-942d-767667736f99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.939452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ecf4654-abf3-4fe7-942d-767667736f99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.939903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ecf4654-abf3-4fe7-942d-767667736f99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.940333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ecf4654-abf3-4fe7-942d-767667736f99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:10.017388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3ecf4654-abf3-4fe7-942d-767667736f99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:10.026359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3ecf4654-abf3-4fe7-942d-767667736f99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1290 microversion: 2.1 time: 0.100309 Sep 13 20:00:10.026982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 139/254] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:10.403825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1fb18c22-8f9d-4dcf-9173-cb57bec4238e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:10.404468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1fb18c22-8f9d-4dcf-9173-cb57bec4238e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:10.411749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1fb18c22-8f9d-4dcf-9173-cb57bec4238e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:10.412357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1fb18c22-8f9d-4dcf-9173-cb57bec4238e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:10.412643 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1fb18c22-8f9d-4dcf-9173-cb57bec4238e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:10.413495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1fb18c22-8f9d-4dcf-9173-cb57bec4238e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:10.413940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1fb18c22-8f9d-4dcf-9173-cb57bec4238e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:10.414508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1fb18c22-8f9d-4dcf-9173-cb57bec4238e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:10.570702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1fb18c22-8f9d-4dcf-9173-cb57bec4238e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:10.588182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1fb18c22-8f9d-4dcf-9173-cb57bec4238e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1521 microversion: 2.1 time: 0.187973 Sep 13 20:00:10.589231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 116/255] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:10 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:10.957012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-80e6ed27-dd8a-464c-b3f3-113a4a244444 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:10.958098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-80e6ed27-dd8a-464c-b3f3-113a4a244444 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:10.968404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80e6ed27-dd8a-464c-b3f3-113a4a244444 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:10.968921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80e6ed27-dd8a-464c-b3f3-113a4a244444 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:10.969523 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80e6ed27-dd8a-464c-b3f3-113a4a244444 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:10.986874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80e6ed27-dd8a-464c-b3f3-113a4a244444 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:10.986874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80e6ed27-dd8a-464c-b3f3-113a4a244444 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:10.986874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80e6ed27-dd8a-464c-b3f3-113a4a244444 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.056660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ebca37d1-9941-485c-b21a-6be57623b9bf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:11.059037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ebca37d1-9941-485c-b21a-6be57623b9bf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:11.070555 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebca37d1-9941-485c-b21a-6be57623b9bf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.071337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebca37d1-9941-485c-b21a-6be57623b9bf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.071970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebca37d1-9941-485c-b21a-6be57623b9bf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.072721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebca37d1-9941-485c-b21a-6be57623b9bf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.073173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebca37d1-9941-485c-b21a-6be57623b9bf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.073776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebca37d1-9941-485c-b21a-6be57623b9bf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.146360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ebca37d1-9941-485c-b21a-6be57623b9bf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:11.154730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ebca37d1-9941-485c-b21a-6be57623b9bf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1290 microversion: 2.1 time: 0.107539 Sep 13 20:00:11.155317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 117/256] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:11 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1290 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:11.198979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-80e6ed27-dd8a-464c-b3f3-113a4a244444 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:11.207519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-80e6ed27-dd8a-464c-b3f3-113a4a244444 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1504 microversion: 2.1 time: 0.254941 Sep 13 20:00:11.208107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 140/257] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:10 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:11.616535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-98b285b0-0452-4b9b-b66b-5e9332a99b12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:11.617638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-98b285b0-0452-4b9b-b66b-5e9332a99b12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:11.624567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98b285b0-0452-4b9b-b66b-5e9332a99b12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.625246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98b285b0-0452-4b9b-b66b-5e9332a99b12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.625683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98b285b0-0452-4b9b-b66b-5e9332a99b12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.626403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98b285b0-0452-4b9b-b66b-5e9332a99b12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.626856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98b285b0-0452-4b9b-b66b-5e9332a99b12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.627304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98b285b0-0452-4b9b-b66b-5e9332a99b12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.781807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-98b285b0-0452-4b9b-b66b-5e9332a99b12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:11.790185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-98b285b0-0452-4b9b-b66b-5e9332a99b12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1501 microversion: 2.1 time: 0.182557 Sep 13 20:00:11.790770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 118/258] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:11 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:11.813160 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-80238c5a-83f8-4d44-afda-6aa81c1d8f60 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:11.813773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-80238c5a-83f8-4d44-afda-6aa81c1d8f60 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:11.820328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80238c5a-83f8-4d44-afda-6aa81c1d8f60 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.820820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80238c5a-83f8-4d44-afda-6aa81c1d8f60 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.821254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80238c5a-83f8-4d44-afda-6aa81c1d8f60 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.821954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80238c5a-83f8-4d44-afda-6aa81c1d8f60 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.822430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80238c5a-83f8-4d44-afda-6aa81c1d8f60 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.822850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80238c5a-83f8-4d44-afda-6aa81c1d8f60 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.009103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-80238c5a-83f8-4d44-afda-6aa81c1d8f60 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:12.026694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-80238c5a-83f8-4d44-afda-6aa81c1d8f60 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1515 microversion: 2.1 time: 0.217033 Sep 13 20:00:12.029259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 141/259] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:11 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:12.179192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2075dcc7-3d17-4d5c-ae60-313bd5d477c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:12.181167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2075dcc7-3d17-4d5c-ae60-313bd5d477c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:12.188632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2075dcc7-3d17-4d5c-ae60-313bd5d477c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:12.189120 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2075dcc7-3d17-4d5c-ae60-313bd5d477c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:12.189600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2075dcc7-3d17-4d5c-ae60-313bd5d477c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.190719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2075dcc7-3d17-4d5c-ae60-313bd5d477c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:12.191354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2075dcc7-3d17-4d5c-ae60-313bd5d477c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:12.191922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2075dcc7-3d17-4d5c-ae60-313bd5d477c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.245768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9bdff5c7-1d37-4870-869e-9914b5d16fdb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:12.246551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9bdff5c7-1d37-4870-869e-9914b5d16fdb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:12.259446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9bdff5c7-1d37-4870-869e-9914b5d16fdb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:12.261199 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9bdff5c7-1d37-4870-869e-9914b5d16fdb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:12.261680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9bdff5c7-1d37-4870-869e-9914b5d16fdb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.263150 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9bdff5c7-1d37-4870-869e-9914b5d16fdb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:12.263845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9bdff5c7-1d37-4870-869e-9914b5d16fdb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:12.264327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9bdff5c7-1d37-4870-869e-9914b5d16fdb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.325510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2075dcc7-3d17-4d5c-ae60-313bd5d477c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:12.328403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:12.356724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2075dcc7-3d17-4d5c-ae60-313bd5d477c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1308 microversion: 2.1 time: 0.182312 Sep 13 20:00:12.357757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 119/260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:12 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:12.607993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9bdff5c7-1d37-4870-869e-9914b5d16fdb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:12.622772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9bdff5c7-1d37-4870-869e-9914b5d16fdb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1504 microversion: 2.1 time: 0.383062 Sep 13 20:00:12.623736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 142/261] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:12 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1504 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:13.313232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-86729b49-ab6e-4f8e-aae4-eca785472b31 req-d1c07502-fd2a-4b93-b2c4-9745741864eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19", "name": "network-vif-deleted", "tag": "0fe03322-5617-4899-bcc3-1784fa57edc8"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:13.338228 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-86729b49-ab6e-4f8e-aae4-eca785472b31 req-d1c07502-fd2a-4b93-b2c4-9745741864eb service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.340935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-86729b49-ab6e-4f8e-aae4-eca785472b31 req-d1c07502-fd2a-4b93-b2c4-9745741864eb service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.343424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-86729b49-ab6e-4f8e-aae4-eca785472b31 req-d1c07502-fd2a-4b93-b2c4-9745741864eb service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.364507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-86729b49-ab6e-4f8e-aae4-eca785472b31 req-d1c07502-fd2a-4b93-b2c4-9745741864eb service nova] Creating event network-vif-deleted:0fe03322-5617-4899-bcc3-1784fa57edc8 for instance 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 on hv-cinder-85427 Sep 13 20:00:13.370205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-86729b49-ab6e-4f8e-aae4-eca785472b31 req-d1c07502-fd2a-4b93-b2c4-9745741864eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070990 Sep 13 20:00:13.371193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 120/262] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:13.384622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b7e62a7d-cebc-46cb-8931-a3767c0a63e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:13.385805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b7e62a7d-cebc-46cb-8931-a3767c0a63e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:13.404066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7e62a7d-cebc-46cb-8931-a3767c0a63e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.404967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7e62a7d-cebc-46cb-8931-a3767c0a63e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.405875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7e62a7d-cebc-46cb-8931-a3767c0a63e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.406996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7e62a7d-cebc-46cb-8931-a3767c0a63e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.408599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7e62a7d-cebc-46cb-8931-a3767c0a63e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.409260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7e62a7d-cebc-46cb-8931-a3767c0a63e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.490763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b7e62a7d-cebc-46cb-8931-a3767c0a63e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:13.509681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b7e62a7d-cebc-46cb-8931-a3767c0a63e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1296 microversion: 2.1 time: 0.130442 Sep 13 20:00:13.510757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 143/263] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1296 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:13.659695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:13.660520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:13.673082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.673576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.673980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.692380 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.697001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.697883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.755131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.758575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.759157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.761234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.objects.instance [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lazy-loading 'fault' on Instance uuid 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 {{(pid=120845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:00:13.779606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-53d12834-c01a-4b05-a109-e61662ffe912 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:13.782101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-53d12834-c01a-4b05-a109-e61662ffe912 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:13.811539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53d12834-c01a-4b05-a109-e61662ffe912 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.814765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53d12834-c01a-4b05-a109-e61662ffe912 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.816173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53d12834-c01a-4b05-a109-e61662ffe912 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.819361 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53d12834-c01a-4b05-a109-e61662ffe912 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.821575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53d12834-c01a-4b05-a109-e61662ffe912 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.822494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53d12834-c01a-4b05-a109-e61662ffe912 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.877596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:13.884435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:13.897657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-53d12834-c01a-4b05-a109-e61662ffe912 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lazy-loading 'flavor' on Instance uuid 1188b80c-75f7-4d0e-a43b-4f1285e63a69 {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:00:13.905896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-21529928-6337-4eb1-8670-af50885d884e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 200 len: 1304 microversion: 2.1 time: 0.251897 Sep 13 20:00:13.907948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 121/264] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:13 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 1304 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:14.069748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-53d12834-c01a-4b05-a109-e61662ffe912 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "POST /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69/action" status: 200 len: 32 microversion: 2.1 time: 0.294983 Sep 13 20:00:14.082579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 144/265] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 13 20:00:13 2022] POST /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69/action => generated 32 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 20:00:14.086353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-985819cb-f77a-422f-894e-9e60f52cd5a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:14.086997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-985819cb-f77a-422f-894e-9e60f52cd5a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:14.101973 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-985819cb-f77a-422f-894e-9e60f52cd5a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.102545 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-985819cb-f77a-422f-894e-9e60f52cd5a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.114655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-985819cb-f77a-422f-894e-9e60f52cd5a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.115717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-985819cb-f77a-422f-894e-9e60f52cd5a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.116197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-985819cb-f77a-422f-894e-9e60f52cd5a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.116620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-985819cb-f77a-422f-894e-9e60f52cd5a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.416602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-985819cb-f77a-422f-894e-9e60f52cd5a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:14.426386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-985819cb-f77a-422f-894e-9e60f52cd5a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.343896 Sep 13 20:00:14.427028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 122/266] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:14 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:14.540696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-76c4864e-0162-456c-87e9-6521c5265e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:14.542512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-76c4864e-0162-456c-87e9-6521c5265e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:14.553387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76c4864e-0162-456c-87e9-6521c5265e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.554790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76c4864e-0162-456c-87e9-6521c5265e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.556217 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76c4864e-0162-456c-87e9-6521c5265e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.557840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76c4864e-0162-456c-87e9-6521c5265e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.558660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76c4864e-0162-456c-87e9-6521c5265e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.559335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76c4864e-0162-456c-87e9-6521c5265e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.766218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-76c4864e-0162-456c-87e9-6521c5265e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:14.777737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-76c4864e-0162-456c-87e9-6521c5265e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.244805 Sep 13 20:00:14.795087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 145/267] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:14 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:14.934205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8211a1f8-e7f2-43e5-b308-18d907828624 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:14.934833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8211a1f8-e7f2-43e5-b308-18d907828624 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:14.941310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8211a1f8-e7f2-43e5-b308-18d907828624 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.942042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8211a1f8-e7f2-43e5-b308-18d907828624 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.942682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8211a1f8-e7f2-43e5-b308-18d907828624 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.943546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8211a1f8-e7f2-43e5-b308-18d907828624 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.944200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8211a1f8-e7f2-43e5-b308-18d907828624 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.944771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8211a1f8-e7f2-43e5-b308-18d907828624 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.964500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-8211a1f8-e7f2-43e5-b308-18d907828624 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] HTTP exception thrown: Instance 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 could not be found. Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8211a1f8-e7f2-43e5-b308-18d907828624 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Request method failure captured: Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 HTTP/1.1 Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOEohyHLfPP6O0c95hLUCucf2y0n-jOjeSY33-Cokjo4LF77zsheZh3n28MbEoByY2aYdU2kQLdd9PX8Nx-pIHLFKH0m_rjEjP1hE0VtOcRHXk5F3S7Abh29wqtrqLw1IZjnT0YK5srehHhIAtqOHF_0xE4j52Wm_3nfh_VDO-TLMLw Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: a747512840e14dfca8bf507e70623fa5 Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-VolumesActionsTest-2143939136 Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:00:14.966505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:00:14.967951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a747512840e14dfca8bf507e70623fa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a747512840e14dfca8bf507e70623fa5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a747512840e14dfca8bf507e70623fa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a747512840e14dfca8bf507e70623fa5"}]}] Sep 13 20:00:14.967951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-VolumesActionsTest-2143939136 Sep 13 20:00:14.967951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: a747512840e14dfca8bf507e70623fa5 Sep 13 20:00:14.967951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-VolumesActionsTest-2143939136 Sep 13 20:00:14.967951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-VolumesActionsTest-2143939136-project Sep 13 20:00:14.967951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:00:14.967951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:00:14.967951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: b5b22eed68ce4d879de69b94084f1fb8 Sep 13 20:00:14.967951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-VolumesActionsTest-2143939136-project Sep 13 20:00:14.967951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:00:14.967951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 could not be found. Sep 13 20:00:14.967951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19'} Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 could not be found. Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:00:14.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 could not be found. Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 could not be found. Sep 13 20:00:14.970254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:00:14.972773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8211a1f8-e7f2-43e5-b308-18d907828624 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Returning 404 to user: Instance 2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:00:14.973645 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8211a1f8-e7f2-43e5-b308-18d907828624 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19" status: 404 len: 111 microversion: 2.1 time: 0.043409 Sep 13 20:00:14.974558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 123/268] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:14 2022] GET /compute/v2.1/servers/2f4b5a6d-e1bf-4c05-b285-bebb8d7d1b19 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:00:15.140460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1485147166", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "networks": [{"uuid": "0461f2fa-45b5-48b5-aa22-82ba55bd2663"}]}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:15.451826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d1374acd-dbe8-4d24-b891-09b19ac56034 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:15.452623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d1374acd-dbe8-4d24-b891-09b19ac56034 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:15.464469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1374acd-dbe8-4d24-b891-09b19ac56034 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:15.465747 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1374acd-dbe8-4d24-b891-09b19ac56034 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:15.465896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1374acd-dbe8-4d24-b891-09b19ac56034 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:15.466765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1374acd-dbe8-4d24-b891-09b19ac56034 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:15.467431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1374acd-dbe8-4d24-b891-09b19ac56034 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:15.467431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1374acd-dbe8-4d24-b891-09b19ac56034 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:15.868166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1374acd-dbe8-4d24-b891-09b19ac56034 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:15.878620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d1374acd-dbe8-4d24-b891-09b19ac56034 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.430551 Sep 13 20:00:15.879308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 124/269] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:15 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:15.884646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-0aca988a-7e68-4013-81e1-0f9f299bf26b req-4b4c71c9-aac2-488c-966e-a7d08c0b2c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6c34670-16a4-4b3b-9a8d-1d77974d355e", "tag": "7a33c927-0f1f-4566-9bf6-1b28ad675d14"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:15.906178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0aca988a-7e68-4013-81e1-0f9f299bf26b req-4b4c71c9-aac2-488c-966e-a7d08c0b2c71 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:15.906178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0aca988a-7e68-4013-81e1-0f9f299bf26b req-4b4c71c9-aac2-488c-966e-a7d08c0b2c71 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:15.906178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0aca988a-7e68-4013-81e1-0f9f299bf26b req-4b4c71c9-aac2-488c-966e-a7d08c0b2c71 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:15.913057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-0aca988a-7e68-4013-81e1-0f9f299bf26b req-4b4c71c9-aac2-488c-966e-a7d08c0b2c71 service nova] Creating event network-changed:7a33c927-0f1f-4566-9bf6-1b28ad675d14 for instance b6c34670-16a4-4b3b-9a8d-1d77974d355e on hv-cinder-85427 Sep 13 20:00:15.918105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-0aca988a-7e68-4013-81e1-0f9f299bf26b req-4b4c71c9-aac2-488c-966e-a7d08c0b2c71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037383 Sep 13 20:00:15.918770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 125/270] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:15.924445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-579fc1e1-6e29-4cd7-9dce-546700b4819b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:15.925179 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-579fc1e1-6e29-4cd7-9dce-546700b4819b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:15.931993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-579fc1e1-6e29-4cd7-9dce-546700b4819b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:15.932476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-579fc1e1-6e29-4cd7-9dce-546700b4819b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:15.932908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-579fc1e1-6e29-4cd7-9dce-546700b4819b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:15.933600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-579fc1e1-6e29-4cd7-9dce-546700b4819b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:15.934209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-579fc1e1-6e29-4cd7-9dce-546700b4819b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:15.934834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-579fc1e1-6e29-4cd7-9dce-546700b4819b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:16.208239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-579fc1e1-6e29-4cd7-9dce-546700b4819b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:16.219520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-579fc1e1-6e29-4cd7-9dce-546700b4819b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.299368 Sep 13 20:00:16.220653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 126/271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:16.586189 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:16.904113 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1018bf66-7248-474c-887a-97b1658f1050 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:16.904979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1018bf66-7248-474c-887a-97b1658f1050 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:16.910426 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:16.911416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=6 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:16.914067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1018bf66-7248-474c-887a-97b1658f1050 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:16.914746 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1018bf66-7248-474c-887a-97b1658f1050 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:16.915232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1018bf66-7248-474c-887a-97b1658f1050 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:16.915924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1018bf66-7248-474c-887a-97b1658f1050 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:16.916563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1018bf66-7248-474c-887a-97b1658f1050 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:16.916979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1018bf66-7248-474c-887a-97b1658f1050 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:17.047571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.network.neutron [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] validate_networks() for [('0461f2fa-45b5-48b5-aa22-82ba55bd2663', None, None, None, None, None)] {{(pid=120844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:00:17.077978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1018bf66-7248-474c-887a-97b1658f1050 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:17.086399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1018bf66-7248-474c-887a-97b1658f1050 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.186130 Sep 13 20:00:17.087020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 127/272] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:16 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:17.244976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e8c4735e-da11-45d3-bf02-8a4bb21540be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:17.245852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e8c4735e-da11-45d3-bf02-8a4bb21540be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:17.253444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8c4735e-da11-45d3-bf02-8a4bb21540be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:17.254456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8c4735e-da11-45d3-bf02-8a4bb21540be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:17.255136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8c4735e-da11-45d3-bf02-8a4bb21540be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:17.256187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8c4735e-da11-45d3-bf02-8a4bb21540be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:17.256877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8c4735e-da11-45d3-bf02-8a4bb21540be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:17.257507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8c4735e-da11-45d3-bf02-8a4bb21540be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:17.451484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e8c4735e-da11-45d3-bf02-8a4bb21540be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:17.460043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e8c4735e-da11-45d3-bf02-8a4bb21540be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.220519 Sep 13 20:00:17.460870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 128/273] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:17 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:17.553869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Flavor limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:00:17.554286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Image limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:00:17.554850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Flavor pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:00:17.555253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Image pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:00:17.555793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:00:17.571188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:17.572605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:17.573038 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:17.573767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:17.574228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:17.574668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:17.594944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Getting quotas for project a747512840e14dfca8bf507e70623fa5. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:00:17.599333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Getting quotas for user b5b22eed68ce4d879de69b94084f1fb8 and project a747512840e14dfca8bf507e70623fa5. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:00:17.641534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Going to run 1 instances... {{(pid=120844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:00:17.643996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:00:17.696359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3820e7be-6e74-4917-933f-eb15da13f062 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.560660 Sep 13 20:00:17.697234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 146/274] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:00:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:00:17.709127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-580afa6a-2fb9-4485-87cb-aab485a633fb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:17.709736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-580afa6a-2fb9-4485-87cb-aab485a633fb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:17.783814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-580afa6a-2fb9-4485-87cb-aab485a633fb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:17.791523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-580afa6a-2fb9-4485-87cb-aab485a633fb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1214 microversion: 2.1 time: 0.086433 Sep 13 20:00:17.793761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 129/275] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:17 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:18.109541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-36370400-f869-4bd8-a816-8320d8ae16f3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:18.110557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-36370400-f869-4bd8-a816-8320d8ae16f3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:18.117985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36370400-f869-4bd8-a816-8320d8ae16f3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:18.118501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36370400-f869-4bd8-a816-8320d8ae16f3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:18.118924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36370400-f869-4bd8-a816-8320d8ae16f3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:18.119869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36370400-f869-4bd8-a816-8320d8ae16f3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:18.120390 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36370400-f869-4bd8-a816-8320d8ae16f3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:18.120872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36370400-f869-4bd8-a816-8320d8ae16f3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:18.297923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-36370400-f869-4bd8-a816-8320d8ae16f3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:18.306485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-36370400-f869-4bd8-a816-8320d8ae16f3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.201009 Sep 13 20:00:18.307050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 147/276] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:18 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:18.487673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-aef1646e-336f-4877-a12a-f1c72182d2ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:18.488391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-aef1646e-336f-4877-a12a-f1c72182d2ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:18.494686 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aef1646e-336f-4877-a12a-f1c72182d2ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:18.495258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aef1646e-336f-4877-a12a-f1c72182d2ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:18.495776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aef1646e-336f-4877-a12a-f1c72182d2ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:18.496554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aef1646e-336f-4877-a12a-f1c72182d2ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:18.497091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aef1646e-336f-4877-a12a-f1c72182d2ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:18.497580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aef1646e-336f-4877-a12a-f1c72182d2ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:18.665266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-aef1646e-336f-4877-a12a-f1c72182d2ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:18.673135 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-aef1646e-336f-4877-a12a-f1c72182d2ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.189320 Sep 13 20:00:18.673691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 130/277] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:18.816947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-18f8ed83-725d-45bd-b03b-68e781272e52 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:18.817792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-18f8ed83-725d-45bd-b03b-68e781272e52 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:18.827139 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18f8ed83-725d-45bd-b03b-68e781272e52 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:18.827623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18f8ed83-725d-45bd-b03b-68e781272e52 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:18.828043 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18f8ed83-725d-45bd-b03b-68e781272e52 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:18.828873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18f8ed83-725d-45bd-b03b-68e781272e52 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:18.829319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18f8ed83-725d-45bd-b03b-68e781272e52 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:18.829729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18f8ed83-725d-45bd-b03b-68e781272e52 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:18.901438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-18f8ed83-725d-45bd-b03b-68e781272e52 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:18.909349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-18f8ed83-725d-45bd-b03b-68e781272e52 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1218 microversion: 2.1 time: 0.097274 Sep 13 20:00:18.909982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 148/278] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:18 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:19.329247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-725072d6-830a-4c82-a5d5-e2e87ca48dee tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:19.329898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-725072d6-830a-4c82-a5d5-e2e87ca48dee tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:19.336324 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-725072d6-830a-4c82-a5d5-e2e87ca48dee tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:19.336847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-725072d6-830a-4c82-a5d5-e2e87ca48dee tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:19.337500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-725072d6-830a-4c82-a5d5-e2e87ca48dee tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:19.338410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-725072d6-830a-4c82-a5d5-e2e87ca48dee tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:19.338957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-725072d6-830a-4c82-a5d5-e2e87ca48dee tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:19.339383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-725072d6-830a-4c82-a5d5-e2e87ca48dee tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:19.476074 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-725072d6-830a-4c82-a5d5-e2e87ca48dee tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:19.484543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-725072d6-830a-4c82-a5d5-e2e87ca48dee tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.159229 Sep 13 20:00:19.485104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 131/279] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:19 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:19.696040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c7e6f020-b37c-4df0-9b5e-5c9a246d957c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:19.696834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c7e6f020-b37c-4df0-9b5e-5c9a246d957c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:19.704326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c7e6f020-b37c-4df0-9b5e-5c9a246d957c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:19.704791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c7e6f020-b37c-4df0-9b5e-5c9a246d957c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:19.705412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c7e6f020-b37c-4df0-9b5e-5c9a246d957c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:19.706627 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c7e6f020-b37c-4df0-9b5e-5c9a246d957c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:19.707232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c7e6f020-b37c-4df0-9b5e-5c9a246d957c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:19.707805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c7e6f020-b37c-4df0-9b5e-5c9a246d957c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:19.845212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c7e6f020-b37c-4df0-9b5e-5c9a246d957c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:19.853506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c7e6f020-b37c-4df0-9b5e-5c9a246d957c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.161239 Sep 13 20:00:19.854167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 149/280] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:19.931771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-717ad666-55a9-43f7-b5d8-b2cf532397f6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:19.932546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-717ad666-55a9-43f7-b5d8-b2cf532397f6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:19.939894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-717ad666-55a9-43f7-b5d8-b2cf532397f6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:19.940065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-717ad666-55a9-43f7-b5d8-b2cf532397f6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:19.940397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-717ad666-55a9-43f7-b5d8-b2cf532397f6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:19.941092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-717ad666-55a9-43f7-b5d8-b2cf532397f6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:19.941565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-717ad666-55a9-43f7-b5d8-b2cf532397f6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:19.942032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-717ad666-55a9-43f7-b5d8-b2cf532397f6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:20.012458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-717ad666-55a9-43f7-b5d8-b2cf532397f6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:20.024663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-717ad666-55a9-43f7-b5d8-b2cf532397f6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1218 microversion: 2.1 time: 0.096197 Sep 13 20:00:20.025315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 132/281] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:19 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:20.508744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d0a81b60-a04d-4cde-bfc1-4271f76987be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:20.509342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d0a81b60-a04d-4cde-bfc1-4271f76987be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:20.516236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0a81b60-a04d-4cde-bfc1-4271f76987be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:20.516709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0a81b60-a04d-4cde-bfc1-4271f76987be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:20.517131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0a81b60-a04d-4cde-bfc1-4271f76987be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:20.517777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0a81b60-a04d-4cde-bfc1-4271f76987be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:20.518250 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0a81b60-a04d-4cde-bfc1-4271f76987be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:20.518693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0a81b60-a04d-4cde-bfc1-4271f76987be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:20.660867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d0a81b60-a04d-4cde-bfc1-4271f76987be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:20.668841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d0a81b60-a04d-4cde-bfc1-4271f76987be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.164067 Sep 13 20:00:20.669422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 150/282] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:20 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:20.878066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6465c7e9-98ca-4afa-a6bc-95f4b8169b53 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:20.878691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6465c7e9-98ca-4afa-a6bc-95f4b8169b53 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:20.885097 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6465c7e9-98ca-4afa-a6bc-95f4b8169b53 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:20.885575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6465c7e9-98ca-4afa-a6bc-95f4b8169b53 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:20.886000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6465c7e9-98ca-4afa-a6bc-95f4b8169b53 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:20.886723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6465c7e9-98ca-4afa-a6bc-95f4b8169b53 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:20.887163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6465c7e9-98ca-4afa-a6bc-95f4b8169b53 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:20.887580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6465c7e9-98ca-4afa-a6bc-95f4b8169b53 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.025563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6465c7e9-98ca-4afa-a6bc-95f4b8169b53 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:21.033661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6465c7e9-98ca-4afa-a6bc-95f4b8169b53 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.159624 Sep 13 20:00:21.034225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 133/283] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:21.047799 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-67ad15c8-dc91-4e62-960c-6200ce6e627e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:21.048517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-67ad15c8-dc91-4e62-960c-6200ce6e627e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:21.050927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:21.056876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67ad15c8-dc91-4e62-960c-6200ce6e627e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:21.057363 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67ad15c8-dc91-4e62-960c-6200ce6e627e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:21.057795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67ad15c8-dc91-4e62-960c-6200ce6e627e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.058573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67ad15c8-dc91-4e62-960c-6200ce6e627e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:21.059028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67ad15c8-dc91-4e62-960c-6200ce6e627e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:21.059451 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67ad15c8-dc91-4e62-960c-6200ce6e627e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.124325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-67ad15c8-dc91-4e62-960c-6200ce6e627e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:21.132456 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-67ad15c8-dc91-4e62-960c-6200ce6e627e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1218 microversion: 2.1 time: 0.088596 Sep 13 20:00:21.133132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 151/284] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:21 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:21.692395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-35e66da2-75c0-4ad6-ab56-9ea91d7aecaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:21.693654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-35e66da2-75c0-4ad6-ab56-9ea91d7aecaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:21.700427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35e66da2-75c0-4ad6-ab56-9ea91d7aecaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:21.700913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35e66da2-75c0-4ad6-ab56-9ea91d7aecaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:21.701343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35e66da2-75c0-4ad6-ab56-9ea91d7aecaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.702042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35e66da2-75c0-4ad6-ab56-9ea91d7aecaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:21.702502 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35e66da2-75c0-4ad6-ab56-9ea91d7aecaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:21.702923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35e66da2-75c0-4ad6-ab56-9ea91d7aecaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.856172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-35e66da2-75c0-4ad6-ab56-9ea91d7aecaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:21.864803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-35e66da2-75c0-4ad6-ab56-9ea91d7aecaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.176311 Sep 13 20:00:21.865370 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 134/285] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:21 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:22.057234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-93f1e204-dfd7-454b-8358-4223d6443f8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:22.057979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-93f1e204-dfd7-454b-8358-4223d6443f8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:22.067154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93f1e204-dfd7-454b-8358-4223d6443f8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.067885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93f1e204-dfd7-454b-8358-4223d6443f8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.068628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93f1e204-dfd7-454b-8358-4223d6443f8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.069793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93f1e204-dfd7-454b-8358-4223d6443f8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.070393 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93f1e204-dfd7-454b-8358-4223d6443f8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.070822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93f1e204-dfd7-454b-8358-4223d6443f8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.155744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-33371faf-bb0d-4eb6-aabf-b063c5d9f9ef tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:22.156931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-33371faf-bb0d-4eb6-aabf-b063c5d9f9ef tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:22.162430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:22.181748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33371faf-bb0d-4eb6-aabf-b063c5d9f9ef tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.186948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33371faf-bb0d-4eb6-aabf-b063c5d9f9ef tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.190198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33371faf-bb0d-4eb6-aabf-b063c5d9f9ef tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.191187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33371faf-bb0d-4eb6-aabf-b063c5d9f9ef tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.194017 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33371faf-bb0d-4eb6-aabf-b063c5d9f9ef tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.196747 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33371faf-bb0d-4eb6-aabf-b063c5d9f9ef tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.294722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-33371faf-bb0d-4eb6-aabf-b063c5d9f9ef tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:22.304878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-33371faf-bb0d-4eb6-aabf-b063c5d9f9ef tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1266 microversion: 2.1 time: 0.153517 Sep 13 20:00:22.306388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 135/286] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:22 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:22.331503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-93f1e204-dfd7-454b-8358-4223d6443f8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:22.340625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-93f1e204-dfd7-454b-8358-4223d6443f8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.288657 Sep 13 20:00:22.341196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 152/287] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:22.887997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3d42534b-c606-4d87-ac83-98fcf202e5c9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:22.888629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3d42534b-c606-4d87-ac83-98fcf202e5c9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:22.894921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3d42534b-c606-4d87-ac83-98fcf202e5c9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.895396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3d42534b-c606-4d87-ac83-98fcf202e5c9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.895829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3d42534b-c606-4d87-ac83-98fcf202e5c9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.896515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3d42534b-c606-4d87-ac83-98fcf202e5c9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.897021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3d42534b-c606-4d87-ac83-98fcf202e5c9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.897362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3d42534b-c606-4d87-ac83-98fcf202e5c9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:23.046606 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3d42534b-c606-4d87-ac83-98fcf202e5c9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:23.054433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3d42534b-c606-4d87-ac83-98fcf202e5c9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.170662 Sep 13 20:00:23.055021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 136/288] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:22 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:23.338229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e6a491c5-abc7-4016-a87a-13b71e0985c4 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:23.338867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e6a491c5-abc7-4016-a87a-13b71e0985c4 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:23.345849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6a491c5-abc7-4016-a87a-13b71e0985c4 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:23.346402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6a491c5-abc7-4016-a87a-13b71e0985c4 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:23.346822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6a491c5-abc7-4016-a87a-13b71e0985c4 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:23.347491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6a491c5-abc7-4016-a87a-13b71e0985c4 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:23.347938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6a491c5-abc7-4016-a87a-13b71e0985c4 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:23.348353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6a491c5-abc7-4016-a87a-13b71e0985c4 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:23.363801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-63cb34b8-4196-41f8-b64d-e97fc50e9cb2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:23.364407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-63cb34b8-4196-41f8-b64d-e97fc50e9cb2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:23.371600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-63cb34b8-4196-41f8-b64d-e97fc50e9cb2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:23.371926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-63cb34b8-4196-41f8-b64d-e97fc50e9cb2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:23.372589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-63cb34b8-4196-41f8-b64d-e97fc50e9cb2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:23.373311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-63cb34b8-4196-41f8-b64d-e97fc50e9cb2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:23.373750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-63cb34b8-4196-41f8-b64d-e97fc50e9cb2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:23.374163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-63cb34b8-4196-41f8-b64d-e97fc50e9cb2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:23.413698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e6a491c5-abc7-4016-a87a-13b71e0985c4 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:23.421709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e6a491c5-abc7-4016-a87a-13b71e0985c4 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1266 microversion: 2.1 time: 0.087829 Sep 13 20:00:23.422287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 153/289] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:23 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:23.514880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-63cb34b8-4196-41f8-b64d-e97fc50e9cb2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:23.524082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-63cb34b8-4196-41f8-b64d-e97fc50e9cb2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.164375 Sep 13 20:00:23.524688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 137/290] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:24.080706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3e6b65f6-5bd2-4f47-8c5a-977cee774263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:24.081407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3e6b65f6-5bd2-4f47-8c5a-977cee774263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:24.088347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e6b65f6-5bd2-4f47-8c5a-977cee774263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:24.088844 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e6b65f6-5bd2-4f47-8c5a-977cee774263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:24.089276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e6b65f6-5bd2-4f47-8c5a-977cee774263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:24.089992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e6b65f6-5bd2-4f47-8c5a-977cee774263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:24.090438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e6b65f6-5bd2-4f47-8c5a-977cee774263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:24.090882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e6b65f6-5bd2-4f47-8c5a-977cee774263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:24.232675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3e6b65f6-5bd2-4f47-8c5a-977cee774263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:24.241339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3e6b65f6-5bd2-4f47-8c5a-977cee774263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.166586 Sep 13 20:00:24.241924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 154/291] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:24 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:24.444941 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1cd870b9-9bc9-453f-abe4-057c99059bdd tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:24.445613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1cd870b9-9bc9-453f-abe4-057c99059bdd tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:24.452051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1cd870b9-9bc9-453f-abe4-057c99059bdd tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:24.452527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1cd870b9-9bc9-453f-abe4-057c99059bdd tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:24.453071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1cd870b9-9bc9-453f-abe4-057c99059bdd tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:24.453821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1cd870b9-9bc9-453f-abe4-057c99059bdd tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:24.454288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1cd870b9-9bc9-453f-abe4-057c99059bdd tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:24.454715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1cd870b9-9bc9-453f-abe4-057c99059bdd tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:24.533608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1cd870b9-9bc9-453f-abe4-057c99059bdd tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:24.541974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1cd870b9-9bc9-453f-abe4-057c99059bdd tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1266 microversion: 2.1 time: 0.100852 Sep 13 20:00:24.543185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 138/292] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:24 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:24.555499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-780f11d9-0bda-4e25-b38f-a57af0ebdb67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:24.556466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-780f11d9-0bda-4e25-b38f-a57af0ebdb67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:24.563567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-780f11d9-0bda-4e25-b38f-a57af0ebdb67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:24.564301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-780f11d9-0bda-4e25-b38f-a57af0ebdb67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:24.564777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-780f11d9-0bda-4e25-b38f-a57af0ebdb67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:24.565480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-780f11d9-0bda-4e25-b38f-a57af0ebdb67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:24.565929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-780f11d9-0bda-4e25-b38f-a57af0ebdb67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:24.566349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-780f11d9-0bda-4e25-b38f-a57af0ebdb67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:24.716963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-780f11d9-0bda-4e25-b38f-a57af0ebdb67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:24.726078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-780f11d9-0bda-4e25-b38f-a57af0ebdb67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.175042 Sep 13 20:00:24.726668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 155/293] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:24 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:25.266540 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ef61f1b2-aed1-43ab-b2e8-005a15871790 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:25.267575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ef61f1b2-aed1-43ab-b2e8-005a15871790 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:25.276361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef61f1b2-aed1-43ab-b2e8-005a15871790 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.276834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef61f1b2-aed1-43ab-b2e8-005a15871790 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.277273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef61f1b2-aed1-43ab-b2e8-005a15871790 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.278043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef61f1b2-aed1-43ab-b2e8-005a15871790 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.278565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef61f1b2-aed1-43ab-b2e8-005a15871790 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.279069 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef61f1b2-aed1-43ab-b2e8-005a15871790 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.282078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:25.426776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ef61f1b2-aed1-43ab-b2e8-005a15871790 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:25.435082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ef61f1b2-aed1-43ab-b2e8-005a15871790 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.173710 Sep 13 20:00:25.435539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 139/294] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:25 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:25.565869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-96744e39-e64e-41a4-bda2-ac9531ee34e6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:25.566587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-96744e39-e64e-41a4-bda2-ac9531ee34e6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:25.573394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96744e39-e64e-41a4-bda2-ac9531ee34e6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.573889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96744e39-e64e-41a4-bda2-ac9531ee34e6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.574305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96744e39-e64e-41a4-bda2-ac9531ee34e6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.575050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96744e39-e64e-41a4-bda2-ac9531ee34e6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.575900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96744e39-e64e-41a4-bda2-ac9531ee34e6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.575900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96744e39-e64e-41a4-bda2-ac9531ee34e6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.643610 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-96744e39-e64e-41a4-bda2-ac9531ee34e6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:25.655472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-96744e39-e64e-41a4-bda2-ac9531ee34e6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1266 microversion: 2.1 time: 0.093768 Sep 13 20:00:25.656309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 156/295] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:25 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:25.756540 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-eb64b684-ec63-42a8-be96-b2434fdc64d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:25.757113 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-eb64b684-ec63-42a8-be96-b2434fdc64d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:25.765873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb64b684-ec63-42a8-be96-b2434fdc64d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.766460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb64b684-ec63-42a8-be96-b2434fdc64d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.767112 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb64b684-ec63-42a8-be96-b2434fdc64d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.767800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb64b684-ec63-42a8-be96-b2434fdc64d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.768225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb64b684-ec63-42a8-be96-b2434fdc64d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.768789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb64b684-ec63-42a8-be96-b2434fdc64d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.924481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eb64b684-ec63-42a8-be96-b2434fdc64d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:25.932722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-eb64b684-ec63-42a8-be96-b2434fdc64d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.182214 Sep 13 20:00:25.933311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 140/296] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:26.458124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f1498dac-1dab-479e-8a4b-8a788d3ca46e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:26.458852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f1498dac-1dab-479e-8a4b-8a788d3ca46e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:26.465753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1498dac-1dab-479e-8a4b-8a788d3ca46e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.466241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1498dac-1dab-479e-8a4b-8a788d3ca46e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.467626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1498dac-1dab-479e-8a4b-8a788d3ca46e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.468440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1498dac-1dab-479e-8a4b-8a788d3ca46e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.468915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1498dac-1dab-479e-8a4b-8a788d3ca46e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.469690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1498dac-1dab-479e-8a4b-8a788d3ca46e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.618434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f1498dac-1dab-479e-8a4b-8a788d3ca46e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:26.652075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f1498dac-1dab-479e-8a4b-8a788d3ca46e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.197822 Sep 13 20:00:26.652660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 157/297] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:26 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:26.684349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3c3dc839-27b7-4433-aae6-92373454998f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:26.684967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3c3dc839-27b7-4433-aae6-92373454998f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:26.698725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c3dc839-27b7-4433-aae6-92373454998f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.699652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c3dc839-27b7-4433-aae6-92373454998f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.700137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c3dc839-27b7-4433-aae6-92373454998f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.700839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c3dc839-27b7-4433-aae6-92373454998f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.702426 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c3dc839-27b7-4433-aae6-92373454998f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.702426 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c3dc839-27b7-4433-aae6-92373454998f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.803691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3c3dc839-27b7-4433-aae6-92373454998f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:26.816503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3c3dc839-27b7-4433-aae6-92373454998f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1272 microversion: 2.1 time: 0.135933 Sep 13 20:00:26.817134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 141/298] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:26 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:26.939516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-928f0b07-8f82-4b1f-8660-b510159bf878 req-4e2b4d4c-de00-4b1e-a811-9e6f55153d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6c34670-16a4-4b3b-9a8d-1d77974d355e", "name": "network-vif-plugged", "status": "completed", "tag": "7a33c927-0f1f-4566-9bf6-1b28ad675d14"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:26.954933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-928f0b07-8f82-4b1f-8660-b510159bf878 req-4e2b4d4c-de00-4b1e-a811-9e6f55153d5f service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.955524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-928f0b07-8f82-4b1f-8660-b510159bf878 req-4e2b4d4c-de00-4b1e-a811-9e6f55153d5f service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.956021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-928f0b07-8f82-4b1f-8660-b510159bf878 req-4e2b4d4c-de00-4b1e-a811-9e6f55153d5f service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.959252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-36c3870c-4b6f-4396-b54c-0764101fa24c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:26.960233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-36c3870c-4b6f-4396-b54c-0764101fa24c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:26.967550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36c3870c-4b6f-4396-b54c-0764101fa24c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.968386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36c3870c-4b6f-4396-b54c-0764101fa24c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.969034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36c3870c-4b6f-4396-b54c-0764101fa24c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.970288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36c3870c-4b6f-4396-b54c-0764101fa24c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.970958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36c3870c-4b6f-4396-b54c-0764101fa24c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.971794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36c3870c-4b6f-4396-b54c-0764101fa24c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.975746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-928f0b07-8f82-4b1f-8660-b510159bf878 req-4e2b4d4c-de00-4b1e-a811-9e6f55153d5f service nova] Creating event network-vif-plugged:7a33c927-0f1f-4566-9bf6-1b28ad675d14 for instance b6c34670-16a4-4b3b-9a8d-1d77974d355e on hv-cinder-85427 Sep 13 20:00:26.984064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-928f0b07-8f82-4b1f-8660-b510159bf878 req-4e2b4d4c-de00-4b1e-a811-9e6f55153d5f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049695 Sep 13 20:00:26.984687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 158/299] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:27.362205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-36c3870c-4b6f-4396-b54c-0764101fa24c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:27.375169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-36c3870c-4b6f-4396-b54c-0764101fa24c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.421289 Sep 13 20:00:27.375847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 142/300] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:27.675769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:27.676493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=6 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:27.681591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b7ea5b52-93bd-463f-86ce-f34c3353a6ad tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:27.682299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b7ea5b52-93bd-463f-86ce-f34c3353a6ad tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:27.689853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7ea5b52-93bd-463f-86ce-f34c3353a6ad tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.690841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7ea5b52-93bd-463f-86ce-f34c3353a6ad tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.691276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7ea5b52-93bd-463f-86ce-f34c3353a6ad tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.691981 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7ea5b52-93bd-463f-86ce-f34c3353a6ad tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.692436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7ea5b52-93bd-463f-86ce-f34c3353a6ad tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.693055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7ea5b52-93bd-463f-86ce-f34c3353a6ad tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.843999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0f8e9c94-d939-467c-ad83-475c70e35e7a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:27.845636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0f8e9c94-d939-467c-ad83-475c70e35e7a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:27.849696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b7ea5b52-93bd-463f-86ce-f34c3353a6ad tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:27.853020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:27.854991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f8e9c94-d939-467c-ad83-475c70e35e7a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.855738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f8e9c94-d939-467c-ad83-475c70e35e7a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.856525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f8e9c94-d939-467c-ad83-475c70e35e7a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.857549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f8e9c94-d939-467c-ad83-475c70e35e7a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.857985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f8e9c94-d939-467c-ad83-475c70e35e7a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.858634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f8e9c94-d939-467c-ad83-475c70e35e7a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.860845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b7ea5b52-93bd-463f-86ce-f34c3353a6ad tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.186597 Sep 13 20:00:27.862348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 159/301] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:27 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:28.124392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0f8e9c94-d939-467c-ad83-475c70e35e7a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:28.136158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0f8e9c94-d939-467c-ad83-475c70e35e7a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.299953 Sep 13 20:00:28.138484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 143/302] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:27 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:28.403332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8dfea963-79d9-4390-8fa4-da62d750501b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:28.404004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8dfea963-79d9-4390-8fa4-da62d750501b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:28.411559 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8dfea963-79d9-4390-8fa4-da62d750501b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.412007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8dfea963-79d9-4390-8fa4-da62d750501b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.412491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8dfea963-79d9-4390-8fa4-da62d750501b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.413186 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8dfea963-79d9-4390-8fa4-da62d750501b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.413628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8dfea963-79d9-4390-8fa4-da62d750501b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.414141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8dfea963-79d9-4390-8fa4-da62d750501b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.433723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:28.589421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8dfea963-79d9-4390-8fa4-da62d750501b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:28.597580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8dfea963-79d9-4390-8fa4-da62d750501b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.198873 Sep 13 20:00:28.598094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 160/303] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:28.885744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d0c9ab87-026e-4171-bd5e-57118af09418 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:28.886619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d0c9ab87-026e-4171-bd5e-57118af09418 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:28.900961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0c9ab87-026e-4171-bd5e-57118af09418 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.901720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0c9ab87-026e-4171-bd5e-57118af09418 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.902249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0c9ab87-026e-4171-bd5e-57118af09418 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.903088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0c9ab87-026e-4171-bd5e-57118af09418 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.918768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0c9ab87-026e-4171-bd5e-57118af09418 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.920628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0c9ab87-026e-4171-bd5e-57118af09418 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:29.161155 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-77fc3a43-a385-40db-a966-28110fa941d3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:29.161900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-77fc3a43-a385-40db-a966-28110fa941d3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:29.174278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77fc3a43-a385-40db-a966-28110fa941d3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:29.174978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77fc3a43-a385-40db-a966-28110fa941d3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:29.175419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77fc3a43-a385-40db-a966-28110fa941d3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:29.176196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77fc3a43-a385-40db-a966-28110fa941d3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:29.176712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77fc3a43-a385-40db-a966-28110fa941d3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:29.177247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77fc3a43-a385-40db-a966-28110fa941d3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:29.188943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d0c9ab87-026e-4171-bd5e-57118af09418 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:29.200188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d0c9ab87-026e-4171-bd5e-57118af09418 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.318699 Sep 13 20:00:29.201141 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 144/304] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:28 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:29.208902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-00211fd6-2491-4858-910b-78d84dfe41b7 req-3abdbed5-d10e-4c44-9d12-0a75a742253c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8d05bf-2349-4766-9c4c-b10409c38b0b", "tag": "45cbaa63-9248-4c2d-ab71-b1bd54dd2064"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:29.225131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-00211fd6-2491-4858-910b-78d84dfe41b7 req-3abdbed5-d10e-4c44-9d12-0a75a742253c service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:29.226077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-00211fd6-2491-4858-910b-78d84dfe41b7 req-3abdbed5-d10e-4c44-9d12-0a75a742253c service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:29.226692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-00211fd6-2491-4858-910b-78d84dfe41b7 req-3abdbed5-d10e-4c44-9d12-0a75a742253c service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:29.268951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-00211fd6-2491-4858-910b-78d84dfe41b7 req-3abdbed5-d10e-4c44-9d12-0a75a742253c service nova] Creating event network-changed:45cbaa63-9248-4c2d-ab71-b1bd54dd2064 for instance 8c8d05bf-2349-4766-9c4c-b10409c38b0b on hv-cinder-85427 Sep 13 20:00:29.275675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-00211fd6-2491-4858-910b-78d84dfe41b7 req-3abdbed5-d10e-4c44-9d12-0a75a742253c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073001 Sep 13 20:00:29.277130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 145/305] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:29.332618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1c0b4d11-c1ef-4e4f-b53d-c409fdc880f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5860af2-1cbd-46b5-b429-4664abbae2d1", "device": "/dev/sdb"}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:29.335744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1c0b4d11-c1ef-4e4f-b53d-c409fdc880f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:29.342971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c0b4d11-c1ef-4e4f-b53d-c409fdc880f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:29.343455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c0b4d11-c1ef-4e4f-b53d-c409fdc880f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:29.343880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c0b4d11-c1ef-4e4f-b53d-c409fdc880f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:29.344573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c0b4d11-c1ef-4e4f-b53d-c409fdc880f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:29.345017 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c0b4d11-c1ef-4e4f-b53d-c409fdc880f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:29.345426 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c0b4d11-c1ef-4e4f-b53d-c409fdc880f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:29.360628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-77fc3a43-a385-40db-a966-28110fa941d3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:29.369482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-77fc3a43-a385-40db-a966-28110fa941d3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.212281 Sep 13 20:00:29.370655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 161/306] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:29 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:29.621608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8e03e9fa-75aa-4dee-a42a-a1c166527697 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:29.622219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8e03e9fa-75aa-4dee-a42a-a1c166527697 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:29.628996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e03e9fa-75aa-4dee-a42a-a1c166527697 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:29.629500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e03e9fa-75aa-4dee-a42a-a1c166527697 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:29.629924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e03e9fa-75aa-4dee-a42a-a1c166527697 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:29.630966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e03e9fa-75aa-4dee-a42a-a1c166527697 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:29.631694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e03e9fa-75aa-4dee-a42a-a1c166527697 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:29.632283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e03e9fa-75aa-4dee-a42a-a1c166527697 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:29.805146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8e03e9fa-75aa-4dee-a42a-a1c166527697 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:29.815635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8e03e9fa-75aa-4dee-a42a-a1c166527697 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1363 microversion: 2.1 time: 0.197671 Sep 13 20:00:29.817049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 162/307] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:30.151779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1c0b4d11-c1ef-4e4f-b53d-c409fdc880f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "POST /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.823646 Sep 13 20:00:30.154045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 146/308] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 13 20:00:29 2022] POST /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:30.240081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-27cb6cd7-a368-479a-946e-0693fa4fc263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:30.251195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-27cb6cd7-a368-479a-946e-0693fa4fc263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:30.293943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27cb6cd7-a368-479a-946e-0693fa4fc263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:30.299354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27cb6cd7-a368-479a-946e-0693fa4fc263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:30.300368 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27cb6cd7-a368-479a-946e-0693fa4fc263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:30.301269 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27cb6cd7-a368-479a-946e-0693fa4fc263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:30.301880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27cb6cd7-a368-479a-946e-0693fa4fc263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:30.302671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27cb6cd7-a368-479a-946e-0693fa4fc263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:30.396014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-89fdb230-32e6-42f3-9116-e4e1f8f3f618 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:30.397333 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-89fdb230-32e6-42f3-9116-e4e1f8f3f618 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:30.405662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89fdb230-32e6-42f3-9116-e4e1f8f3f618 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:30.406658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89fdb230-32e6-42f3-9116-e4e1f8f3f618 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:30.407774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89fdb230-32e6-42f3-9116-e4e1f8f3f618 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:30.408732 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89fdb230-32e6-42f3-9116-e4e1f8f3f618 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:30.409395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89fdb230-32e6-42f3-9116-e4e1f8f3f618 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:30.410024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89fdb230-32e6-42f3-9116-e4e1f8f3f618 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:30.476059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-27cb6cd7-a368-479a-946e-0693fa4fc263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:30.487159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-27cb6cd7-a368-479a-946e-0693fa4fc263 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.265229 Sep 13 20:00:30.488284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 163/309] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:30 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:30.792439 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-89fdb230-32e6-42f3-9116-e4e1f8f3f618 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:30.801169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-89fdb230-32e6-42f3-9116-e4e1f8f3f618 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.411308 Sep 13 20:00:30.802242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 147/310] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:30 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:30.849331 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c4dc1ebe-7128-443a-a3ad-16e8f2352e0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:30.850477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c4dc1ebe-7128-443a-a3ad-16e8f2352e0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:30.858144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4dc1ebe-7128-443a-a3ad-16e8f2352e0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:30.859047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4dc1ebe-7128-443a-a3ad-16e8f2352e0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:30.859567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4dc1ebe-7128-443a-a3ad-16e8f2352e0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:30.860718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4dc1ebe-7128-443a-a3ad-16e8f2352e0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:30.861450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4dc1ebe-7128-443a-a3ad-16e8f2352e0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:30.861929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4dc1ebe-7128-443a-a3ad-16e8f2352e0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.023793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c4dc1ebe-7128-443a-a3ad-16e8f2352e0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:31.032104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c4dc1ebe-7128-443a-a3ad-16e8f2352e0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1548 microversion: 2.1 time: 0.187505 Sep 13 20:00:31.033098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 164/311] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:30 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1548 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:31.056832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2900cf4f-e489-4d53-bad9-88748f024113 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:31.057329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2900cf4f-e489-4d53-bad9-88748f024113 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:31.067490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2900cf4f-e489-4d53-bad9-88748f024113 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.068471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2900cf4f-e489-4d53-bad9-88748f024113 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.068915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2900cf4f-e489-4d53-bad9-88748f024113 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.069711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2900cf4f-e489-4d53-bad9-88748f024113 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.070153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2900cf4f-e489-4d53-bad9-88748f024113 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.070604 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2900cf4f-e489-4d53-bad9-88748f024113 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.163593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2900cf4f-e489-4d53-bad9-88748f024113 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111050 Sep 13 20:00:31.164331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 148/312] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 13 20:00:31 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:31.512934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2d88e4aa-28b8-4023-81a6-e72b42746a3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:31.513705 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2d88e4aa-28b8-4023-81a6-e72b42746a3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:31.520897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d88e4aa-28b8-4023-81a6-e72b42746a3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.521738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d88e4aa-28b8-4023-81a6-e72b42746a3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.522536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d88e4aa-28b8-4023-81a6-e72b42746a3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.523361 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d88e4aa-28b8-4023-81a6-e72b42746a3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.524036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d88e4aa-28b8-4023-81a6-e72b42746a3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.524467 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d88e4aa-28b8-4023-81a6-e72b42746a3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.690020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2d88e4aa-28b8-4023-81a6-e72b42746a3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:31.698759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2d88e4aa-28b8-4023-81a6-e72b42746a3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.190818 Sep 13 20:00:31.699346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 165/313] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:31 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:31.827011 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-014f5a55-e187-4af0-8fdb-25c9f133c60a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:31.827630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-014f5a55-e187-4af0-8fdb-25c9f133c60a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:31.835259 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-014f5a55-e187-4af0-8fdb-25c9f133c60a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.836719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-014f5a55-e187-4af0-8fdb-25c9f133c60a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.837072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-014f5a55-e187-4af0-8fdb-25c9f133c60a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.838544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-014f5a55-e187-4af0-8fdb-25c9f133c60a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.838961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-014f5a55-e187-4af0-8fdb-25c9f133c60a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.839377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-014f5a55-e187-4af0-8fdb-25c9f133c60a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:32.100405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-014f5a55-e187-4af0-8fdb-25c9f133c60a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:32.108892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-014f5a55-e187-4af0-8fdb-25c9f133c60a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.286664 Sep 13 20:00:32.109605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 149/314] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:31 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:32.546141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-1280f26c-4740-4844-bd15-2d08de8fefaa req-6ce18baa-325a-4ba7-be4e-ef6c9fcda07d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6c34670-16a4-4b3b-9a8d-1d77974d355e", "tag": "7a33c927-0f1f-4566-9bf6-1b28ad675d14"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:32.558748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-1280f26c-4740-4844-bd15-2d08de8fefaa req-6ce18baa-325a-4ba7-be4e-ef6c9fcda07d service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:32.559332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-1280f26c-4740-4844-bd15-2d08de8fefaa req-6ce18baa-325a-4ba7-be4e-ef6c9fcda07d service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:32.559871 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-1280f26c-4740-4844-bd15-2d08de8fefaa req-6ce18baa-325a-4ba7-be4e-ef6c9fcda07d service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:32.572236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-1280f26c-4740-4844-bd15-2d08de8fefaa req-6ce18baa-325a-4ba7-be4e-ef6c9fcda07d service nova] Creating event network-changed:7a33c927-0f1f-4566-9bf6-1b28ad675d14 for instance b6c34670-16a4-4b3b-9a8d-1d77974d355e on hv-cinder-85427 Sep 13 20:00:32.578146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-1280f26c-4740-4844-bd15-2d08de8fefaa req-6ce18baa-325a-4ba7-be4e-ef6c9fcda07d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035427 Sep 13 20:00:32.578983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 166/315] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:32.724097 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-221d9269-b8d9-433f-8562-8da37f5cb842 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:32.724733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-221d9269-b8d9-433f-8562-8da37f5cb842 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:32.730847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-221d9269-b8d9-433f-8562-8da37f5cb842 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:32.731338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-221d9269-b8d9-433f-8562-8da37f5cb842 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:32.731887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-221d9269-b8d9-433f-8562-8da37f5cb842 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:32.732911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-221d9269-b8d9-433f-8562-8da37f5cb842 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:32.733456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-221d9269-b8d9-433f-8562-8da37f5cb842 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:32.733989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-221d9269-b8d9-433f-8562-8da37f5cb842 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:33.013708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0dec0123-b5d7-4690-977d-1302109d7933 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:33.014443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0dec0123-b5d7-4690-977d-1302109d7933 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:33.028066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0dec0123-b5d7-4690-977d-1302109d7933 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:33.028563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0dec0123-b5d7-4690-977d-1302109d7933 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:33.029001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0dec0123-b5d7-4690-977d-1302109d7933 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:33.029704 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0dec0123-b5d7-4690-977d-1302109d7933 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:33.030321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0dec0123-b5d7-4690-977d-1302109d7933 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:33.032008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0dec0123-b5d7-4690-977d-1302109d7933 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:33.064518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0dec0123-b5d7-4690-977d-1302109d7933 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/ips" status: 200 len: 151 microversion: 2.20 time: 0.055645 Sep 13 20:00:33.065935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 167/316] 10.222.0.52 () {60 vars in 1289 bytes} [Tue Sep 13 20:00:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/ips => generated 151 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:00:33.133710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7afecf1a-d618-4369-b445-4b3c7904312f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:33.138757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-221d9269-b8d9-433f-8562-8da37f5cb842 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:33.148855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-221d9269-b8d9-433f-8562-8da37f5cb842 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.429154 Sep 13 20:00:33.150208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 150/317] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:32 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:33.151194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7afecf1a-d618-4369-b445-4b3c7904312f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:33.158856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7afecf1a-d618-4369-b445-4b3c7904312f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:33.159332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7afecf1a-d618-4369-b445-4b3c7904312f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:33.159753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7afecf1a-d618-4369-b445-4b3c7904312f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:33.160485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7afecf1a-d618-4369-b445-4b3c7904312f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:33.161000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7afecf1a-d618-4369-b445-4b3c7904312f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:33.161412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7afecf1a-d618-4369-b445-4b3c7904312f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:33.313883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7afecf1a-d618-4369-b445-4b3c7904312f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:33.322648 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7afecf1a-d618-4369-b445-4b3c7904312f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.194912 Sep 13 20:00:33.323230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 168/318] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:33 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:34.171677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7614069f-d504-48f3-b75f-bd8915761472 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:34.172269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7614069f-d504-48f3-b75f-bd8915761472 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:34.179468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7614069f-d504-48f3-b75f-bd8915761472 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:34.179955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7614069f-d504-48f3-b75f-bd8915761472 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:34.180442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7614069f-d504-48f3-b75f-bd8915761472 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:34.181215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7614069f-d504-48f3-b75f-bd8915761472 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:34.181996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7614069f-d504-48f3-b75f-bd8915761472 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:34.182466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7614069f-d504-48f3-b75f-bd8915761472 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:34.320942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7614069f-d504-48f3-b75f-bd8915761472 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:34.328900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7614069f-d504-48f3-b75f-bd8915761472 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.161078 Sep 13 20:00:34.329469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 151/319] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:34 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:34.346792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-852255e4-5b6b-420e-bfce-d3bd689a868b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:34.347408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-852255e4-5b6b-420e-bfce-d3bd689a868b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:34.353974 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-852255e4-5b6b-420e-bfce-d3bd689a868b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:34.354490 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-852255e4-5b6b-420e-bfce-d3bd689a868b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:34.354920 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-852255e4-5b6b-420e-bfce-d3bd689a868b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:34.355599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-852255e4-5b6b-420e-bfce-d3bd689a868b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:34.356044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-852255e4-5b6b-420e-bfce-d3bd689a868b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:34.356462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-852255e4-5b6b-420e-bfce-d3bd689a868b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:34.505643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-852255e4-5b6b-420e-bfce-d3bd689a868b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:34.514139 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-852255e4-5b6b-420e-bfce-d3bd689a868b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.171363 Sep 13 20:00:34.514729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 169/320] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:34 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:35.353304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b400c6b1-603d-42c4-a146-e7e37293266e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:35.353997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b400c6b1-603d-42c4-a146-e7e37293266e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:35.360906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b400c6b1-603d-42c4-a146-e7e37293266e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:35.361487 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b400c6b1-603d-42c4-a146-e7e37293266e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:35.361919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b400c6b1-603d-42c4-a146-e7e37293266e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:35.362776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b400c6b1-603d-42c4-a146-e7e37293266e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:35.363307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b400c6b1-603d-42c4-a146-e7e37293266e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:35.363694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b400c6b1-603d-42c4-a146-e7e37293266e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:35.537225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-99ccdbc2-e475-4db8-ae32-58e50358c15c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:35.537914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-99ccdbc2-e475-4db8-ae32-58e50358c15c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:35.545828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99ccdbc2-e475-4db8-ae32-58e50358c15c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:35.546611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99ccdbc2-e475-4db8-ae32-58e50358c15c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:35.547622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99ccdbc2-e475-4db8-ae32-58e50358c15c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:35.548538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99ccdbc2-e475-4db8-ae32-58e50358c15c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:35.549176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99ccdbc2-e475-4db8-ae32-58e50358c15c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:35.550542 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99ccdbc2-e475-4db8-ae32-58e50358c15c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:35.606607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b400c6b1-603d-42c4-a146-e7e37293266e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:35.620506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b400c6b1-603d-42c4-a146-e7e37293266e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.271642 Sep 13 20:00:35.622738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 152/321] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:35 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:35.733695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-99ccdbc2-e475-4db8-ae32-58e50358c15c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:35.745961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-99ccdbc2-e475-4db8-ae32-58e50358c15c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.212664 Sep 13 20:00:35.755010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 170/322] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:35 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:36.446891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f23a54c3-0275-44b9-bce2-cf70e80b4b3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:36.447950 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f23a54c3-0275-44b9-bce2-cf70e80b4b3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:36.455247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f23a54c3-0275-44b9-bce2-cf70e80b4b3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.455821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f23a54c3-0275-44b9-bce2-cf70e80b4b3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.456311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f23a54c3-0275-44b9-bce2-cf70e80b4b3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.456992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f23a54c3-0275-44b9-bce2-cf70e80b4b3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.457424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f23a54c3-0275-44b9-bce2-cf70e80b4b3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.457879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f23a54c3-0275-44b9-bce2-cf70e80b4b3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.483713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.objects.instance [None req-f23a54c3-0275-44b9-bce2-cf70e80b4b3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lazy-loading 'flavor' on Instance uuid 8d0decb4-2f46-4f2f-860f-e8ca277f7080 {{(pid=120845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:00:36.552971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:36.647014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-67bf47de-26fe-4333-a7b6-315cacbfb7dd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:36.648090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-67bf47de-26fe-4333-a7b6-315cacbfb7dd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:36.660158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67bf47de-26fe-4333-a7b6-315cacbfb7dd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.660658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67bf47de-26fe-4333-a7b6-315cacbfb7dd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.661098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67bf47de-26fe-4333-a7b6-315cacbfb7dd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.661807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67bf47de-26fe-4333-a7b6-315cacbfb7dd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.662259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67bf47de-26fe-4333-a7b6-315cacbfb7dd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.662747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67bf47de-26fe-4333-a7b6-315cacbfb7dd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.759793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f23a54c3-0275-44b9-bce2-cf70e80b4b3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "POST /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/action" status: 202 len: 0 microversion: 2.20 time: 0.316922 Sep 13 20:00:36.760401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 153/323] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 13 20:00:36 2022] POST /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:00:36.780778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e25bdc57-848c-40a1-96cd-61bde7baf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:36.781564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e25bdc57-848c-40a1-96cd-61bde7baf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:36.809120 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e25bdc57-848c-40a1-96cd-61bde7baf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.810057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e25bdc57-848c-40a1-96cd-61bde7baf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.811273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e25bdc57-848c-40a1-96cd-61bde7baf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.812134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e25bdc57-848c-40a1-96cd-61bde7baf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.812869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e25bdc57-848c-40a1-96cd-61bde7baf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.813140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e25bdc57-848c-40a1-96cd-61bde7baf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.951362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-67bf47de-26fe-4333-a7b6-315cacbfb7dd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:36.961514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-67bf47de-26fe-4333-a7b6-315cacbfb7dd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.318275 Sep 13 20:00:36.969854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e25bdc57-848c-40a1-96cd-61bde7baf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:36.978471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 171/324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:36 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:36.979985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e25bdc57-848c-40a1-96cd-61bde7baf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:36.982017 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e25bdc57-848c-40a1-96cd-61bde7baf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:36.983254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e25bdc57-848c-40a1-96cd-61bde7baf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.218142 Sep 13 20:00:36.983466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ff9505e6-0c80-422b-9228-9b0d536d7b3f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:36.984116 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 154/325] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:36.984512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ff9505e6-0c80-422b-9228-9b0d536d7b3f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:36.990999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff9505e6-0c80-422b-9228-9b0d536d7b3f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.991471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff9505e6-0c80-422b-9228-9b0d536d7b3f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.991937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff9505e6-0c80-422b-9228-9b0d536d7b3f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.992797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff9505e6-0c80-422b-9228-9b0d536d7b3f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.993244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff9505e6-0c80-422b-9228-9b0d536d7b3f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.993651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff9505e6-0c80-422b-9228-9b0d536d7b3f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.187374 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ff9505e6-0c80-422b-9228-9b0d536d7b3f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:37.196021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ff9505e6-0c80-422b-9228-9b0d536d7b3f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.216179 Sep 13 20:00:37.197437 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 172/326] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:36 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:37.696837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-008d70dd-c5e4-4580-add8-72bc4e8f6d61 req-ae9e6a57-8ff4-4b71-af53-215614db63cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8d05bf-2349-4766-9c4c-b10409c38b0b", "name": "network-vif-plugged", "status": "completed", "tag": "45cbaa63-9248-4c2d-ab71-b1bd54dd2064"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:37.708568 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-008d70dd-c5e4-4580-add8-72bc4e8f6d61 req-ae9e6a57-8ff4-4b71-af53-215614db63cf service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.708985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-008d70dd-c5e4-4580-add8-72bc4e8f6d61 req-ae9e6a57-8ff4-4b71-af53-215614db63cf service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.709408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-008d70dd-c5e4-4580-add8-72bc4e8f6d61 req-ae9e6a57-8ff4-4b71-af53-215614db63cf service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.722318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-008d70dd-c5e4-4580-add8-72bc4e8f6d61 req-ae9e6a57-8ff4-4b71-af53-215614db63cf service nova] Creating event network-vif-plugged:45cbaa63-9248-4c2d-ab71-b1bd54dd2064 for instance 8c8d05bf-2349-4766-9c4c-b10409c38b0b on hv-cinder-85427 Sep 13 20:00:37.727638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-008d70dd-c5e4-4580-add8-72bc4e8f6d61 req-ae9e6a57-8ff4-4b71-af53-215614db63cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034830 Sep 13 20:00:37.728228 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 155/327] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:37.985407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-53cca3e2-1529-47f3-9aec-99290769d097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:37.986823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-53cca3e2-1529-47f3-9aec-99290769d097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:37.993915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53cca3e2-1529-47f3-9aec-99290769d097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.994535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53cca3e2-1529-47f3-9aec-99290769d097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.995167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53cca3e2-1529-47f3-9aec-99290769d097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.995878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53cca3e2-1529-47f3-9aec-99290769d097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.996331 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53cca3e2-1529-47f3-9aec-99290769d097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.996747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53cca3e2-1529-47f3-9aec-99290769d097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.019796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1970b72d-9544-40f2-9243-aa4a87d08396 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:38.020486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1970b72d-9544-40f2-9243-aa4a87d08396 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:38.026835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1970b72d-9544-40f2-9243-aa4a87d08396 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.027309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1970b72d-9544-40f2-9243-aa4a87d08396 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.027727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1970b72d-9544-40f2-9243-aa4a87d08396 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.028413 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1970b72d-9544-40f2-9243-aa4a87d08396 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.028870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1970b72d-9544-40f2-9243-aa4a87d08396 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.029286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1970b72d-9544-40f2-9243-aa4a87d08396 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.152461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-53cca3e2-1529-47f3-9aec-99290769d097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:38.160584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-53cca3e2-1529-47f3-9aec-99290769d097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.178936 Sep 13 20:00:38.161288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 173/328] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:37 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:38.175064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1970b72d-9544-40f2-9243-aa4a87d08396 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:38.184016 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1970b72d-9544-40f2-9243-aa4a87d08396 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:38.185667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1970b72d-9544-40f2-9243-aa4a87d08396 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:38.187286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1970b72d-9544-40f2-9243-aa4a87d08396 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.172353 Sep 13 20:00:38.188271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 156/329] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:38.224453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-abf3fc31-94c6-42fc-8004-836c0197be92 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:38.225370 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-abf3fc31-94c6-42fc-8004-836c0197be92 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:38.232491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-abf3fc31-94c6-42fc-8004-836c0197be92 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.232978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-abf3fc31-94c6-42fc-8004-836c0197be92 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.233406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-abf3fc31-94c6-42fc-8004-836c0197be92 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.234102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-abf3fc31-94c6-42fc-8004-836c0197be92 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.234662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-abf3fc31-94c6-42fc-8004-836c0197be92 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.235079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-abf3fc31-94c6-42fc-8004-836c0197be92 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.375773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-abf3fc31-94c6-42fc-8004-836c0197be92 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:38.384496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-abf3fc31-94c6-42fc-8004-836c0197be92 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.163803 Sep 13 20:00:38.385690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 174/330] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:38 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:39.184796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-acacfa38-4d2b-4a76-98c4-2ec6d8224f7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:39.185682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-acacfa38-4d2b-4a76-98c4-2ec6d8224f7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:39.192008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-acacfa38-4d2b-4a76-98c4-2ec6d8224f7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:39.192396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-acacfa38-4d2b-4a76-98c4-2ec6d8224f7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:39.192829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-acacfa38-4d2b-4a76-98c4-2ec6d8224f7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:39.193512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-acacfa38-4d2b-4a76-98c4-2ec6d8224f7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:39.193961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-acacfa38-4d2b-4a76-98c4-2ec6d8224f7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:39.194435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-acacfa38-4d2b-4a76-98c4-2ec6d8224f7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:39.212444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ecb53f8f-9ecf-4921-a571-b58d1e0983b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:39.213053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ecb53f8f-9ecf-4921-a571-b58d1e0983b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:39.219241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecb53f8f-9ecf-4921-a571-b58d1e0983b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:39.219720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecb53f8f-9ecf-4921-a571-b58d1e0983b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:39.220144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecb53f8f-9ecf-4921-a571-b58d1e0983b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:39.220878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecb53f8f-9ecf-4921-a571-b58d1e0983b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:39.221324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecb53f8f-9ecf-4921-a571-b58d1e0983b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:39.221736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecb53f8f-9ecf-4921-a571-b58d1e0983b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:39.338782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-acacfa38-4d2b-4a76-98c4-2ec6d8224f7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:39.347446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-acacfa38-4d2b-4a76-98c4-2ec6d8224f7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.166701 Sep 13 20:00:39.348423 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 157/331] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:39 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:39.369760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ecb53f8f-9ecf-4921-a571-b58d1e0983b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:39.379264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ecb53f8f-9ecf-4921-a571-b58d1e0983b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:39.380763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ecb53f8f-9ecf-4921-a571-b58d1e0983b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:39.382180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ecb53f8f-9ecf-4921-a571-b58d1e0983b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.173978 Sep 13 20:00:39.382772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 175/332] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:39.409521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-70e56916-ea73-4fd6-a84c-bbecea838da7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:39.410158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-70e56916-ea73-4fd6-a84c-bbecea838da7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:39.416656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70e56916-ea73-4fd6-a84c-bbecea838da7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:39.417144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70e56916-ea73-4fd6-a84c-bbecea838da7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:39.417612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70e56916-ea73-4fd6-a84c-bbecea838da7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:39.418277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70e56916-ea73-4fd6-a84c-bbecea838da7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:39.418756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70e56916-ea73-4fd6-a84c-bbecea838da7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:39.419170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70e56916-ea73-4fd6-a84c-bbecea838da7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:39.558226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-70e56916-ea73-4fd6-a84c-bbecea838da7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:39.566470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-70e56916-ea73-4fd6-a84c-bbecea838da7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.162366 Sep 13 20:00:39.567022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 158/333] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:39 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:40.378811 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-67747dde-08f0-4ef1-aeec-430496595a7f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:40.379898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-67747dde-08f0-4ef1-aeec-430496595a7f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:40.390262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67747dde-08f0-4ef1-aeec-430496595a7f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:40.391121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67747dde-08f0-4ef1-aeec-430496595a7f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:40.391867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67747dde-08f0-4ef1-aeec-430496595a7f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:40.393032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67747dde-08f0-4ef1-aeec-430496595a7f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:40.393744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67747dde-08f0-4ef1-aeec-430496595a7f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:40.394445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67747dde-08f0-4ef1-aeec-430496595a7f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:40.417417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dce6e825-445b-445a-873f-8b6064beb9f5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:40.418086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dce6e825-445b-445a-873f-8b6064beb9f5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:40.424716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dce6e825-445b-445a-873f-8b6064beb9f5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:40.425180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dce6e825-445b-445a-873f-8b6064beb9f5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:40.425622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dce6e825-445b-445a-873f-8b6064beb9f5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:40.426527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dce6e825-445b-445a-873f-8b6064beb9f5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:40.426970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dce6e825-445b-445a-873f-8b6064beb9f5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:40.427383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dce6e825-445b-445a-873f-8b6064beb9f5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:40.587668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-67747dde-08f0-4ef1-aeec-430496595a7f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:40.596750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-67747dde-08f0-4ef1-aeec-430496595a7f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.224928 Sep 13 20:00:40.597429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 176/334] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:40 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:40.602642 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b9571c8a-0d3f-4ec6-883d-85af177f2dd7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:40.603358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b9571c8a-0d3f-4ec6-883d-85af177f2dd7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:40.604187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dce6e825-445b-445a-873f-8b6064beb9f5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:40.609891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9571c8a-0d3f-4ec6-883d-85af177f2dd7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:40.610499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9571c8a-0d3f-4ec6-883d-85af177f2dd7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:40.611184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9571c8a-0d3f-4ec6-883d-85af177f2dd7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:40.612071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9571c8a-0d3f-4ec6-883d-85af177f2dd7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:40.612695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9571c8a-0d3f-4ec6-883d-85af177f2dd7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:40.613262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9571c8a-0d3f-4ec6-883d-85af177f2dd7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:40.613864 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dce6e825-445b-445a-873f-8b6064beb9f5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:40.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dce6e825-445b-445a-873f-8b6064beb9f5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:40.617117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dce6e825-445b-445a-873f-8b6064beb9f5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.203577 Sep 13 20:00:40.617785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 159/335] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:40.769624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b9571c8a-0d3f-4ec6-883d-85af177f2dd7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:40.778246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b9571c8a-0d3f-4ec6-883d-85af177f2dd7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.179553 Sep 13 20:00:40.778878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 177/336] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:40 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:41.621080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d3378136-ba58-40e9-9d60-38e7e84f7765 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:41.621728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d3378136-ba58-40e9-9d60-38e7e84f7765 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:41.628432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3378136-ba58-40e9-9d60-38e7e84f7765 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:41.628909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3378136-ba58-40e9-9d60-38e7e84f7765 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:41.629342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3378136-ba58-40e9-9d60-38e7e84f7765 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:41.630069 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3378136-ba58-40e9-9d60-38e7e84f7765 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:41.630578 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3378136-ba58-40e9-9d60-38e7e84f7765 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:41.631043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3378136-ba58-40e9-9d60-38e7e84f7765 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:41.647686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-651964d2-764f-451e-9d3f-3ccf4bd7f282 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:41.648291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-651964d2-764f-451e-9d3f-3ccf4bd7f282 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:41.662452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-651964d2-764f-451e-9d3f-3ccf4bd7f282 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:41.664162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-651964d2-764f-451e-9d3f-3ccf4bd7f282 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:41.664606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-651964d2-764f-451e-9d3f-3ccf4bd7f282 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:41.665332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-651964d2-764f-451e-9d3f-3ccf4bd7f282 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:41.665788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-651964d2-764f-451e-9d3f-3ccf4bd7f282 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:41.666203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-651964d2-764f-451e-9d3f-3ccf4bd7f282 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:41.671164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:41.793051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d3378136-ba58-40e9-9d60-38e7e84f7765 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:41.801793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d3378136-ba58-40e9-9d60-38e7e84f7765 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.184387 Sep 13 20:00:41.802291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 160/337] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:41 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:41.827008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e94a708b-10b9-49cb-a811-c406cec63135 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:41.828827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e94a708b-10b9-49cb-a811-c406cec63135 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:41.839634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e94a708b-10b9-49cb-a811-c406cec63135 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:41.840538 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e94a708b-10b9-49cb-a811-c406cec63135 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:41.841091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e94a708b-10b9-49cb-a811-c406cec63135 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:41.842391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e94a708b-10b9-49cb-a811-c406cec63135 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:41.843514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e94a708b-10b9-49cb-a811-c406cec63135 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:41.844588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e94a708b-10b9-49cb-a811-c406cec63135 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:41.845035 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-651964d2-764f-451e-9d3f-3ccf4bd7f282 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:41.865688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-651964d2-764f-451e-9d3f-3ccf4bd7f282 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:41.868717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-651964d2-764f-451e-9d3f-3ccf4bd7f282 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:41.870597 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-651964d2-764f-451e-9d3f-3ccf4bd7f282 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.226736 Sep 13 20:00:41.874197 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 178/338] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:41 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:00:42.032364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e94a708b-10b9-49cb-a811-c406cec63135 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:42.041657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e94a708b-10b9-49cb-a811-c406cec63135 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.227022 Sep 13 20:00:42.042248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 161/339] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:41 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:42.826797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-aa1c3651-ad0d-4c08-94f6-707c3abd2038 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:42.827626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-aa1c3651-ad0d-4c08-94f6-707c3abd2038 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:42.834543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa1c3651-ad0d-4c08-94f6-707c3abd2038 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:42.835030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa1c3651-ad0d-4c08-94f6-707c3abd2038 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:42.836029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa1c3651-ad0d-4c08-94f6-707c3abd2038 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:42.836203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa1c3651-ad0d-4c08-94f6-707c3abd2038 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:42.836592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa1c3651-ad0d-4c08-94f6-707c3abd2038 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:42.837373 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa1c3651-ad0d-4c08-94f6-707c3abd2038 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:42.899270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0cd4775f-d9bb-4aaa-b6ea-496bae195ca8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:42.899944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0cd4775f-d9bb-4aaa-b6ea-496bae195ca8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:42.907709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0cd4775f-d9bb-4aaa-b6ea-496bae195ca8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:42.908191 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0cd4775f-d9bb-4aaa-b6ea-496bae195ca8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:42.908621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0cd4775f-d9bb-4aaa-b6ea-496bae195ca8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:42.909331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0cd4775f-d9bb-4aaa-b6ea-496bae195ca8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:42.909770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0cd4775f-d9bb-4aaa-b6ea-496bae195ca8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:42.910189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0cd4775f-d9bb-4aaa-b6ea-496bae195ca8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:42.995655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-aa1c3651-ad0d-4c08-94f6-707c3abd2038 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:43.012464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-aa1c3651-ad0d-4c08-94f6-707c3abd2038 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.188743 Sep 13 20:00:43.013488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 179/340] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:42 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:43.074158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0cd4775f-d9bb-4aaa-b6ea-496bae195ca8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:43.079883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-06cb60af-b647-48c0-8842-dadefeb6e27e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:43.080457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-06cb60af-b647-48c0-8842-dadefeb6e27e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:43.084449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0cd4775f-d9bb-4aaa-b6ea-496bae195ca8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:43.086533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0cd4775f-d9bb-4aaa-b6ea-496bae195ca8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:43.087721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06cb60af-b647-48c0-8842-dadefeb6e27e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:43.088156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0cd4775f-d9bb-4aaa-b6ea-496bae195ca8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.192954 Sep 13 20:00:43.088322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06cb60af-b647-48c0-8842-dadefeb6e27e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:43.088614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06cb60af-b647-48c0-8842-dadefeb6e27e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:43.088845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 162/341] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:00:43.089339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06cb60af-b647-48c0-8842-dadefeb6e27e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:43.089830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06cb60af-b647-48c0-8842-dadefeb6e27e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:43.090244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06cb60af-b647-48c0-8842-dadefeb6e27e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:43.264239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-06cb60af-b647-48c0-8842-dadefeb6e27e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:43.274284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-06cb60af-b647-48c0-8842-dadefeb6e27e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1314 microversion: 2.1 time: 0.198496 Sep 13 20:00:43.275064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 180/342] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:43 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:44.036498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-df45b334-68e1-4ed7-9866-d435743ede99 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:44.037105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-df45b334-68e1-4ed7-9866-d435743ede99 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:44.043841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-df45b334-68e1-4ed7-9866-d435743ede99 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:44.044302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-df45b334-68e1-4ed7-9866-d435743ede99 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:44.045021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-df45b334-68e1-4ed7-9866-d435743ede99 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.045620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-df45b334-68e1-4ed7-9866-d435743ede99 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:44.046233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-df45b334-68e1-4ed7-9866-d435743ede99 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:44.046698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-df45b334-68e1-4ed7-9866-d435743ede99 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.118796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6307e2f0-df08-471e-a2b7-6e840e488b3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:44.119426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6307e2f0-df08-471e-a2b7-6e840e488b3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:44.144138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6307e2f0-df08-471e-a2b7-6e840e488b3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:44.144855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6307e2f0-df08-471e-a2b7-6e840e488b3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:44.145290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6307e2f0-df08-471e-a2b7-6e840e488b3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.145996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6307e2f0-df08-471e-a2b7-6e840e488b3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:44.146622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6307e2f0-df08-471e-a2b7-6e840e488b3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:44.147194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6307e2f0-df08-471e-a2b7-6e840e488b3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.241367 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-df45b334-68e1-4ed7-9866-d435743ede99 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:44.246183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-df45b334-68e1-4ed7-9866-d435743ede99 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.213651 Sep 13 20:00:44.250419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 163/343] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:44 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:44.314318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-876af488-b228-4fa3-9b4d-9933e4809455 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:44.314971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-876af488-b228-4fa3-9b4d-9933e4809455 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:44.321901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-876af488-b228-4fa3-9b4d-9933e4809455 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:44.322421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-876af488-b228-4fa3-9b4d-9933e4809455 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:44.322840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-876af488-b228-4fa3-9b4d-9933e4809455 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.324078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-876af488-b228-4fa3-9b4d-9933e4809455 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:44.324745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-876af488-b228-4fa3-9b4d-9933e4809455 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:44.325894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-876af488-b228-4fa3-9b4d-9933e4809455 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.358929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6307e2f0-df08-471e-a2b7-6e840e488b3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:44.367929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6307e2f0-df08-471e-a2b7-6e840e488b3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:44.370061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6307e2f0-df08-471e-a2b7-6e840e488b3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:44.372966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6307e2f0-df08-471e-a2b7-6e840e488b3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.260146 Sep 13 20:00:44.382831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 181/344] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:44.480539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-876af488-b228-4fa3-9b4d-9933e4809455 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:44.489672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-876af488-b228-4fa3-9b4d-9933e4809455 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1498 microversion: 2.1 time: 0.184250 Sep 13 20:00:44.490254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 164/345] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:44 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1498 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:45.277291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dca8632f-2ca1-4eec-b70c-6d93e4356d0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:45.278248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dca8632f-2ca1-4eec-b70c-6d93e4356d0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:45.287118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dca8632f-2ca1-4eec-b70c-6d93e4356d0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:45.287900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dca8632f-2ca1-4eec-b70c-6d93e4356d0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:45.288590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dca8632f-2ca1-4eec-b70c-6d93e4356d0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:45.289705 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dca8632f-2ca1-4eec-b70c-6d93e4356d0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:45.290359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dca8632f-2ca1-4eec-b70c-6d93e4356d0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:45.290977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dca8632f-2ca1-4eec-b70c-6d93e4356d0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:45.400398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ad22e246-1a61-45ea-886b-83957aa66675 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:45.400935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ad22e246-1a61-45ea-886b-83957aa66675 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:45.408113 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ad22e246-1a61-45ea-886b-83957aa66675 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:45.408728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ad22e246-1a61-45ea-886b-83957aa66675 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:45.409358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ad22e246-1a61-45ea-886b-83957aa66675 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:45.410277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ad22e246-1a61-45ea-886b-83957aa66675 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:45.410752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ad22e246-1a61-45ea-886b-83957aa66675 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:45.411195 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ad22e246-1a61-45ea-886b-83957aa66675 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:45.453445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dca8632f-2ca1-4eec-b70c-6d93e4356d0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:45.459333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dca8632f-2ca1-4eec-b70c-6d93e4356d0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.189951 Sep 13 20:00:45.459920 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 182/346] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:45 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:45.563455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ad22e246-1a61-45ea-886b-83957aa66675 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:45.572815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ad22e246-1a61-45ea-886b-83957aa66675 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:45.574255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ad22e246-1a61-45ea-886b-83957aa66675 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:45.575462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ad22e246-1a61-45ea-886b-83957aa66675 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.179580 Sep 13 20:00:45.576049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 165/347] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:46.483046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9f816913-ecda-401a-96f4-9011c2477a11 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:46.483657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9f816913-ecda-401a-96f4-9011c2477a11 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:46.490676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f816913-ecda-401a-96f4-9011c2477a11 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:46.491194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f816913-ecda-401a-96f4-9011c2477a11 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:46.491609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f816913-ecda-401a-96f4-9011c2477a11 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:46.492323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f816913-ecda-401a-96f4-9011c2477a11 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:46.492980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f816913-ecda-401a-96f4-9011c2477a11 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:46.493527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f816913-ecda-401a-96f4-9011c2477a11 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:46.601730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ba38284d-bee9-4d79-8d43-0b79aa8923e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:46.602529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ba38284d-bee9-4d79-8d43-0b79aa8923e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:46.609938 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba38284d-bee9-4d79-8d43-0b79aa8923e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:46.610457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba38284d-bee9-4d79-8d43-0b79aa8923e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:46.610938 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba38284d-bee9-4d79-8d43-0b79aa8923e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:46.611841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba38284d-bee9-4d79-8d43-0b79aa8923e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:46.612300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba38284d-bee9-4d79-8d43-0b79aa8923e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:46.612713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba38284d-bee9-4d79-8d43-0b79aa8923e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:46.639256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9f816913-ecda-401a-96f4-9011c2477a11 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:46.659743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9f816913-ecda-401a-96f4-9011c2477a11 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.180355 Sep 13 20:00:46.661943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 183/348] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:46 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:46.785616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ba38284d-bee9-4d79-8d43-0b79aa8923e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:46.799662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ba38284d-bee9-4d79-8d43-0b79aa8923e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:46.801133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ba38284d-bee9-4d79-8d43-0b79aa8923e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:46.802308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ba38284d-bee9-4d79-8d43-0b79aa8923e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.204592 Sep 13 20:00:46.802895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 166/349] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:47.687146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c3c655f9-ba26-4b16-84ba-b4dcc2394143 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:47.688081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c3c655f9-ba26-4b16-84ba-b4dcc2394143 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:47.695433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3c655f9-ba26-4b16-84ba-b4dcc2394143 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:47.695873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3c655f9-ba26-4b16-84ba-b4dcc2394143 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:47.696369 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3c655f9-ba26-4b16-84ba-b4dcc2394143 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:47.697068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3c655f9-ba26-4b16-84ba-b4dcc2394143 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:47.697525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3c655f9-ba26-4b16-84ba-b4dcc2394143 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:47.697936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3c655f9-ba26-4b16-84ba-b4dcc2394143 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:47.839482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dd4b2b86-9dfc-43dc-8b14-0ef457cd5059 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:47.840481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dd4b2b86-9dfc-43dc-8b14-0ef457cd5059 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:47.851516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd4b2b86-9dfc-43dc-8b14-0ef457cd5059 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:47.852484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd4b2b86-9dfc-43dc-8b14-0ef457cd5059 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:47.853246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd4b2b86-9dfc-43dc-8b14-0ef457cd5059 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:47.854483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd4b2b86-9dfc-43dc-8b14-0ef457cd5059 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:47.854974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd4b2b86-9dfc-43dc-8b14-0ef457cd5059 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:47.855537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd4b2b86-9dfc-43dc-8b14-0ef457cd5059 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:47.860331 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c3c655f9-ba26-4b16-84ba-b4dcc2394143 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:47.869460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c3c655f9-ba26-4b16-84ba-b4dcc2394143 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.188010 Sep 13 20:00:47.870157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 184/350] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:47 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:48.014628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dd4b2b86-9dfc-43dc-8b14-0ef457cd5059 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:48.025232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dd4b2b86-9dfc-43dc-8b14-0ef457cd5059 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:48.028376 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dd4b2b86-9dfc-43dc-8b14-0ef457cd5059 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:48.029957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dd4b2b86-9dfc-43dc-8b14-0ef457cd5059 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.198196 Sep 13 20:00:48.030543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 167/351] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:47 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:48.367110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-67f547d5-203d-4431-aae6-ccca9fbc23e7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:48.367720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-67f547d5-203d-4431-aae6-ccca9fbc23e7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:48.375534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67f547d5-203d-4431-aae6-ccca9fbc23e7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.376018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67f547d5-203d-4431-aae6-ccca9fbc23e7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.376538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67f547d5-203d-4431-aae6-ccca9fbc23e7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.377241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67f547d5-203d-4431-aae6-ccca9fbc23e7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.377695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67f547d5-203d-4431-aae6-ccca9fbc23e7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.378441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67f547d5-203d-4431-aae6-ccca9fbc23e7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.405000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-67f547d5-203d-4431-aae6-ccca9fbc23e7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Going to try to terminate instance {{(pid=120844) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:00:48.496935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-67f547d5-203d-4431-aae6-ccca9fbc23e7 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 204 len: 0 microversion: 2.1 time: 0.134344 Sep 13 20:00:48.497646 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 185/352] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:00:48 2022] DELETE /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:00:48.507094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-07eab098-91dd-4cd9-889b-fd828c3189df tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:48.507797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-07eab098-91dd-4cd9-889b-fd828c3189df tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:48.518579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07eab098-91dd-4cd9-889b-fd828c3189df tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.518579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07eab098-91dd-4cd9-889b-fd828c3189df tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.518579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07eab098-91dd-4cd9-889b-fd828c3189df tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.518579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07eab098-91dd-4cd9-889b-fd828c3189df tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.518930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07eab098-91dd-4cd9-889b-fd828c3189df tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.518930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07eab098-91dd-4cd9-889b-fd828c3189df tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.674657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-07eab098-91dd-4cd9-889b-fd828c3189df tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:48.685774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-07eab098-91dd-4cd9-889b-fd828c3189df tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.183083 Sep 13 20:00:48.691139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 168/353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:48 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:48.905133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-39a669cf-bde1-41e6-853c-3e8a9afbd1c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:48.905721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-39a669cf-bde1-41e6-853c-3e8a9afbd1c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:48.912797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-39a669cf-bde1-41e6-853c-3e8a9afbd1c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.913495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-39a669cf-bde1-41e6-853c-3e8a9afbd1c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.913930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-39a669cf-bde1-41e6-853c-3e8a9afbd1c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.914739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-39a669cf-bde1-41e6-853c-3e8a9afbd1c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.915185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-39a669cf-bde1-41e6-853c-3e8a9afbd1c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.915610 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-39a669cf-bde1-41e6-853c-3e8a9afbd1c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:49.057155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-49738c32-46b1-4237-9ac9-c790f1d88b0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:49.067337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-49738c32-46b1-4237-9ac9-c790f1d88b0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:49.067475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-39a669cf-bde1-41e6-853c-3e8a9afbd1c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:49.074985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49738c32-46b1-4237-9ac9-c790f1d88b0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:49.075831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49738c32-46b1-4237-9ac9-c790f1d88b0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:49.076474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49738c32-46b1-4237-9ac9-c790f1d88b0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:49.077387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49738c32-46b1-4237-9ac9-c790f1d88b0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:49.078040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49738c32-46b1-4237-9ac9-c790f1d88b0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:49.078713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49738c32-46b1-4237-9ac9-c790f1d88b0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:49.089639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-39a669cf-bde1-41e6-853c-3e8a9afbd1c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.189669 Sep 13 20:00:49.090252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 186/354] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:48 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:49.229253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-49738c32-46b1-4237-9ac9-c790f1d88b0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:49.238140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-49738c32-46b1-4237-9ac9-c790f1d88b0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:49.239626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-49738c32-46b1-4237-9ac9-c790f1d88b0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:49.240796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-49738c32-46b1-4237-9ac9-c790f1d88b0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.188827 Sep 13 20:00:49.247542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 169/355] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:00:49.713372 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-952122ca-6836-47b9-9c5a-7d2a0fa57467 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:49.714177 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-952122ca-6836-47b9-9c5a-7d2a0fa57467 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:49.723217 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-952122ca-6836-47b9-9c5a-7d2a0fa57467 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:49.723873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-952122ca-6836-47b9-9c5a-7d2a0fa57467 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:49.724327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-952122ca-6836-47b9-9c5a-7d2a0fa57467 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:49.725167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-952122ca-6836-47b9-9c5a-7d2a0fa57467 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:49.725845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-952122ca-6836-47b9-9c5a-7d2a0fa57467 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:49.726436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-952122ca-6836-47b9-9c5a-7d2a0fa57467 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:49.874484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-952122ca-6836-47b9-9c5a-7d2a0fa57467 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:49.882872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-952122ca-6836-47b9-9c5a-7d2a0fa57467 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.175881 Sep 13 20:00:49.883446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 187/356] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:49 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:50.113357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9e5f0fe8-f71a-44d4-8482-9c1e6d584be2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:50.113897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9e5f0fe8-f71a-44d4-8482-9c1e6d584be2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:50.120924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e5f0fe8-f71a-44d4-8482-9c1e6d584be2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:50.121408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e5f0fe8-f71a-44d4-8482-9c1e6d584be2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:50.121838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e5f0fe8-f71a-44d4-8482-9c1e6d584be2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:50.122609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e5f0fe8-f71a-44d4-8482-9c1e6d584be2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:50.123024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e5f0fe8-f71a-44d4-8482-9c1e6d584be2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:50.123446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e5f0fe8-f71a-44d4-8482-9c1e6d584be2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:50.265522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b00f5098-4012-4cf9-bfb8-521bcf3e54e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:50.266114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b00f5098-4012-4cf9-bfb8-521bcf3e54e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:50.271694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9e5f0fe8-f71a-44d4-8482-9c1e6d584be2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:50.272920 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b00f5098-4012-4cf9-bfb8-521bcf3e54e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:50.273389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b00f5098-4012-4cf9-bfb8-521bcf3e54e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:50.273813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b00f5098-4012-4cf9-bfb8-521bcf3e54e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:50.274536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b00f5098-4012-4cf9-bfb8-521bcf3e54e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:50.274983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b00f5098-4012-4cf9-bfb8-521bcf3e54e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:50.275395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b00f5098-4012-4cf9-bfb8-521bcf3e54e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:50.277430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:50.280437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9e5f0fe8-f71a-44d4-8482-9c1e6d584be2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.171097 Sep 13 20:00:50.280993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 170/357] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:50 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:50.411430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b00f5098-4012-4cf9-bfb8-521bcf3e54e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:50.423265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b00f5098-4012-4cf9-bfb8-521bcf3e54e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:50.424782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b00f5098-4012-4cf9-bfb8-521bcf3e54e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:50.426069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b00f5098-4012-4cf9-bfb8-521bcf3e54e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.164493 Sep 13 20:00:50.426738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 188/358] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:50.909089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-274e5ff8-7d4e-443a-8980-e4ca914587cb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:50.909666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-274e5ff8-7d4e-443a-8980-e4ca914587cb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:50.916580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-274e5ff8-7d4e-443a-8980-e4ca914587cb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:50.917057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-274e5ff8-7d4e-443a-8980-e4ca914587cb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:50.917484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-274e5ff8-7d4e-443a-8980-e4ca914587cb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:50.918178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-274e5ff8-7d4e-443a-8980-e4ca914587cb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:50.918667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-274e5ff8-7d4e-443a-8980-e4ca914587cb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:50.919085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-274e5ff8-7d4e-443a-8980-e4ca914587cb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.055715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-274e5ff8-7d4e-443a-8980-e4ca914587cb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:51.063886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-274e5ff8-7d4e-443a-8980-e4ca914587cb tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.160590 Sep 13 20:00:51.064429 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 171/359] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:50 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:51.304644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1d80c066-a119-4ec3-8f3c-5c2554a89927 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:51.305353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1d80c066-a119-4ec3-8f3c-5c2554a89927 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:51.307962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:51.313812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d80c066-a119-4ec3-8f3c-5c2554a89927 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:51.314743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d80c066-a119-4ec3-8f3c-5c2554a89927 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:51.315436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d80c066-a119-4ec3-8f3c-5c2554a89927 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.316212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d80c066-a119-4ec3-8f3c-5c2554a89927 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:51.316726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d80c066-a119-4ec3-8f3c-5c2554a89927 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:51.317108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d80c066-a119-4ec3-8f3c-5c2554a89927 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.453528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0c05fe77-7820-4671-97b9-525ad5dbe4a9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:51.454165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0c05fe77-7820-4671-97b9-525ad5dbe4a9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:51.455647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1d80c066-a119-4ec3-8f3c-5c2554a89927 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:51.463519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c05fe77-7820-4671-97b9-525ad5dbe4a9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:51.464048 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1d80c066-a119-4ec3-8f3c-5c2554a89927 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.163788 Sep 13 20:00:51.464202 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c05fe77-7820-4671-97b9-525ad5dbe4a9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:51.464610 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 189/360] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:51 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:51.464920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c05fe77-7820-4671-97b9-525ad5dbe4a9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.465961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c05fe77-7820-4671-97b9-525ad5dbe4a9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:51.466460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c05fe77-7820-4671-97b9-525ad5dbe4a9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:51.467042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c05fe77-7820-4671-97b9-525ad5dbe4a9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.606859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0c05fe77-7820-4671-97b9-525ad5dbe4a9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:51.615610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0c05fe77-7820-4671-97b9-525ad5dbe4a9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:51.617058 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0c05fe77-7820-4671-97b9-525ad5dbe4a9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:51.618240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0c05fe77-7820-4671-97b9-525ad5dbe4a9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.170355 Sep 13 20:00:51.619536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 172/361] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:52.088132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7f9a38e2-e707-4ad9-88fb-5406ffa65279 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:52.088695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7f9a38e2-e707-4ad9-88fb-5406ffa65279 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:52.096624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f9a38e2-e707-4ad9-88fb-5406ffa65279 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.097112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f9a38e2-e707-4ad9-88fb-5406ffa65279 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.097542 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f9a38e2-e707-4ad9-88fb-5406ffa65279 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.098284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f9a38e2-e707-4ad9-88fb-5406ffa65279 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.098831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f9a38e2-e707-4ad9-88fb-5406ffa65279 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.099150 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f9a38e2-e707-4ad9-88fb-5406ffa65279 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.243407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7f9a38e2-e707-4ad9-88fb-5406ffa65279 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:52.251820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7f9a38e2-e707-4ad9-88fb-5406ffa65279 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.168250 Sep 13 20:00:52.252417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 190/362] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:52 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:52.491630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8f11587b-31c9-4d3b-9a01-ac5bdf23a162 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:52.492237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8f11587b-31c9-4d3b-9a01-ac5bdf23a162 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:52.495332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=76 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:52.500928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f11587b-31c9-4d3b-9a01-ac5bdf23a162 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.501464 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f11587b-31c9-4d3b-9a01-ac5bdf23a162 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.501891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f11587b-31c9-4d3b-9a01-ac5bdf23a162 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.502610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f11587b-31c9-4d3b-9a01-ac5bdf23a162 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.503080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f11587b-31c9-4d3b-9a01-ac5bdf23a162 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.503495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f11587b-31c9-4d3b-9a01-ac5bdf23a162 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.643572 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a754641f-19d5-45f3-a62b-0a553b08a27b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:52.646650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a754641f-19d5-45f3-a62b-0a553b08a27b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:52.646814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8f11587b-31c9-4d3b-9a01-ac5bdf23a162 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:52.653385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a754641f-19d5-45f3-a62b-0a553b08a27b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.653884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a754641f-19d5-45f3-a62b-0a553b08a27b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.654312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a754641f-19d5-45f3-a62b-0a553b08a27b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.654871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8f11587b-31c9-4d3b-9a01-ac5bdf23a162 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.169033 Sep 13 20:00:52.655018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a754641f-19d5-45f3-a62b-0a553b08a27b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.655445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 173/363] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:52 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:52.655842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a754641f-19d5-45f3-a62b-0a553b08a27b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.656783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a754641f-19d5-45f3-a62b-0a553b08a27b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.791048 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a754641f-19d5-45f3-a62b-0a553b08a27b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:52.799305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a754641f-19d5-45f3-a62b-0a553b08a27b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:52.803428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a754641f-19d5-45f3-a62b-0a553b08a27b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:52.804818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a754641f-19d5-45f3-a62b-0a553b08a27b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.165515 Sep 13 20:00:52.805433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 191/364] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:00:53.274962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2b0ba893-166a-4f05-a7a2-767fb4ffb859 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:53.275782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2b0ba893-166a-4f05-a7a2-767fb4ffb859 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:53.282211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b0ba893-166a-4f05-a7a2-767fb4ffb859 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.282670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b0ba893-166a-4f05-a7a2-767fb4ffb859 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.283273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b0ba893-166a-4f05-a7a2-767fb4ffb859 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.283828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b0ba893-166a-4f05-a7a2-767fb4ffb859 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.284276 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b0ba893-166a-4f05-a7a2-767fb4ffb859 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.284674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b0ba893-166a-4f05-a7a2-767fb4ffb859 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.444918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2b0ba893-166a-4f05-a7a2-767fb4ffb859 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:53.453422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2b0ba893-166a-4f05-a7a2-767fb4ffb859 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.182311 Sep 13 20:00:53.454010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 174/365] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:53 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:53.677346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f35d1782-f632-422f-8497-d99aca4a6115 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:53.677957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f35d1782-f632-422f-8497-d99aca4a6115 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:53.684666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f35d1782-f632-422f-8497-d99aca4a6115 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.685145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f35d1782-f632-422f-8497-d99aca4a6115 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.685572 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f35d1782-f632-422f-8497-d99aca4a6115 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.686254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f35d1782-f632-422f-8497-d99aca4a6115 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.686733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f35d1782-f632-422f-8497-d99aca4a6115 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.687151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f35d1782-f632-422f-8497-d99aca4a6115 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.832771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c874c7fb-a1ff-4e6c-be71-a4174e8808a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:53.833414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c874c7fb-a1ff-4e6c-be71-a4174e8808a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:53.836839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f35d1782-f632-422f-8497-d99aca4a6115 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:53.840016 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c874c7fb-a1ff-4e6c-be71-a4174e8808a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.840500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c874c7fb-a1ff-4e6c-be71-a4174e8808a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.840965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c874c7fb-a1ff-4e6c-be71-a4174e8808a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.841632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c874c7fb-a1ff-4e6c-be71-a4174e8808a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.842079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c874c7fb-a1ff-4e6c-be71-a4174e8808a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.842551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c874c7fb-a1ff-4e6c-be71-a4174e8808a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.845473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f35d1782-f632-422f-8497-d99aca4a6115 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.172177 Sep 13 20:00:53.846077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 192/366] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:53 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:53.986448 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c874c7fb-a1ff-4e6c-be71-a4174e8808a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:53.995679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c874c7fb-a1ff-4e6c-be71-a4174e8808a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:53.997103 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c874c7fb-a1ff-4e6c-be71-a4174e8808a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:53.998255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c874c7fb-a1ff-4e6c-be71-a4174e8808a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.169605 Sep 13 20:00:53.998849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 175/367] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:53 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:00:54.477546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-75f94397-9ea8-4903-88a3-889ed3222b0a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:54.478178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-75f94397-9ea8-4903-88a3-889ed3222b0a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:54.484709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75f94397-9ea8-4903-88a3-889ed3222b0a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:54.485220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75f94397-9ea8-4903-88a3-889ed3222b0a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:54.485639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75f94397-9ea8-4903-88a3-889ed3222b0a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:54.486321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75f94397-9ea8-4903-88a3-889ed3222b0a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:54.486785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75f94397-9ea8-4903-88a3-889ed3222b0a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:54.487194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75f94397-9ea8-4903-88a3-889ed3222b0a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:54.491382 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:54.624744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-75f94397-9ea8-4903-88a3-889ed3222b0a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:54.633466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-75f94397-9ea8-4903-88a3-889ed3222b0a tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.159741 Sep 13 20:00:54.634096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 193/368] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:54 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:54.868881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4ff7592f-457c-45b9-8789-78d2d92dbc78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:54.869513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4ff7592f-457c-45b9-8789-78d2d92dbc78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:54.876353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ff7592f-457c-45b9-8789-78d2d92dbc78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:54.876833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ff7592f-457c-45b9-8789-78d2d92dbc78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:54.877241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ff7592f-457c-45b9-8789-78d2d92dbc78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:54.877949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ff7592f-457c-45b9-8789-78d2d92dbc78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:54.878399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ff7592f-457c-45b9-8789-78d2d92dbc78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:54.878839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ff7592f-457c-45b9-8789-78d2d92dbc78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:55.023577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4ff7592f-457c-45b9-8789-78d2d92dbc78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:55.027442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d33fea41-8aca-4784-bada-871ed6470e0f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:55.029286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d33fea41-8aca-4784-bada-871ed6470e0f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:55.036237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4ff7592f-457c-45b9-8789-78d2d92dbc78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.170957 Sep 13 20:00:55.037613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 176/369] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:54 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:55.038793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d33fea41-8aca-4784-bada-871ed6470e0f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:55.039342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d33fea41-8aca-4784-bada-871ed6470e0f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:55.039826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d33fea41-8aca-4784-bada-871ed6470e0f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:55.040594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d33fea41-8aca-4784-bada-871ed6470e0f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:55.041098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d33fea41-8aca-4784-bada-871ed6470e0f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:55.041553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d33fea41-8aca-4784-bada-871ed6470e0f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:55.193334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d33fea41-8aca-4784-bada-871ed6470e0f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:55.203020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d33fea41-8aca-4784-bada-871ed6470e0f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:55.204509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d33fea41-8aca-4784-bada-871ed6470e0f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:55.205888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d33fea41-8aca-4784-bada-871ed6470e0f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.185404 Sep 13 20:00:55.206397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 194/370] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:55.657209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2d990e1f-d989-4968-9f5b-250dde6c886b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:55.657807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2d990e1f-d989-4968-9f5b-250dde6c886b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:55.664781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2d990e1f-d989-4968-9f5b-250dde6c886b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:55.665269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2d990e1f-d989-4968-9f5b-250dde6c886b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:55.665801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2d990e1f-d989-4968-9f5b-250dde6c886b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:55.666702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2d990e1f-d989-4968-9f5b-250dde6c886b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:55.667174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2d990e1f-d989-4968-9f5b-250dde6c886b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:55.667602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2d990e1f-d989-4968-9f5b-250dde6c886b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:55.815235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2d990e1f-d989-4968-9f5b-250dde6c886b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:55.824606 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2d990e1f-d989-4968-9f5b-250dde6c886b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.171379 Sep 13 20:00:55.825274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 177/371] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:55 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:56.061047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-27880c26-c841-437e-983b-b4f2ea0d0d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:56.061715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-27880c26-c841-437e-983b-b4f2ea0d0d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:56.068176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27880c26-c841-437e-983b-b4f2ea0d0d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:56.068650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27880c26-c841-437e-983b-b4f2ea0d0d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:56.069073 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27880c26-c841-437e-983b-b4f2ea0d0d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:56.069857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27880c26-c841-437e-983b-b4f2ea0d0d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:56.070347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27880c26-c841-437e-983b-b4f2ea0d0d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:56.070925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27880c26-c841-437e-983b-b4f2ea0d0d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:56.222919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-27880c26-c841-437e-983b-b4f2ea0d0d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:56.231430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-27880c26-c841-437e-983b-b4f2ea0d0d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.174286 Sep 13 20:00:56.231997 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 195/372] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:56 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:56.233311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a5d063e3-54e6-4ea7-b0cd-1fadf474b7d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:56.233920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a5d063e3-54e6-4ea7-b0cd-1fadf474b7d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:56.241294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5d063e3-54e6-4ea7-b0cd-1fadf474b7d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:56.241789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5d063e3-54e6-4ea7-b0cd-1fadf474b7d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:56.242224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5d063e3-54e6-4ea7-b0cd-1fadf474b7d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:56.242964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5d063e3-54e6-4ea7-b0cd-1fadf474b7d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:56.243435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5d063e3-54e6-4ea7-b0cd-1fadf474b7d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:56.243860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5d063e3-54e6-4ea7-b0cd-1fadf474b7d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:56.386821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a5d063e3-54e6-4ea7-b0cd-1fadf474b7d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:56.396422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a5d063e3-54e6-4ea7-b0cd-1fadf474b7d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:56.398275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a5d063e3-54e6-4ea7-b0cd-1fadf474b7d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:56.399556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a5d063e3-54e6-4ea7-b0cd-1fadf474b7d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.170133 Sep 13 20:00:56.400192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 178/373] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:56.848331 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e7914d19-b142-4e2d-85d2-5483323ffbd1 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:56.848946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e7914d19-b142-4e2d-85d2-5483323ffbd1 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:56.855109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7914d19-b142-4e2d-85d2-5483323ffbd1 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:56.855589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7914d19-b142-4e2d-85d2-5483323ffbd1 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:56.856018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7914d19-b142-4e2d-85d2-5483323ffbd1 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:56.856730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7914d19-b142-4e2d-85d2-5483323ffbd1 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:56.857154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7914d19-b142-4e2d-85d2-5483323ffbd1 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:56.857573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7914d19-b142-4e2d-85d2-5483323ffbd1 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:57.012742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e7914d19-b142-4e2d-85d2-5483323ffbd1 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:57.023506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e7914d19-b142-4e2d-85d2-5483323ffbd1 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.178571 Sep 13 20:00:57.023506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 196/374] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:56 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:57.255198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-89be13f9-516a-49f8-a0db-f9577bce1b50 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:57.255809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-89be13f9-516a-49f8-a0db-f9577bce1b50 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:57.263027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89be13f9-516a-49f8-a0db-f9577bce1b50 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:57.263714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89be13f9-516a-49f8-a0db-f9577bce1b50 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:57.264216 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89be13f9-516a-49f8-a0db-f9577bce1b50 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:57.265073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89be13f9-516a-49f8-a0db-f9577bce1b50 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:57.265525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89be13f9-516a-49f8-a0db-f9577bce1b50 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:57.265985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89be13f9-516a-49f8-a0db-f9577bce1b50 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:57.409979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-89be13f9-516a-49f8-a0db-f9577bce1b50 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:57.417967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-89be13f9-516a-49f8-a0db-f9577bce1b50 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.166907 Sep 13 20:00:57.418638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 179/375] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:57 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:57.433050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a610788a-5b03-4c21-a2af-1772a3a5c94d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:57.433050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a610788a-5b03-4c21-a2af-1772a3a5c94d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:57.435256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a610788a-5b03-4c21-a2af-1772a3a5c94d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:57.435734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a610788a-5b03-4c21-a2af-1772a3a5c94d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:57.436190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a610788a-5b03-4c21-a2af-1772a3a5c94d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:57.436879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a610788a-5b03-4c21-a2af-1772a3a5c94d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:57.437329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a610788a-5b03-4c21-a2af-1772a3a5c94d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:57.437740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a610788a-5b03-4c21-a2af-1772a3a5c94d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:57.579779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a610788a-5b03-4c21-a2af-1772a3a5c94d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:57.588569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a610788a-5b03-4c21-a2af-1772a3a5c94d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:57.590036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a610788a-5b03-4c21-a2af-1772a3a5c94d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:57.591226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a610788a-5b03-4c21-a2af-1772a3a5c94d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.170302 Sep 13 20:00:57.591773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 197/376] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:00:58.049666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-26221cad-72b0-4b30-a9aa-82a489c0e487 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:58.050414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-26221cad-72b0-4b30-a9aa-82a489c0e487 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:58.056828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26221cad-72b0-4b30-a9aa-82a489c0e487 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:58.057325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26221cad-72b0-4b30-a9aa-82a489c0e487 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:58.057745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26221cad-72b0-4b30-a9aa-82a489c0e487 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:58.058490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26221cad-72b0-4b30-a9aa-82a489c0e487 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:58.058942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26221cad-72b0-4b30-a9aa-82a489c0e487 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:58.059359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26221cad-72b0-4b30-a9aa-82a489c0e487 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:58.194747 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-26221cad-72b0-4b30-a9aa-82a489c0e487 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:58.203068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-26221cad-72b0-4b30-a9aa-82a489c0e487 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.159470 Sep 13 20:00:58.203631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 180/377] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:58 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:58.441715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6438024a-f374-4324-9187-a20f3f8ee983 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:58.442236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6438024a-f374-4324-9187-a20f3f8ee983 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:58.449284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6438024a-f374-4324-9187-a20f3f8ee983 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:58.449775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6438024a-f374-4324-9187-a20f3f8ee983 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:58.450213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6438024a-f374-4324-9187-a20f3f8ee983 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:58.450936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6438024a-f374-4324-9187-a20f3f8ee983 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:58.451383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6438024a-f374-4324-9187-a20f3f8ee983 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:58.451804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6438024a-f374-4324-9187-a20f3f8ee983 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:58.582418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6438024a-f374-4324-9187-a20f3f8ee983 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:58.590639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6438024a-f374-4324-9187-a20f3f8ee983 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.153067 Sep 13 20:00:58.591203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 198/378] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:58 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:58.619735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3e879592-7799-49ed-add1-621edfecc08e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:58.620622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3e879592-7799-49ed-add1-621edfecc08e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:58.630716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e879592-7799-49ed-add1-621edfecc08e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:58.631297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e879592-7799-49ed-add1-621edfecc08e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:58.632157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e879592-7799-49ed-add1-621edfecc08e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:58.633203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e879592-7799-49ed-add1-621edfecc08e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:58.633739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e879592-7799-49ed-add1-621edfecc08e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:58.634450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e879592-7799-49ed-add1-621edfecc08e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:58.780421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3e879592-7799-49ed-add1-621edfecc08e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:58.793163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3e879592-7799-49ed-add1-621edfecc08e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:58.795396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3e879592-7799-49ed-add1-621edfecc08e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:58.797057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3e879592-7799-49ed-add1-621edfecc08e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.183019 Sep 13 20:00:58.797786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 181/379] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:00:59.227350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d58d3100-15fe-4845-b7dd-fac3f2f3e6d0 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:59.228000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d58d3100-15fe-4845-b7dd-fac3f2f3e6d0 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:59.234403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d58d3100-15fe-4845-b7dd-fac3f2f3e6d0 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:59.234907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d58d3100-15fe-4845-b7dd-fac3f2f3e6d0 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:59.235340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d58d3100-15fe-4845-b7dd-fac3f2f3e6d0 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:59.236028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d58d3100-15fe-4845-b7dd-fac3f2f3e6d0 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:59.236480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d58d3100-15fe-4845-b7dd-fac3f2f3e6d0 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:59.236902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d58d3100-15fe-4845-b7dd-fac3f2f3e6d0 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:59.388980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d58d3100-15fe-4845-b7dd-fac3f2f3e6d0 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:59.397455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d58d3100-15fe-4845-b7dd-fac3f2f3e6d0 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.173999 Sep 13 20:00:59.397889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 199/380] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:59 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:59.615152 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-729683fd-a5d4-471c-90b6-837e9bed7524 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:59.615798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-729683fd-a5d4-471c-90b6-837e9bed7524 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:59.622262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-729683fd-a5d4-471c-90b6-837e9bed7524 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:59.622871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-729683fd-a5d4-471c-90b6-837e9bed7524 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:59.623211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-729683fd-a5d4-471c-90b6-837e9bed7524 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:59.623856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-729683fd-a5d4-471c-90b6-837e9bed7524 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:59.624728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-729683fd-a5d4-471c-90b6-837e9bed7524 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:59.625181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-729683fd-a5d4-471c-90b6-837e9bed7524 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:59.775498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-729683fd-a5d4-471c-90b6-837e9bed7524 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:59.786158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-729683fd-a5d4-471c-90b6-837e9bed7524 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.175104 Sep 13 20:00:59.786780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 182/381] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:59 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:59.823903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7f42ae07-8f16-42ca-a911-c3af4c33b6ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:59.824445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7f42ae07-8f16-42ca-a911-c3af4c33b6ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:59.830925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f42ae07-8f16-42ca-a911-c3af4c33b6ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:59.831438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f42ae07-8f16-42ca-a911-c3af4c33b6ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:59.831856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f42ae07-8f16-42ca-a911-c3af4c33b6ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:59.832534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f42ae07-8f16-42ca-a911-c3af4c33b6ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:59.832967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f42ae07-8f16-42ca-a911-c3af4c33b6ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:59.833375 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f42ae07-8f16-42ca-a911-c3af4c33b6ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:59.969760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7f42ae07-8f16-42ca-a911-c3af4c33b6ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:59.978351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7f42ae07-8f16-42ca-a911-c3af4c33b6ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:59.979828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7f42ae07-8f16-42ca-a911-c3af4c33b6ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:59.980997 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7f42ae07-8f16-42ca-a911-c3af4c33b6ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.161640 Sep 13 20:00:59.981556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 200/382] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:00:59 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:00.420712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-098f0950-b63f-4dc2-94be-e3c65a028d65 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:00.421406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-098f0950-b63f-4dc2-94be-e3c65a028d65 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:00.429841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-098f0950-b63f-4dc2-94be-e3c65a028d65 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:00.430744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-098f0950-b63f-4dc2-94be-e3c65a028d65 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:00.431512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-098f0950-b63f-4dc2-94be-e3c65a028d65 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:00.432917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-098f0950-b63f-4dc2-94be-e3c65a028d65 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:00.433596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-098f0950-b63f-4dc2-94be-e3c65a028d65 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:00.434100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-098f0950-b63f-4dc2-94be-e3c65a028d65 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:00.577027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-098f0950-b63f-4dc2-94be-e3c65a028d65 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:00.585398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-098f0950-b63f-4dc2-94be-e3c65a028d65 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.168612 Sep 13 20:01:00.586312 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 183/383] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:00 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:00.810695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2d31bd61-ddca-4325-9a18-1d6c5da82d54 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:00.811555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2d31bd61-ddca-4325-9a18-1d6c5da82d54 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:00.820585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d31bd61-ddca-4325-9a18-1d6c5da82d54 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:00.821395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d31bd61-ddca-4325-9a18-1d6c5da82d54 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:00.821839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d31bd61-ddca-4325-9a18-1d6c5da82d54 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:00.822591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d31bd61-ddca-4325-9a18-1d6c5da82d54 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:00.823161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d31bd61-ddca-4325-9a18-1d6c5da82d54 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:00.823758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d31bd61-ddca-4325-9a18-1d6c5da82d54 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:00.970645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2d31bd61-ddca-4325-9a18-1d6c5da82d54 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:00.979685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2d31bd61-ddca-4325-9a18-1d6c5da82d54 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.174365 Sep 13 20:01:00.980362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 201/384] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:00 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:01.005180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2cf400e5-98bf-4559-a5f7-b59d73ae43a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:01.005788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2cf400e5-98bf-4559-a5f7-b59d73ae43a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:01.012640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2cf400e5-98bf-4559-a5f7-b59d73ae43a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:01.013107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2cf400e5-98bf-4559-a5f7-b59d73ae43a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:01.013528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2cf400e5-98bf-4559-a5f7-b59d73ae43a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:01.014201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2cf400e5-98bf-4559-a5f7-b59d73ae43a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:01.014637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2cf400e5-98bf-4559-a5f7-b59d73ae43a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:01.015047 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2cf400e5-98bf-4559-a5f7-b59d73ae43a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:01.151923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2cf400e5-98bf-4559-a5f7-b59d73ae43a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:01.160673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2cf400e5-98bf-4559-a5f7-b59d73ae43a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:01.162117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2cf400e5-98bf-4559-a5f7-b59d73ae43a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:01.163307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2cf400e5-98bf-4559-a5f7-b59d73ae43a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.162041 Sep 13 20:01:01.163866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 184/385] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:01.609239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5d636761-ea09-4b9f-bd58-f61cb887737c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:01.609847 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5d636761-ea09-4b9f-bd58-f61cb887737c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:01.616397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d636761-ea09-4b9f-bd58-f61cb887737c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:01.616886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d636761-ea09-4b9f-bd58-f61cb887737c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:01.617329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d636761-ea09-4b9f-bd58-f61cb887737c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:01.618092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d636761-ea09-4b9f-bd58-f61cb887737c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:01.618507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d636761-ea09-4b9f-bd58-f61cb887737c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:01.618946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d636761-ea09-4b9f-bd58-f61cb887737c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:01.770798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5d636761-ea09-4b9f-bd58-f61cb887737c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:01.779522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5d636761-ea09-4b9f-bd58-f61cb887737c tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.174462 Sep 13 20:01:01.780332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 202/386] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:01 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:02.002573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-897ced41-601b-4785-bb31-c29dc4e56f27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:02.003224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-897ced41-601b-4785-bb31-c29dc4e56f27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:02.010324 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-897ced41-601b-4785-bb31-c29dc4e56f27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:02.010974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-897ced41-601b-4785-bb31-c29dc4e56f27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:02.011278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-897ced41-601b-4785-bb31-c29dc4e56f27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:02.012026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-897ced41-601b-4785-bb31-c29dc4e56f27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:02.012560 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-897ced41-601b-4785-bb31-c29dc4e56f27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:02.013103 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-897ced41-601b-4785-bb31-c29dc4e56f27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:02.166815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-897ced41-601b-4785-bb31-c29dc4e56f27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:02.178140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-897ced41-601b-4785-bb31-c29dc4e56f27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.179592 Sep 13 20:01:02.178831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 185/387] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:01 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:02.188571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2f18f436-1a7f-4d0d-8072-959e66e73709 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:02.189206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2f18f436-1a7f-4d0d-8072-959e66e73709 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:02.197136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f18f436-1a7f-4d0d-8072-959e66e73709 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:02.197869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f18f436-1a7f-4d0d-8072-959e66e73709 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:02.198485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f18f436-1a7f-4d0d-8072-959e66e73709 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:02.199666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f18f436-1a7f-4d0d-8072-959e66e73709 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:02.199986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f18f436-1a7f-4d0d-8072-959e66e73709 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:02.200592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f18f436-1a7f-4d0d-8072-959e66e73709 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:02.341660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2f18f436-1a7f-4d0d-8072-959e66e73709 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:02.349983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2f18f436-1a7f-4d0d-8072-959e66e73709 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:02.351391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2f18f436-1a7f-4d0d-8072-959e66e73709 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:02.352546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2f18f436-1a7f-4d0d-8072-959e66e73709 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.167969 Sep 13 20:01:02.353095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 203/388] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:02.804436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-58cfa0c3-fe1d-4e24-9b05-2c966a8fc683 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:02.805235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-58cfa0c3-fe1d-4e24-9b05-2c966a8fc683 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:02.813695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58cfa0c3-fe1d-4e24-9b05-2c966a8fc683 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:02.814354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58cfa0c3-fe1d-4e24-9b05-2c966a8fc683 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:02.814963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58cfa0c3-fe1d-4e24-9b05-2c966a8fc683 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:02.815944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58cfa0c3-fe1d-4e24-9b05-2c966a8fc683 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:02.816565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58cfa0c3-fe1d-4e24-9b05-2c966a8fc683 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:02.817094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58cfa0c3-fe1d-4e24-9b05-2c966a8fc683 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:02.952611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-58cfa0c3-fe1d-4e24-9b05-2c966a8fc683 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:02.961615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-58cfa0c3-fe1d-4e24-9b05-2c966a8fc683 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.162304 Sep 13 20:01:02.962144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 186/389] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:02 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:03.201516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9576008c-fc0e-4a0f-8b4f-33fcc5c3ffc3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:03.202138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9576008c-fc0e-4a0f-8b4f-33fcc5c3ffc3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:03.208865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9576008c-fc0e-4a0f-8b4f-33fcc5c3ffc3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:03.209347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9576008c-fc0e-4a0f-8b4f-33fcc5c3ffc3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:03.209763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9576008c-fc0e-4a0f-8b4f-33fcc5c3ffc3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:03.210470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9576008c-fc0e-4a0f-8b4f-33fcc5c3ffc3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:03.211276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9576008c-fc0e-4a0f-8b4f-33fcc5c3ffc3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:03.211683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9576008c-fc0e-4a0f-8b4f-33fcc5c3ffc3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:03.366472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9576008c-fc0e-4a0f-8b4f-33fcc5c3ffc3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:03.374435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9576008c-fc0e-4a0f-8b4f-33fcc5c3ffc3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.176740 Sep 13 20:01:03.374971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 204/390] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:03 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:03.381293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f4a6fb66-5a25-40ba-9d18-b12d9499c322 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:03.382005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f4a6fb66-5a25-40ba-9d18-b12d9499c322 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:03.388677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4a6fb66-5a25-40ba-9d18-b12d9499c322 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:03.389168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4a6fb66-5a25-40ba-9d18-b12d9499c322 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:03.389594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4a6fb66-5a25-40ba-9d18-b12d9499c322 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:03.390288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4a6fb66-5a25-40ba-9d18-b12d9499c322 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:03.390759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4a6fb66-5a25-40ba-9d18-b12d9499c322 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:03.391180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4a6fb66-5a25-40ba-9d18-b12d9499c322 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:03.407111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:03.536162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f4a6fb66-5a25-40ba-9d18-b12d9499c322 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:03.544658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f4a6fb66-5a25-40ba-9d18-b12d9499c322 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:03.546109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f4a6fb66-5a25-40ba-9d18-b12d9499c322 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:03.547299 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f4a6fb66-5a25-40ba-9d18-b12d9499c322 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.170024 Sep 13 20:01:03.547852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 187/391] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:03.984692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6f4c6198-1274-4570-a299-f2187aa49400 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:03.985292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6f4c6198-1274-4570-a299-f2187aa49400 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:03.991783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6f4c6198-1274-4570-a299-f2187aa49400 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:03.992255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6f4c6198-1274-4570-a299-f2187aa49400 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:03.992684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6f4c6198-1274-4570-a299-f2187aa49400 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:03.993375 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6f4c6198-1274-4570-a299-f2187aa49400 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:03.993831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6f4c6198-1274-4570-a299-f2187aa49400 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:03.994253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6f4c6198-1274-4570-a299-f2187aa49400 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:04.127385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6f4c6198-1274-4570-a299-f2187aa49400 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:04.135836 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6f4c6198-1274-4570-a299-f2187aa49400 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.155053 Sep 13 20:01:04.136405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 205/392] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:03 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:04.399174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d674659c-88d2-450a-aff8-fd5ebe1071a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:04.399736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d674659c-88d2-450a-aff8-fd5ebe1071a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:04.406766 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d674659c-88d2-450a-aff8-fd5ebe1071a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:04.407248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d674659c-88d2-450a-aff8-fd5ebe1071a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:04.407677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d674659c-88d2-450a-aff8-fd5ebe1071a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:04.408374 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d674659c-88d2-450a-aff8-fd5ebe1071a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:04.408819 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d674659c-88d2-450a-aff8-fd5ebe1071a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:04.409241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d674659c-88d2-450a-aff8-fd5ebe1071a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:04.551680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d674659c-88d2-450a-aff8-fd5ebe1071a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:04.559959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d674659c-88d2-450a-aff8-fd5ebe1071a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.165153 Sep 13 20:01:04.560515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 188/393] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:04 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:04.576394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-220f6796-efae-4ed4-aed6-317cb0912cc3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:04.577001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-220f6796-efae-4ed4-aed6-317cb0912cc3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:04.583805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-220f6796-efae-4ed4-aed6-317cb0912cc3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:04.584280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-220f6796-efae-4ed4-aed6-317cb0912cc3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:04.584711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-220f6796-efae-4ed4-aed6-317cb0912cc3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:04.585395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-220f6796-efae-4ed4-aed6-317cb0912cc3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:04.586197 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-220f6796-efae-4ed4-aed6-317cb0912cc3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:04.586674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-220f6796-efae-4ed4-aed6-317cb0912cc3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:04.731201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-220f6796-efae-4ed4-aed6-317cb0912cc3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:04.740314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-220f6796-efae-4ed4-aed6-317cb0912cc3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:04.741775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-220f6796-efae-4ed4-aed6-317cb0912cc3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:04.743015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-220f6796-efae-4ed4-aed6-317cb0912cc3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.170660 Sep 13 20:01:04.743586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 206/394] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:05.162488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-838b157e-5946-4d03-a834-70c7aa9c516e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:05.163455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-838b157e-5946-4d03-a834-70c7aa9c516e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:05.173274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-838b157e-5946-4d03-a834-70c7aa9c516e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:05.174024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-838b157e-5946-4d03-a834-70c7aa9c516e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:05.174857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-838b157e-5946-4d03-a834-70c7aa9c516e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:05.175978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-838b157e-5946-4d03-a834-70c7aa9c516e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:05.176872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-838b157e-5946-4d03-a834-70c7aa9c516e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:05.177294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-838b157e-5946-4d03-a834-70c7aa9c516e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:05.326667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-838b157e-5946-4d03-a834-70c7aa9c516e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:05.334166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-838b157e-5946-4d03-a834-70c7aa9c516e tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1504 microversion: 2.1 time: 0.178239 Sep 13 20:01:05.334802 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 189/395] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:05 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:05.582163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0ac091d4-2103-4c66-98e5-65b01fa79d91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:05.582880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0ac091d4-2103-4c66-98e5-65b01fa79d91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:05.590063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ac091d4-2103-4c66-98e5-65b01fa79d91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:05.590584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ac091d4-2103-4c66-98e5-65b01fa79d91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:05.591010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ac091d4-2103-4c66-98e5-65b01fa79d91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:05.591699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ac091d4-2103-4c66-98e5-65b01fa79d91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:05.592146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ac091d4-2103-4c66-98e5-65b01fa79d91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:05.592561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ac091d4-2103-4c66-98e5-65b01fa79d91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:05.726999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0ac091d4-2103-4c66-98e5-65b01fa79d91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:05.735569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0ac091d4-2103-4c66-98e5-65b01fa79d91 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.157210 Sep 13 20:01:05.736157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 207/396] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:05 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:05.771514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e39d42a1-f79c-4280-978d-c35aa1f92c0d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:05.772242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e39d42a1-f79c-4280-978d-c35aa1f92c0d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:05.779667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e39d42a1-f79c-4280-978d-c35aa1f92c0d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:05.780155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e39d42a1-f79c-4280-978d-c35aa1f92c0d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:05.780590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e39d42a1-f79c-4280-978d-c35aa1f92c0d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:05.781289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e39d42a1-f79c-4280-978d-c35aa1f92c0d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:05.781737 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e39d42a1-f79c-4280-978d-c35aa1f92c0d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:05.782155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e39d42a1-f79c-4280-978d-c35aa1f92c0d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:05.997707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e39d42a1-f79c-4280-978d-c35aa1f92c0d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:06.006425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e39d42a1-f79c-4280-978d-c35aa1f92c0d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:06.007883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e39d42a1-f79c-4280-978d-c35aa1f92c0d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:06.009040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e39d42a1-f79c-4280-978d-c35aa1f92c0d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1724 microversion: 2.20 time: 0.241833 Sep 13 20:01:06.022602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 190/397] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:06.362242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-feaec142-bb65-41a0-a00f-18a456ca402f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:06.363054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-feaec142-bb65-41a0-a00f-18a456ca402f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:06.369714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-feaec142-bb65-41a0-a00f-18a456ca402f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:06.370397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-feaec142-bb65-41a0-a00f-18a456ca402f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:06.371058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-feaec142-bb65-41a0-a00f-18a456ca402f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:06.371808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-feaec142-bb65-41a0-a00f-18a456ca402f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:06.372333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-feaec142-bb65-41a0-a00f-18a456ca402f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:06.372713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-feaec142-bb65-41a0-a00f-18a456ca402f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:06.457587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-feaec142-bb65-41a0-a00f-18a456ca402f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:06.462293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-222af246-573b-47d7-b639-fad63b1f2181 req-92fdb161-ec0b-4cd5-8dfe-9ec46454e97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8d05bf-2349-4766-9c4c-b10409c38b0b", "name": "network-vif-deleted", "tag": "45cbaa63-9248-4c2d-ab71-b1bd54dd2064"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:06.467257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-feaec142-bb65-41a0-a00f-18a456ca402f tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1462 microversion: 2.1 time: 0.109173 Sep 13 20:01:06.467961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 208/398] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:06 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1462 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:06.472887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-222af246-573b-47d7-b639-fad63b1f2181 req-92fdb161-ec0b-4cd5-8dfe-9ec46454e97a service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:06.473430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-222af246-573b-47d7-b639-fad63b1f2181 req-92fdb161-ec0b-4cd5-8dfe-9ec46454e97a service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:06.473866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-222af246-573b-47d7-b639-fad63b1f2181 req-92fdb161-ec0b-4cd5-8dfe-9ec46454e97a service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:06.485571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-222af246-573b-47d7-b639-fad63b1f2181 req-92fdb161-ec0b-4cd5-8dfe-9ec46454e97a service nova] Creating event network-vif-deleted:45cbaa63-9248-4c2d-ab71-b1bd54dd2064 for instance 8c8d05bf-2349-4766-9c4c-b10409c38b0b on hv-cinder-85427 Sep 13 20:01:06.491428 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-222af246-573b-47d7-b639-fad63b1f2181 req-92fdb161-ec0b-4cd5-8dfe-9ec46454e97a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033044 Sep 13 20:01:06.492645 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 191/399] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:01:06.758823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f49f0605-e293-453f-aa5e-aed323b28cea tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:06.759441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f49f0605-e293-453f-aa5e-aed323b28cea tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:06.766212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f49f0605-e293-453f-aa5e-aed323b28cea tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:06.766729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f49f0605-e293-453f-aa5e-aed323b28cea tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:06.767166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f49f0605-e293-453f-aa5e-aed323b28cea tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:06.767855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f49f0605-e293-453f-aa5e-aed323b28cea tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:06.768306 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f49f0605-e293-453f-aa5e-aed323b28cea tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:06.768731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f49f0605-e293-453f-aa5e-aed323b28cea tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:06.905795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f49f0605-e293-453f-aa5e-aed323b28cea tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:06.909240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:06.913859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f49f0605-e293-453f-aa5e-aed323b28cea tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.159155 Sep 13 20:01:06.914446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 209/400] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:06 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:07.037335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2ce5d9b7-31d2-4eb4-86e0-6758763c28c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:07.037884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2ce5d9b7-31d2-4eb4-86e0-6758763c28c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:07.045028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ce5d9b7-31d2-4eb4-86e0-6758763c28c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:07.045518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ce5d9b7-31d2-4eb4-86e0-6758763c28c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:07.045948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ce5d9b7-31d2-4eb4-86e0-6758763c28c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:07.046783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ce5d9b7-31d2-4eb4-86e0-6758763c28c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:07.047109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ce5d9b7-31d2-4eb4-86e0-6758763c28c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:07.047531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ce5d9b7-31d2-4eb4-86e0-6758763c28c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:07.190004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2ce5d9b7-31d2-4eb4-86e0-6758763c28c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:07.198441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2ce5d9b7-31d2-4eb4-86e0-6758763c28c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:07.199972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2ce5d9b7-31d2-4eb4-86e0-6758763c28c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:07.201343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2ce5d9b7-31d2-4eb4-86e0-6758763c28c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1745 microversion: 2.20 time: 0.168971 Sep 13 20:01:07.201982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 192/401] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:07.492719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-54c9179a-4155-4f09-8cbc-4b489e7bd3ed tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:07.493545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-54c9179a-4155-4f09-8cbc-4b489e7bd3ed tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:07.499764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54c9179a-4155-4f09-8cbc-4b489e7bd3ed tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:07.500244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54c9179a-4155-4f09-8cbc-4b489e7bd3ed tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:07.500668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54c9179a-4155-4f09-8cbc-4b489e7bd3ed tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:07.501454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54c9179a-4155-4f09-8cbc-4b489e7bd3ed tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:07.501899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54c9179a-4155-4f09-8cbc-4b489e7bd3ed tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:07.502310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54c9179a-4155-4f09-8cbc-4b489e7bd3ed tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:07.566602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-54c9179a-4155-4f09-8cbc-4b489e7bd3ed tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:07.574751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-54c9179a-4155-4f09-8cbc-4b489e7bd3ed tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1299 microversion: 2.1 time: 0.087008 Sep 13 20:01:07.575311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 210/402] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:07 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:07.937777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5eb4807f-0da7-4ad6-a46e-e0631368b177 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:07.938413 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5eb4807f-0da7-4ad6-a46e-e0631368b177 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:07.945085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5eb4807f-0da7-4ad6-a46e-e0631368b177 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:07.945570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5eb4807f-0da7-4ad6-a46e-e0631368b177 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:07.945998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5eb4807f-0da7-4ad6-a46e-e0631368b177 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:07.946732 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5eb4807f-0da7-4ad6-a46e-e0631368b177 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:07.947180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5eb4807f-0da7-4ad6-a46e-e0631368b177 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:07.947607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5eb4807f-0da7-4ad6-a46e-e0631368b177 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:08.084144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5eb4807f-0da7-4ad6-a46e-e0631368b177 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:08.092431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5eb4807f-0da7-4ad6-a46e-e0631368b177 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.158555 Sep 13 20:01:08.093136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 193/403] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:07 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:08.229922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2ee3a771-2f22-4ec3-85dc-bc2483f7133f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:08.230517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2ee3a771-2f22-4ec3-85dc-bc2483f7133f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:08.237579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2ee3a771-2f22-4ec3-85dc-bc2483f7133f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:08.238057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2ee3a771-2f22-4ec3-85dc-bc2483f7133f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:08.238530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2ee3a771-2f22-4ec3-85dc-bc2483f7133f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:08.239347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2ee3a771-2f22-4ec3-85dc-bc2483f7133f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:08.239797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2ee3a771-2f22-4ec3-85dc-bc2483f7133f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:08.240202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2ee3a771-2f22-4ec3-85dc-bc2483f7133f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:08.381902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2ee3a771-2f22-4ec3-85dc-bc2483f7133f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:08.390451 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2ee3a771-2f22-4ec3-85dc-bc2483f7133f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:08.391884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2ee3a771-2f22-4ec3-85dc-bc2483f7133f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:08.393092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2ee3a771-2f22-4ec3-85dc-bc2483f7133f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1745 microversion: 2.20 time: 0.167191 Sep 13 20:01:08.393617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 211/404] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:08.598577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d15fdb67-745b-40c1-bf19-811f0ec3e9c3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:08.599191 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d15fdb67-745b-40c1-bf19-811f0ec3e9c3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:08.605593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d15fdb67-745b-40c1-bf19-811f0ec3e9c3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:08.606072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d15fdb67-745b-40c1-bf19-811f0ec3e9c3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:08.606534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d15fdb67-745b-40c1-bf19-811f0ec3e9c3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:08.607230 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d15fdb67-745b-40c1-bf19-811f0ec3e9c3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:08.607674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d15fdb67-745b-40c1-bf19-811f0ec3e9c3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:08.608091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d15fdb67-745b-40c1-bf19-811f0ec3e9c3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:08.670927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d15fdb67-745b-40c1-bf19-811f0ec3e9c3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:08.683609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d15fdb67-745b-40c1-bf19-811f0ec3e9c3 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1299 microversion: 2.1 time: 0.088788 Sep 13 20:01:08.684500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 194/405] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:08 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:09.116367 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e789c7d6-6001-4e03-b8ef-1c30cf49a1db tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:09.116999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e789c7d6-6001-4e03-b8ef-1c30cf49a1db tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:09.123638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e789c7d6-6001-4e03-b8ef-1c30cf49a1db tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:09.124233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e789c7d6-6001-4e03-b8ef-1c30cf49a1db tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:09.124672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e789c7d6-6001-4e03-b8ef-1c30cf49a1db tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:09.125376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e789c7d6-6001-4e03-b8ef-1c30cf49a1db tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:09.125832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e789c7d6-6001-4e03-b8ef-1c30cf49a1db tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:09.126253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e789c7d6-6001-4e03-b8ef-1c30cf49a1db tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:09.264628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e789c7d6-6001-4e03-b8ef-1c30cf49a1db tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:09.273057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e789c7d6-6001-4e03-b8ef-1c30cf49a1db tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.160773 Sep 13 20:01:09.273600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 212/406] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:09 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:09.418497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a8b23676-70fe-4903-afc3-68a150c2cd0a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:09.419107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a8b23676-70fe-4903-afc3-68a150c2cd0a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:09.426144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8b23676-70fe-4903-afc3-68a150c2cd0a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:09.426673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8b23676-70fe-4903-afc3-68a150c2cd0a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:09.427117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8b23676-70fe-4903-afc3-68a150c2cd0a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:09.427826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8b23676-70fe-4903-afc3-68a150c2cd0a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:09.428275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8b23676-70fe-4903-afc3-68a150c2cd0a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:09.428696 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8b23676-70fe-4903-afc3-68a150c2cd0a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:09.571211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a8b23676-70fe-4903-afc3-68a150c2cd0a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:09.579792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a8b23676-70fe-4903-afc3-68a150c2cd0a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:09.581236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a8b23676-70fe-4903-afc3-68a150c2cd0a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:09.582440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a8b23676-70fe-4903-afc3-68a150c2cd0a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1745 microversion: 2.20 time: 0.167980 Sep 13 20:01:09.583031 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 195/407] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:09.710193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7d918620-aabb-4dd4-9a10-c3a130022248 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:09.711076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7d918620-aabb-4dd4-9a10-c3a130022248 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:09.717463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d918620-aabb-4dd4-9a10-c3a130022248 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:09.717944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d918620-aabb-4dd4-9a10-c3a130022248 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:09.718389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d918620-aabb-4dd4-9a10-c3a130022248 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:09.719472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d918620-aabb-4dd4-9a10-c3a130022248 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:09.720201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d918620-aabb-4dd4-9a10-c3a130022248 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:09.720902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d918620-aabb-4dd4-9a10-c3a130022248 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:09.784998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7d918620-aabb-4dd4-9a10-c3a130022248 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:09.793211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7d918620-aabb-4dd4-9a10-c3a130022248 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1299 microversion: 2.1 time: 0.087143 Sep 13 20:01:09.793782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 213/408] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:09 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:10.296652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-06511f68-2449-4ace-a8d3-b8499ac1728d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:10.297285 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-06511f68-2449-4ace-a8d3-b8499ac1728d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:10.303826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06511f68-2449-4ace-a8d3-b8499ac1728d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:10.304308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06511f68-2449-4ace-a8d3-b8499ac1728d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:10.304748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06511f68-2449-4ace-a8d3-b8499ac1728d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:10.305439 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06511f68-2449-4ace-a8d3-b8499ac1728d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:10.305885 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06511f68-2449-4ace-a8d3-b8499ac1728d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:10.306316 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06511f68-2449-4ace-a8d3-b8499ac1728d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:10.445812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-06511f68-2449-4ace-a8d3-b8499ac1728d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:10.453830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-06511f68-2449-4ace-a8d3-b8499ac1728d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.161241 Sep 13 20:01:10.454463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 196/409] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:10 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:10.608501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d85f1c87-1af0-4c57-8bfb-af79d4500447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:10.609109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d85f1c87-1af0-4c57-8bfb-af79d4500447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:10.616211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d85f1c87-1af0-4c57-8bfb-af79d4500447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:10.616692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d85f1c87-1af0-4c57-8bfb-af79d4500447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:10.617117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d85f1c87-1af0-4c57-8bfb-af79d4500447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:10.617813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d85f1c87-1af0-4c57-8bfb-af79d4500447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:10.618259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d85f1c87-1af0-4c57-8bfb-af79d4500447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:10.618724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d85f1c87-1af0-4c57-8bfb-af79d4500447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:10.771438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d85f1c87-1af0-4c57-8bfb-af79d4500447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:10.779754 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d85f1c87-1af0-4c57-8bfb-af79d4500447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:10.781165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d85f1c87-1af0-4c57-8bfb-af79d4500447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:10.782291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d85f1c87-1af0-4c57-8bfb-af79d4500447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1745 microversion: 2.20 time: 0.177816 Sep 13 20:01:10.782876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 214/410] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:10.817621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fb5eb98f-3697-412f-9563-8487dfaba4d8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:10.818512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fb5eb98f-3697-412f-9563-8487dfaba4d8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:10.827696 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb5eb98f-3697-412f-9563-8487dfaba4d8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:10.828189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb5eb98f-3697-412f-9563-8487dfaba4d8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:10.828620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb5eb98f-3697-412f-9563-8487dfaba4d8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:10.829358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb5eb98f-3697-412f-9563-8487dfaba4d8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:10.829837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb5eb98f-3697-412f-9563-8487dfaba4d8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:10.830254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb5eb98f-3697-412f-9563-8487dfaba4d8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:10.901384 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fb5eb98f-3697-412f-9563-8487dfaba4d8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:10.909883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fb5eb98f-3697-412f-9563-8487dfaba4d8 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1299 microversion: 2.1 time: 0.096738 Sep 13 20:01:10.910310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 197/411] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:10 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:11.479439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9b665d48-0d7c-45dd-a08d-427a14f27150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:11.480047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9b665d48-0d7c-45dd-a08d-427a14f27150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:11.486584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b665d48-0d7c-45dd-a08d-427a14f27150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:11.487065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b665d48-0d7c-45dd-a08d-427a14f27150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:11.487493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b665d48-0d7c-45dd-a08d-427a14f27150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:11.488181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b665d48-0d7c-45dd-a08d-427a14f27150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:11.488612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b665d48-0d7c-45dd-a08d-427a14f27150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:11.489027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b665d48-0d7c-45dd-a08d-427a14f27150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:11.625889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9b665d48-0d7c-45dd-a08d-427a14f27150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:11.634096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9b665d48-0d7c-45dd-a08d-427a14f27150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.158638 Sep 13 20:01:11.634903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 215/412] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:11 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:11.807658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c3bf4f95-6b1b-4004-9a1a-8bf9af0b5a39 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:11.808256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c3bf4f95-6b1b-4004-9a1a-8bf9af0b5a39 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:11.815355 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3bf4f95-6b1b-4004-9a1a-8bf9af0b5a39 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:11.815846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3bf4f95-6b1b-4004-9a1a-8bf9af0b5a39 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:11.816966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3bf4f95-6b1b-4004-9a1a-8bf9af0b5a39 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:11.817669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3bf4f95-6b1b-4004-9a1a-8bf9af0b5a39 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:11.818130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3bf4f95-6b1b-4004-9a1a-8bf9af0b5a39 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:11.818645 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3bf4f95-6b1b-4004-9a1a-8bf9af0b5a39 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:11.933677 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:11.934404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:11.941477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:11.941972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:11.942426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:11.943478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:11.943628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:11.944117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:11.970888 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c3bf4f95-6b1b-4004-9a1a-8bf9af0b5a39 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:11.986621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c3bf4f95-6b1b-4004-9a1a-8bf9af0b5a39 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:11.988175 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c3bf4f95-6b1b-4004-9a1a-8bf9af0b5a39 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:11.989353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c3bf4f95-6b1b-4004-9a1a-8bf9af0b5a39 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1745 microversion: 2.20 time: 0.185655 Sep 13 20:01:11.989897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 198/413] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:11 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1745 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:11.995085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:11.995563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:11.996179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:11.996951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lazy-loading 'fault' on Instance uuid 8c8d05bf-2349-4766-9c4c-b10409c38b0b {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:01:12.042785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:12.061476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-244bb449-bb0e-4e90-8086-0b09d73bb85b tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1304 microversion: 2.1 time: 0.132199 Sep 13 20:01:12.063330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 216/414] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:11 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:12.657397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-76606f2e-c73c-4092-9b5b-099fc699d8c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:12.658069 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-76606f2e-c73c-4092-9b5b-099fc699d8c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:12.664331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-76606f2e-c73c-4092-9b5b-099fc699d8c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:12.664805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-76606f2e-c73c-4092-9b5b-099fc699d8c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:12.665232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-76606f2e-c73c-4092-9b5b-099fc699d8c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:12.666130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-76606f2e-c73c-4092-9b5b-099fc699d8c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:12.666611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-76606f2e-c73c-4092-9b5b-099fc699d8c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:12.667029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-76606f2e-c73c-4092-9b5b-099fc699d8c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:12.816533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-76606f2e-c73c-4092-9b5b-099fc699d8c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:12.825547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-76606f2e-c73c-4092-9b5b-099fc699d8c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1501 microversion: 2.1 time: 0.172712 Sep 13 20:01:12.826136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 199/415] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:12 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1501 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:12.849936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b3f13754-f12e-4b4f-93dd-9e59c2102a7d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa4ff0e4-b730-46e2-9946-4f4350c587b9"}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:12.852614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b3f13754-f12e-4b4f-93dd-9e59c2102a7d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:12.859869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3f13754-f12e-4b4f-93dd-9e59c2102a7d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:12.860341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3f13754-f12e-4b4f-93dd-9e59c2102a7d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:12.860763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3f13754-f12e-4b4f-93dd-9e59c2102a7d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:12.861443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3f13754-f12e-4b4f-93dd-9e59c2102a7d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:12.861890 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3f13754-f12e-4b4f-93dd-9e59c2102a7d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:12.862297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3f13754-f12e-4b4f-93dd-9e59c2102a7d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:12.887042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-b3f13754-f12e-4b4f-93dd-9e59c2102a7d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] HTTP exception thrown: Cannot 'attach_volume' instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 while it is in vm_state rescued Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b3f13754-f12e-4b4f-93dd-9e59c2102a7d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Request method failure captured: Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: POST /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69/os-volume_attachments HTTP/1.1 Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 74 Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIODjpin5P12LMyIUegGlCoSGVMfXGu2Nxs3IFiIhuiJZDZclH8lXbMQoqdDqy_PWYg2k7m4QoAAHFfGmD7eQR3BJfmhy27yZk6YpUDgJpcQG4tV_vMnNwrcOcaFgXOAFqaDFEJ6wxipdPyiKiC0SUxZ_e28cOVQZnL1BQqEyYD6qS0Q Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: 23873d995d564c0388a4649e57821c69 Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1939790678 Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:01:12.888757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:01:12.890430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/23873d995d564c0388a4649e57821c69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_23873d995d564c0388a4649e57821c69", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/23873d995d564c0388a4649e57821c69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/23873d995d564c0388a4649e57821c69"}]}] Sep 13 20:01:12.890430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1939790678 Sep 13 20:01:12.890430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: 23873d995d564c0388a4649e57821c69 Sep 13 20:01:12.890430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1939790678 Sep 13 20:01:12.890430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-ServerRescueNegativeTestJSON-1939790678-project Sep 13 20:01:12.890430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:01:12.890430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:01:12.890430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 2577fc11946c4597857187ae7b464fe7 Sep 13 20:01:12.890430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1939790678-project Sep 13 20:01:12.890430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Sep 13 20:01:12.890430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {"volumeAttachment": {"volumeId": "fa4ff0e4-b730-46e2-9946-4f4350c587b9"}} Sep 13 20:01:12.890430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Cannot 'attach_volume' instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 while it is in vm_state rescued Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'server_id': '1188b80c-75f7-4d0e-a43b-4f1285e63a69', 'body': {'volumeAttachment': {'volumeId': 'fa4ff0e4-b730-46e2-9946-4f4350c587b9'}}} Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:12.891435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 while it is in vm_state rescued Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:12.892839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:12.894436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:12.894436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:12.894436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 while it is in vm_state rescued Sep 13 20:01:12.894436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:01:12.894436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b3f13754-f12e-4b4f-93dd-9e59c2102a7d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Returning 409 to user: Cannot 'attach_volume' instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 while it is in vm_state rescued {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:12.894436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b3f13754-f12e-4b4f-93dd-9e59c2102a7d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "POST /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044486 Sep 13 20:01:12.894436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 217/416] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 13 20:01:12 2022] POST /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 20:01:12.900313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-212e8c48-1d45-4893-9912-4b22bf1b70ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:12.900846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-212e8c48-1d45-4893-9912-4b22bf1b70ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:12.907363 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-212e8c48-1d45-4893-9912-4b22bf1b70ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:12.907848 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-212e8c48-1d45-4893-9912-4b22bf1b70ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:12.908283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-212e8c48-1d45-4893-9912-4b22bf1b70ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:12.908977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-212e8c48-1d45-4893-9912-4b22bf1b70ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:12.909425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-212e8c48-1d45-4893-9912-4b22bf1b70ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:12.909845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-212e8c48-1d45-4893-9912-4b22bf1b70ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:12.980152 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-212e8c48-1d45-4893-9912-4b22bf1b70ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "POST /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69/action" status: 202 len: 0 microversion: 2.1 time: 0.083846 Sep 13 20:01:12.980783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 200/417] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 13 20:01:12 2022] POST /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 20:01:12.989303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a0a26abc-1bb0-4917-9bf5-c11cbf85ca71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:12.989909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a0a26abc-1bb0-4917-9bf5-c11cbf85ca71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:12.996400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0a26abc-1bb0-4917-9bf5-c11cbf85ca71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:12.996886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0a26abc-1bb0-4917-9bf5-c11cbf85ca71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:12.997316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0a26abc-1bb0-4917-9bf5-c11cbf85ca71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:12.998015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0a26abc-1bb0-4917-9bf5-c11cbf85ca71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:12.998493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0a26abc-1bb0-4917-9bf5-c11cbf85ca71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:12.998969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0a26abc-1bb0-4917-9bf5-c11cbf85ca71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:13.017721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a62c074d-c76f-4580-b9c0-9c9f69f67150 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:13.018552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a62c074d-c76f-4580-b9c0-9c9f69f67150 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:13.025546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a62c074d-c76f-4580-b9c0-9c9f69f67150 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:13.026224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a62c074d-c76f-4580-b9c0-9c9f69f67150 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:13.026689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a62c074d-c76f-4580-b9c0-9c9f69f67150 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:13.027390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a62c074d-c76f-4580-b9c0-9c9f69f67150 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:13.027838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a62c074d-c76f-4580-b9c0-9c9f69f67150 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:13.028261 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a62c074d-c76f-4580-b9c0-9c9f69f67150 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:13.176944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a0a26abc-1bb0-4917-9bf5-c11cbf85ca71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:13.190834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a0a26abc-1bb0-4917-9bf5-c11cbf85ca71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1509 microversion: 2.1 time: 0.202823 Sep 13 20:01:13.193014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 218/418] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:12 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:13.198251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:13.198985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:13.205706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:13.206458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:13.207126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:13.208033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:13.208751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:13.209986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:13.251131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:13.251624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:13.252112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:13.252565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lazy-loading 'fault' on Instance uuid 8c8d05bf-2349-4766-9c4c-b10409c38b0b {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:01:13.266010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a62c074d-c76f-4580-b9c0-9c9f69f67150 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:13.276701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a62c074d-c76f-4580-b9c0-9c9f69f67150 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:13.278589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a62c074d-c76f-4580-b9c0-9c9f69f67150 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:13.279881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a62c074d-c76f-4580-b9c0-9c9f69f67150 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.266840 Sep 13 20:01:13.280439 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 201/419] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:13.319902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b22eed68ce4d879de69b94084f1fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a747512840e14dfca8bf507e70623fa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:13.328327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-375961e4-e9af-4f8a-82a4-341b9cf24da6 tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 200 len: 1304 microversion: 2.1 time: 0.134180 Sep 13 20:01:13.328895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 219/420] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:13 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:14.218241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9c11576a-5158-46ef-ba6c-f52827db5645 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:14.220220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9c11576a-5158-46ef-ba6c-f52827db5645 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:14.229813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9c11576a-5158-46ef-ba6c-f52827db5645 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:14.230895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9c11576a-5158-46ef-ba6c-f52827db5645 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:14.231553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9c11576a-5158-46ef-ba6c-f52827db5645 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:14.232460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9c11576a-5158-46ef-ba6c-f52827db5645 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:14.233101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9c11576a-5158-46ef-ba6c-f52827db5645 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:14.233693 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9c11576a-5158-46ef-ba6c-f52827db5645 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:14.305657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-29cdea8d-1c17-4070-a872-495323faa5c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:14.307081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-29cdea8d-1c17-4070-a872-495323faa5c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:14.320859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29cdea8d-1c17-4070-a872-495323faa5c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:14.327534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29cdea8d-1c17-4070-a872-495323faa5c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:14.328465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29cdea8d-1c17-4070-a872-495323faa5c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:14.329309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29cdea8d-1c17-4070-a872-495323faa5c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:14.332975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29cdea8d-1c17-4070-a872-495323faa5c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:14.333656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29cdea8d-1c17-4070-a872-495323faa5c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:14.414903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9c11576a-5158-46ef-ba6c-f52827db5645 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:14.425335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9c11576a-5158-46ef-ba6c-f52827db5645 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1509 microversion: 2.1 time: 0.212147 Sep 13 20:01:14.425997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 202/421] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:14 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:14.432141 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-81835cfe-777d-4f35-bb1c-c070b52644cf tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:14.432872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-81835cfe-777d-4f35-bb1c-c070b52644cf tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] [instance: 8c8d05bf-2349-4766-9c4c-b10409c38b0b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:14.438981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-81835cfe-777d-4f35-bb1c-c070b52644cf tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:14.439700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-81835cfe-777d-4f35-bb1c-c070b52644cf tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:14.440344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-81835cfe-777d-4f35-bb1c-c070b52644cf tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:14.441191 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-81835cfe-777d-4f35-bb1c-c070b52644cf tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:14.441811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-81835cfe-777d-4f35-bb1c-c070b52644cf tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:14.442522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-81835cfe-777d-4f35-bb1c-c070b52644cf tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:14.459552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-81835cfe-777d-4f35-bb1c-c070b52644cf tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] HTTP exception thrown: Instance 8c8d05bf-2349-4766-9c4c-b10409c38b0b could not be found. Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-81835cfe-777d-4f35-bb1c-c070b52644cf tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Request method failure captured: Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b HTTP/1.1 Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOEohyHLfPP6O0c95hLUCucf2y0n-jOjeSY33-Cokjo4LF77zsheZh3n28MbEoByY2aYdU2kQLdd9PX8Nx-pIHLFKH0m_rjEjP1hE0VtOcRHXk5F3S7Abh29wqtrqLw1IZjnT0YK5srehHhIAtqOHF_0xE4j52Wm_3nfh_VDO-TLMLw Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: a747512840e14dfca8bf507e70623fa5 Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-VolumesActionsTest-2143939136 Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:01:14.462494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:01:14.463733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a747512840e14dfca8bf507e70623fa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a747512840e14dfca8bf507e70623fa5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a747512840e14dfca8bf507e70623fa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a747512840e14dfca8bf507e70623fa5"}]}] Sep 13 20:01:14.463733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-VolumesActionsTest-2143939136 Sep 13 20:01:14.463733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: a747512840e14dfca8bf507e70623fa5 Sep 13 20:01:14.463733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-VolumesActionsTest-2143939136 Sep 13 20:01:14.463733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-VolumesActionsTest-2143939136-project Sep 13 20:01:14.463733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:01:14.463733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:01:14.463733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: b5b22eed68ce4d879de69b94084f1fb8 Sep 13 20:01:14.463733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-VolumesActionsTest-2143939136-project Sep 13 20:01:14.463733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:01:14.463733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 8c8d05bf-2349-4766-9c4c-b10409c38b0b could not be found. Sep 13 20:01:14.463733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '8c8d05bf-2349-4766-9c4c-b10409c38b0b'} Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c8d05bf-2349-4766-9c4c-b10409c38b0b could not be found. Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:14.464415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c8d05bf-2349-4766-9c4c-b10409c38b0b could not be found. Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c8d05bf-2349-4766-9c4c-b10409c38b0b could not be found. Sep 13 20:01:14.465559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:01:14.467829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-81835cfe-777d-4f35-bb1c-c070b52644cf tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] Returning 404 to user: Instance 8c8d05bf-2349-4766-9c4c-b10409c38b0b could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:14.468752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-81835cfe-777d-4f35-bb1c-c070b52644cf tempest-VolumesActionsTest-2143939136 tempest-VolumesActionsTest-2143939136-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b" status: 404 len: 111 microversion: 2.1 time: 0.040379 Sep 13 20:01:14.469617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 203/422] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:14 2022] GET /compute/v2.1/servers/8c8d05bf-2349-4766-9c4c-b10409c38b0b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:01:14.648557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-29cdea8d-1c17-4070-a872-495323faa5c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:14.675889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-29cdea8d-1c17-4070-a872-495323faa5c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:14.686723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-29cdea8d-1c17-4070-a872-495323faa5c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:14.688134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-29cdea8d-1c17-4070-a872-495323faa5c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.386519 Sep 13 20:01:14.689340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 220/423] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:15.448621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-43e67aac-3207-4342-9d5d-11383fe08dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:15.449126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-43e67aac-3207-4342-9d5d-11383fe08dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:15.460658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43e67aac-3207-4342-9d5d-11383fe08dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:15.461419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43e67aac-3207-4342-9d5d-11383fe08dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:15.462067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43e67aac-3207-4342-9d5d-11383fe08dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:15.463180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43e67aac-3207-4342-9d5d-11383fe08dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:15.463850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43e67aac-3207-4342-9d5d-11383fe08dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:15.464466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43e67aac-3207-4342-9d5d-11383fe08dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:15.488623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fa3dca93-8ac1-4c5e-9272-2802e8566661 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:15.489188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fa3dca93-8ac1-4c5e-9272-2802e8566661 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:15.496472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:15.500242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa3dca93-8ac1-4c5e-9272-2802e8566661 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:15.500809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa3dca93-8ac1-4c5e-9272-2802e8566661 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:15.501445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa3dca93-8ac1-4c5e-9272-2802e8566661 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:15.502212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa3dca93-8ac1-4c5e-9272-2802e8566661 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:15.506617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa3dca93-8ac1-4c5e-9272-2802e8566661 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:15.506617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa3dca93-8ac1-4c5e-9272-2802e8566661 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:15.717832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-fa3dca93-8ac1-4c5e-9272-2802e8566661 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lazy-loading 'services' on Instance uuid ed156643-30e4-4158-b44b-ff8b7b4980e1 {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:01:15.867442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-43e67aac-3207-4342-9d5d-11383fe08dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:15.878486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-43e67aac-3207-4342-9d5d-11383fe08dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1509 microversion: 2.1 time: 0.433013 Sep 13 20:01:15.879593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 204/424] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:15 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1509 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:15.884947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-833aac97-f028-446d-88de-791f1ed7ff54 req-d2d3a334-1f94-498b-820b-73dbdd7b3e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0decb4-2f46-4f2f-860f-e8ca277f7080", "name": "network-vif-plugged", "status": "completed", "tag": "2f770f4f-2f9f-4723-a236-5204e36adea7"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:15.899120 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-833aac97-f028-446d-88de-791f1ed7ff54 req-d2d3a334-1f94-498b-820b-73dbdd7b3e9f service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:15.899934 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-833aac97-f028-446d-88de-791f1ed7ff54 req-d2d3a334-1f94-498b-820b-73dbdd7b3e9f service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:15.900601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-833aac97-f028-446d-88de-791f1ed7ff54 req-d2d3a334-1f94-498b-820b-73dbdd7b3e9f service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:15.916779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-833aac97-f028-446d-88de-791f1ed7ff54 req-d2d3a334-1f94-498b-820b-73dbdd7b3e9f service nova] Creating event network-vif-plugged:2f770f4f-2f9f-4723-a236-5204e36adea7 for instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 on hv-cinder-85427 Sep 13 20:01:15.923395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-833aac97-f028-446d-88de-791f1ed7ff54 req-d2d3a334-1f94-498b-820b-73dbdd7b3e9f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042356 Sep 13 20:01:15.925085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 205/425] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:01:15.933291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e7bedc5c-65b2-4c68-af35-8b8c465db330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:15.934269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e7bedc5c-65b2-4c68-af35-8b8c465db330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:15.938823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fa3dca93-8ac1-4c5e-9272-2802e8566661 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1/os-volume_attachments/c5860af2-1cbd-46b5-b429-4664abbae2d1" status: 202 len: 0 microversion: 2.1 time: 0.453961 Sep 13 20:01:15.943998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7bedc5c-65b2-4c68-af35-8b8c465db330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:15.944219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 221/426] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 13 20:01:15 2022] DELETE /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1/os-volume_attachments/c5860af2-1cbd-46b5-b429-4664abbae2d1 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 20:01:15.944718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7bedc5c-65b2-4c68-af35-8b8c465db330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:15.945257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7bedc5c-65b2-4c68-af35-8b8c465db330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:15.946276 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7bedc5c-65b2-4c68-af35-8b8c465db330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:15.947008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7bedc5c-65b2-4c68-af35-8b8c465db330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:15.947528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7bedc5c-65b2-4c68-af35-8b8c465db330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:16.160823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e7bedc5c-65b2-4c68-af35-8b8c465db330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:16.179829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e7bedc5c-65b2-4c68-af35-8b8c465db330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:16.181281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e7bedc5c-65b2-4c68-af35-8b8c465db330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:16.182482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e7bedc5c-65b2-4c68-af35-8b8c465db330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.255011 Sep 13 20:01:16.183046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 206/427] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:16.907585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e61e5f47-d869-4aa5-9d1d-66a9b4e2b4cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:16.908309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e61e5f47-d869-4aa5-9d1d-66a9b4e2b4cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:16.919318 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e61e5f47-d869-4aa5-9d1d-66a9b4e2b4cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:16.920125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e61e5f47-d869-4aa5-9d1d-66a9b4e2b4cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:16.920717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e61e5f47-d869-4aa5-9d1d-66a9b4e2b4cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:16.921661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e61e5f47-d869-4aa5-9d1d-66a9b4e2b4cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:16.922394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e61e5f47-d869-4aa5-9d1d-66a9b4e2b4cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:16.923134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e61e5f47-d869-4aa5-9d1d-66a9b4e2b4cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:17.177076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e61e5f47-d869-4aa5-9d1d-66a9b4e2b4cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:17.190312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e61e5f47-d869-4aa5-9d1d-66a9b4e2b4cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1509 microversion: 2.1 time: 0.290562 Sep 13 20:01:17.202818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 222/428] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:16 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:17.210524 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5ffaf42e-85a0-442a-bf5e-eb6f9ffc362f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:17.211327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5ffaf42e-85a0-442a-bf5e-eb6f9ffc362f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:17.221417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5ffaf42e-85a0-442a-bf5e-eb6f9ffc362f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:17.222086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5ffaf42e-85a0-442a-bf5e-eb6f9ffc362f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:17.222520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5ffaf42e-85a0-442a-bf5e-eb6f9ffc362f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:17.223456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5ffaf42e-85a0-442a-bf5e-eb6f9ffc362f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:17.224092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5ffaf42e-85a0-442a-bf5e-eb6f9ffc362f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:17.224768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5ffaf42e-85a0-442a-bf5e-eb6f9ffc362f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:17.709694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5ffaf42e-85a0-442a-bf5e-eb6f9ffc362f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:17.734087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5ffaf42e-85a0-442a-bf5e-eb6f9ffc362f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:17.767246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5ffaf42e-85a0-442a-bf5e-eb6f9ffc362f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:17.769791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5ffaf42e-85a0-442a-bf5e-eb6f9ffc362f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.564530 Sep 13 20:01:17.794877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 207/429] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:17 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:18.217846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b4aac436-4958-4cea-b47c-1f8ca9c36701 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:18.218710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b4aac436-4958-4cea-b47c-1f8ca9c36701 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:18.227828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4aac436-4958-4cea-b47c-1f8ca9c36701 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:18.228503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4aac436-4958-4cea-b47c-1f8ca9c36701 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:18.228942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4aac436-4958-4cea-b47c-1f8ca9c36701 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:18.229651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4aac436-4958-4cea-b47c-1f8ca9c36701 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:18.230098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4aac436-4958-4cea-b47c-1f8ca9c36701 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:18.230563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4aac436-4958-4cea-b47c-1f8ca9c36701 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:18.433971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b4aac436-4958-4cea-b47c-1f8ca9c36701 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:18.445340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b4aac436-4958-4cea-b47c-1f8ca9c36701 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1509 microversion: 2.1 time: 0.233270 Sep 13 20:01:18.463625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 223/430] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:18 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:18.805128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c4ab835d-adef-49de-a715-6a506e637393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:18.807700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c4ab835d-adef-49de-a715-6a506e637393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:18.818621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4ab835d-adef-49de-a715-6a506e637393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:18.819396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4ab835d-adef-49de-a715-6a506e637393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:18.819987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4ab835d-adef-49de-a715-6a506e637393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:18.820872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4ab835d-adef-49de-a715-6a506e637393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:18.821490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4ab835d-adef-49de-a715-6a506e637393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:18.822234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4ab835d-adef-49de-a715-6a506e637393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:19.117193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c4ab835d-adef-49de-a715-6a506e637393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:19.128588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c4ab835d-adef-49de-a715-6a506e637393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:19.130021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c4ab835d-adef-49de-a715-6a506e637393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:19.143917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c4ab835d-adef-49de-a715-6a506e637393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.344361 Sep 13 20:01:19.144869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 208/431] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:19.473573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5f4860c7-221f-411c-a20f-0984dc45dd78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:19.474215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5f4860c7-221f-411c-a20f-0984dc45dd78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:19.480894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f4860c7-221f-411c-a20f-0984dc45dd78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:19.481467 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f4860c7-221f-411c-a20f-0984dc45dd78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:19.481895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f4860c7-221f-411c-a20f-0984dc45dd78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:19.482685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f4860c7-221f-411c-a20f-0984dc45dd78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:19.483149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f4860c7-221f-411c-a20f-0984dc45dd78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:19.483569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f4860c7-221f-411c-a20f-0984dc45dd78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:19.713580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5f4860c7-221f-411c-a20f-0984dc45dd78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:19.722396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5f4860c7-221f-411c-a20f-0984dc45dd78 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1515 microversion: 2.1 time: 0.252960 Sep 13 20:01:19.725690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 224/432] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:19 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:20.172997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ec77c4b4-7aa6-4c74-8aeb-f720e5d29c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:20.173601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ec77c4b4-7aa6-4c74-8aeb-f720e5d29c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:20.189226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec77c4b4-7aa6-4c74-8aeb-f720e5d29c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:20.190552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec77c4b4-7aa6-4c74-8aeb-f720e5d29c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:20.191157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec77c4b4-7aa6-4c74-8aeb-f720e5d29c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:20.192044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec77c4b4-7aa6-4c74-8aeb-f720e5d29c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:20.192685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec77c4b4-7aa6-4c74-8aeb-f720e5d29c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:20.198342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec77c4b4-7aa6-4c74-8aeb-f720e5d29c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:20.741058 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ec77c4b4-7aa6-4c74-8aeb-f720e5d29c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:20.751074 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ec77c4b4-7aa6-4c74-8aeb-f720e5d29c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:20.765112 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ec77c4b4-7aa6-4c74-8aeb-f720e5d29c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:20.783474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ec77c4b4-7aa6-4c74-8aeb-f720e5d29c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.601972 Sep 13 20:01:20.784322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 209/433] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:21.500956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4010d0cd-7e2a-47e0-9093-b90ad6bf1932 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Action: 'create', calling method: .version_select at 0x7f98464c40d0>, body: {"keypair": {"name": "tempest-keypair-1161829303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoCVWPgRGENQoG3HSRKSO5o++REvbyOtNlItoiMuFvEhNPbkQNcktfpUMIYgsWl4uqOiYPj/eYUcITSdmzT2vMu9LPTgbuMwdaT+Nw+xgAUpGkhp3n06bWWioVXitNDYg=="}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:21.508813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=76 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:21.540367 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-4010d0cd-7e2a-47e0-9093-b90ad6bf1932 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Getting quotas for project 23873d995d564c0388a4649e57821c69. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:01:21.557770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-4010d0cd-7e2a-47e0-9093-b90ad6bf1932 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Getting quotas for user 2577fc11946c4597857187ae7b464fe7 and project 23873d995d564c0388a4649e57821c69. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:01:21.605438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4010d0cd-7e2a-47e0-9093-b90ad6bf1932 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108320 Sep 13 20:01:21.606416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 225/434] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 13 20:01:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:01:21.823046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a2a6e172-221b-4cd9-8fe8-801bf7bb5797 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:21.823806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a2a6e172-221b-4cd9-8fe8-801bf7bb5797 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:21.824230 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7acfeeac-d50b-4932-8f5a-b3d6eb0f4716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:21.825061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7acfeeac-d50b-4932-8f5a-b3d6eb0f4716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:21.834202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2a6e172-221b-4cd9-8fe8-801bf7bb5797 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:21.840898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2a6e172-221b-4cd9-8fe8-801bf7bb5797 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:21.841595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2a6e172-221b-4cd9-8fe8-801bf7bb5797 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:21.845417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7acfeeac-d50b-4932-8f5a-b3d6eb0f4716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:21.846766 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7acfeeac-d50b-4932-8f5a-b3d6eb0f4716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:21.855794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2a6e172-221b-4cd9-8fe8-801bf7bb5797 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:21.856574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2a6e172-221b-4cd9-8fe8-801bf7bb5797 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:21.858154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2a6e172-221b-4cd9-8fe8-801bf7bb5797 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:21.860043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7acfeeac-d50b-4932-8f5a-b3d6eb0f4716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:21.862950 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7acfeeac-d50b-4932-8f5a-b3d6eb0f4716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:21.863731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7acfeeac-d50b-4932-8f5a-b3d6eb0f4716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:21.864383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7acfeeac-d50b-4932-8f5a-b3d6eb0f4716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:21.902665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:21.931192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a2a6e172-221b-4cd9-8fe8-801bf7bb5797 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Going to try to terminate instance {{(pid=120844) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:01:22.188914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a2a6e172-221b-4cd9-8fe8-801bf7bb5797 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 204 len: 0 microversion: 2.1 time: 0.361687 Sep 13 20:01:22.199322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 226/435] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:01:21 2022] DELETE /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:01:22.233892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-73d2c39f-c9bc-444d-9c6d-5d795d4ce1b3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:22.235002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-73d2c39f-c9bc-444d-9c6d-5d795d4ce1b3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:22.253087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73d2c39f-c9bc-444d-9c6d-5d795d4ce1b3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:22.254015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73d2c39f-c9bc-444d-9c6d-5d795d4ce1b3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:22.254882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73d2c39f-c9bc-444d-9c6d-5d795d4ce1b3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:22.258686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73d2c39f-c9bc-444d-9c6d-5d795d4ce1b3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:22.259479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73d2c39f-c9bc-444d-9c6d-5d795d4ce1b3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:22.260125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73d2c39f-c9bc-444d-9c6d-5d795d4ce1b3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:22.359500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7acfeeac-d50b-4932-8f5a-b3d6eb0f4716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:22.379213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7acfeeac-d50b-4932-8f5a-b3d6eb0f4716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:22.384243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7acfeeac-d50b-4932-8f5a-b3d6eb0f4716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:22.386409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7acfeeac-d50b-4932-8f5a-b3d6eb0f4716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.566877 Sep 13 20:01:22.390980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 210/436] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:22.709298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-73d2c39f-c9bc-444d-9c6d-5d795d4ce1b3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:22.722176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-73d2c39f-c9bc-444d-9c6d-5d795d4ce1b3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1512 microversion: 2.1 time: 0.505090 Sep 13 20:01:22.725238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 227/437] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:22 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1512 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:23.420554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a219c540-d287-4301-b381-078079c4df48 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:23.421977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a219c540-d287-4301-b381-078079c4df48 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:23.433146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=76 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:23.436309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a219c540-d287-4301-b381-078079c4df48 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:23.447769 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a219c540-d287-4301-b381-078079c4df48 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:23.451449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a219c540-d287-4301-b381-078079c4df48 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:23.466465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a219c540-d287-4301-b381-078079c4df48 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:23.469196 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a219c540-d287-4301-b381-078079c4df48 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:23.469887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a219c540-d287-4301-b381-078079c4df48 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:23.757083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0edf5df8-a65e-4902-affa-d6040e7fb27a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:23.762887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0edf5df8-a65e-4902-affa-d6040e7fb27a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:23.790588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0edf5df8-a65e-4902-affa-d6040e7fb27a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:23.792240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0edf5df8-a65e-4902-affa-d6040e7fb27a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:23.792845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0edf5df8-a65e-4902-affa-d6040e7fb27a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:23.795161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0edf5df8-a65e-4902-affa-d6040e7fb27a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:23.795898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0edf5df8-a65e-4902-affa-d6040e7fb27a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:23.798298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0edf5df8-a65e-4902-affa-d6040e7fb27a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:24.230518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0edf5df8-a65e-4902-affa-d6040e7fb27a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:24.245780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a219c540-d287-4301-b381-078079c4df48 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:24.248086 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0edf5df8-a65e-4902-affa-d6040e7fb27a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1512 microversion: 2.1 time: 0.498822 Sep 13 20:01:24.250440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 228/438] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:23 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1512 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:24.286556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a219c540-d287-4301-b381-078079c4df48 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:24.289489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a219c540-d287-4301-b381-078079c4df48 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:24.297136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a219c540-d287-4301-b381-078079c4df48 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.884161 Sep 13 20:01:24.311744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 211/439] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:23 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:25.278884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d36a0f07-33df-4e72-be1d-1bbf5d630150 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:25.280965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d36a0f07-33df-4e72-be1d-1bbf5d630150 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:25.302491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d36a0f07-33df-4e72-be1d-1bbf5d630150 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:25.304276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d36a0f07-33df-4e72-be1d-1bbf5d630150 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:25.307192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d36a0f07-33df-4e72-be1d-1bbf5d630150 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:25.308438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d36a0f07-33df-4e72-be1d-1bbf5d630150 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:25.310309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d36a0f07-33df-4e72-be1d-1bbf5d630150 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:25.313114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d36a0f07-33df-4e72-be1d-1bbf5d630150 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:25.328293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ebc2d3a6-9f60-4940-859d-92918595a530 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:25.328988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ebc2d3a6-9f60-4940-859d-92918595a530 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:25.340057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebc2d3a6-9f60-4940-859d-92918595a530 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:25.340542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebc2d3a6-9f60-4940-859d-92918595a530 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:25.340970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebc2d3a6-9f60-4940-859d-92918595a530 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:25.341666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebc2d3a6-9f60-4940-859d-92918595a530 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:25.342102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebc2d3a6-9f60-4940-859d-92918595a530 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:25.342552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebc2d3a6-9f60-4940-859d-92918595a530 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:25.690328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d36a0f07-33df-4e72-be1d-1bbf5d630150 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:25.695174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ebc2d3a6-9f60-4940-859d-92918595a530 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:25.707284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ebc2d3a6-9f60-4940-859d-92918595a530 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:25.708785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ebc2d3a6-9f60-4940-859d-92918595a530 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:25.720836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ebc2d3a6-9f60-4940-859d-92918595a530 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.396566 Sep 13 20:01:25.725536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 212/440] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:25.728165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d36a0f07-33df-4e72-be1d-1bbf5d630150 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1512 microversion: 2.1 time: 0.454542 Sep 13 20:01:25.731488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-116588178", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29817ba4-d6b3-4bd2-a1ab-dc4db767ab34"}], "security_groups": [{"name": "tempest-securitygroup--468795342"}], "key_name": "tempest-keypair-1161829303", "user_data": "}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:25.732223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 229/441] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:25 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:26.749809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b83af966-ff9a-431f-9134-3ee38ab15366 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:26.751908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b83af966-ff9a-431f-9134-3ee38ab15366 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:26.772531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b83af966-ff9a-431f-9134-3ee38ab15366 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:26.773017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b83af966-ff9a-431f-9134-3ee38ab15366 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:26.773448 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b83af966-ff9a-431f-9134-3ee38ab15366 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:26.774277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b83af966-ff9a-431f-9134-3ee38ab15366 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:26.774869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b83af966-ff9a-431f-9134-3ee38ab15366 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:26.775286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b83af966-ff9a-431f-9134-3ee38ab15366 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:27.123635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b83af966-ff9a-431f-9134-3ee38ab15366 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:27.151352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b83af966-ff9a-431f-9134-3ee38ab15366 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:27.156193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b83af966-ff9a-431f-9134-3ee38ab15366 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:27.160173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b83af966-ff9a-431f-9134-3ee38ab15366 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.413675 Sep 13 20:01:27.163271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 230/442] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:27.169246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-88e4cf2f-ab3b-403b-80d5-ddbf4210e43b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:27.170291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-88e4cf2f-ab3b-403b-80d5-ddbf4210e43b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:27.209329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88e4cf2f-ab3b-403b-80d5-ddbf4210e43b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:27.210168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88e4cf2f-ab3b-403b-80d5-ddbf4210e43b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:27.210641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88e4cf2f-ab3b-403b-80d5-ddbf4210e43b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:27.211354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88e4cf2f-ab3b-403b-80d5-ddbf4210e43b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:27.211798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88e4cf2f-ab3b-403b-80d5-ddbf4210e43b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:27.212219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88e4cf2f-ab3b-403b-80d5-ddbf4210e43b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:27.759695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-88e4cf2f-ab3b-403b-80d5-ddbf4210e43b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:27.775564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-88e4cf2f-ab3b-403b-80d5-ddbf4210e43b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1512 microversion: 2.1 time: 0.610866 Sep 13 20:01:27.776422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 231/443] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:27 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1512 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:28.191807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ba0c4d58-5a62-4dec-ba97-2c039c443fff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:28.192420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ba0c4d58-5a62-4dec-ba97-2c039c443fff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:28.215527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba0c4d58-5a62-4dec-ba97-2c039c443fff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:28.216033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba0c4d58-5a62-4dec-ba97-2c039c443fff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:28.216466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba0c4d58-5a62-4dec-ba97-2c039c443fff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:28.217174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba0c4d58-5a62-4dec-ba97-2c039c443fff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:28.217624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba0c4d58-5a62-4dec-ba97-2c039c443fff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:28.218043 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba0c4d58-5a62-4dec-ba97-2c039c443fff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:28.555484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ba0c4d58-5a62-4dec-ba97-2c039c443fff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:28.565372 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ba0c4d58-5a62-4dec-ba97-2c039c443fff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:28.574333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ba0c4d58-5a62-4dec-ba97-2c039c443fff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:28.582690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ba0c4d58-5a62-4dec-ba97-2c039c443fff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.393593 Sep 13 20:01:28.586597 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 232/444] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:01:28.804299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4a5924e2-d5d0-4710-a634-b661061dca53 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:28.805670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4a5924e2-d5d0-4710-a634-b661061dca53 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:28.820138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a5924e2-d5d0-4710-a634-b661061dca53 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:28.821065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a5924e2-d5d0-4710-a634-b661061dca53 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:28.821654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a5924e2-d5d0-4710-a634-b661061dca53 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:28.822582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a5924e2-d5d0-4710-a634-b661061dca53 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:28.823201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a5924e2-d5d0-4710-a634-b661061dca53 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:28.825109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a5924e2-d5d0-4710-a634-b661061dca53 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:29.260409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4a5924e2-d5d0-4710-a634-b661061dca53 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:29.277857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4a5924e2-d5d0-4710-a634-b661061dca53 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1512 microversion: 2.1 time: 0.477450 Sep 13 20:01:29.280204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 233/445] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:28 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1512 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:29.612818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ef68ff46-c61e-4484-a2a8-e6548bd97e45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:29.613434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ef68ff46-c61e-4484-a2a8-e6548bd97e45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:29.628067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef68ff46-c61e-4484-a2a8-e6548bd97e45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:29.628465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef68ff46-c61e-4484-a2a8-e6548bd97e45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:29.630901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef68ff46-c61e-4484-a2a8-e6548bd97e45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:29.631895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef68ff46-c61e-4484-a2a8-e6548bd97e45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:29.636246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef68ff46-c61e-4484-a2a8-e6548bd97e45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:29.636698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef68ff46-c61e-4484-a2a8-e6548bd97e45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:30.147899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ef68ff46-c61e-4484-a2a8-e6548bd97e45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:30.162018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ef68ff46-c61e-4484-a2a8-e6548bd97e45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:30.181387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ef68ff46-c61e-4484-a2a8-e6548bd97e45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:30.189496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ef68ff46-c61e-4484-a2a8-e6548bd97e45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.580854 Sep 13 20:01:30.201024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 234/446] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:29 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:01:30.224624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-fdf3c6e0-c86a-47a8-b4cd-a69332764c2b req-9be5661e-1654-4d7d-9287-d99043e996e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed156643-30e4-4158-b44b-ff8b7b4980e1", "name": "network-vif-deleted", "tag": "1e18d8a0-f46d-4e86-a518-83b2588f925f"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:30.281600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-fdf3c6e0-c86a-47a8-b4cd-a69332764c2b req-9be5661e-1654-4d7d-9287-d99043e996e3 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:30.301562 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-fdf3c6e0-c86a-47a8-b4cd-a69332764c2b req-9be5661e-1654-4d7d-9287-d99043e996e3 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:30.304018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-fdf3c6e0-c86a-47a8-b4cd-a69332764c2b req-9be5661e-1654-4d7d-9287-d99043e996e3 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:30.372870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-fdf3c6e0-c86a-47a8-b4cd-a69332764c2b req-9be5661e-1654-4d7d-9287-d99043e996e3 service nova] Creating event network-vif-deleted:1e18d8a0-f46d-4e86-a518-83b2588f925f for instance ed156643-30e4-4158-b44b-ff8b7b4980e1 on hv-cinder-85427 Sep 13 20:01:30.437521 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-fdf3c6e0-c86a-47a8-b4cd-a69332764c2b req-9be5661e-1654-4d7d-9287-d99043e996e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233037 Sep 13 20:01:30.438938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 235/447] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:01:30.484864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:30.487463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:30.508495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:30.509139 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:30.509584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:30.510300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:30.510776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:30.511197 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:30.603759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:30.604249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:30.604684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:30.605131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lazy-loading 'fault' on Instance uuid ed156643-30e4-4158-b44b-ff8b7b4980e1 {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:01:30.738859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:30.758006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-761d0248-1048-42b6-9643-541f0c1b7a0a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 200 len: 1308 microversion: 2.1 time: 0.299310 Sep 13 20:01:30.775972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 236/448] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:30 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 1308 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:31.238114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bd0cd634-c57a-4bdb-bd80-baa82679aa8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:31.240821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bd0cd634-c57a-4bdb-bd80-baa82679aa8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:31.277927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bd0cd634-c57a-4bdb-bd80-baa82679aa8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:31.278925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bd0cd634-c57a-4bdb-bd80-baa82679aa8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:31.279533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bd0cd634-c57a-4bdb-bd80-baa82679aa8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:31.280480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bd0cd634-c57a-4bdb-bd80-baa82679aa8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:31.281089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bd0cd634-c57a-4bdb-bd80-baa82679aa8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:31.282763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bd0cd634-c57a-4bdb-bd80-baa82679aa8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:31.577008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=4 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:31.663953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bd0cd634-c57a-4bdb-bd80-baa82679aa8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:31.714915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bd0cd634-c57a-4bdb-bd80-baa82679aa8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:31.718074 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bd0cd634-c57a-4bdb-bd80-baa82679aa8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:31.727193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bd0cd634-c57a-4bdb-bd80-baa82679aa8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.505016 Sep 13 20:01:31.742432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 237/449] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:31.816087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4d690cf5-0bbc-4b8a-9ce9-b031cb8bcf34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:31.850720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4d690cf5-0bbc-4b8a-9ce9-b031cb8bcf34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: ed156643-30e4-4158-b44b-ff8b7b4980e1] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:31.882711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d690cf5-0bbc-4b8a-9ce9-b031cb8bcf34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:31.883619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d690cf5-0bbc-4b8a-9ce9-b031cb8bcf34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:31.885519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d690cf5-0bbc-4b8a-9ce9-b031cb8bcf34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:31.887018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d690cf5-0bbc-4b8a-9ce9-b031cb8bcf34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:31.892593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d690cf5-0bbc-4b8a-9ce9-b031cb8bcf34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:31.893543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d690cf5-0bbc-4b8a-9ce9-b031cb8bcf34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:31.965541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-4d690cf5-0bbc-4b8a-9ce9-b031cb8bcf34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] HTTP exception thrown: Instance ed156643-30e4-4158-b44b-ff8b7b4980e1 could not be found. Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4d690cf5-0bbc-4b8a-9ce9-b031cb8bcf34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Request method failure captured: Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 HTTP/1.1 Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOEPdTsMbVIB0cbM0FinEZ1isvt5nXQhh9H4-IUUcbbE3KfLhpcvcH7pNb8Syd5wHA8mx2v4wiA0Q745Zd1TH3d1tSCMNrG_OdsLoWjioNbfFLXPGVs3WO-qMtg6Agdmw40dtBL1E8cwlqLWai2PZz87BRkJ8q2z2X48Qkh8yXbqX9M Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: e0a89bb1e9c24a3d8ee45633959e59ea Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1674542736 Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:01:31.984272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:01:31.986884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e0a89bb1e9c24a3d8ee45633959e59ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e0a89bb1e9c24a3d8ee45633959e59ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e0a89bb1e9c24a3d8ee45633959e59ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e0a89bb1e9c24a3d8ee45633959e59ea"}]}] Sep 13 20:01:31.986884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-VolumesSnapshotTestJSON-1674542736 Sep 13 20:01:31.986884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: e0a89bb1e9c24a3d8ee45633959e59ea Sep 13 20:01:31.986884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1674542736 Sep 13 20:01:31.986884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-VolumesSnapshotTestJSON-1674542736-project Sep 13 20:01:31.986884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:01:31.986884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:01:31.986884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 7c17f29c73f643ca83a08f4e44e6279b Sep 13 20:01:31.986884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-VolumesSnapshotTestJSON-1674542736-project Sep 13 20:01:31.986884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:01:31.986884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance ed156643-30e4-4158-b44b-ff8b7b4980e1 could not be found. Sep 13 20:01:31.986884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': 'ed156643-30e4-4158-b44b-ff8b7b4980e1'} Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed156643-30e4-4158-b44b-ff8b7b4980e1 could not be found. Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:31.988107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed156643-30e4-4158-b44b-ff8b7b4980e1 could not be found. Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed156643-30e4-4158-b44b-ff8b7b4980e1 could not be found. Sep 13 20:01:31.990347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:01:31.992422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4d690cf5-0bbc-4b8a-9ce9-b031cb8bcf34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Returning 404 to user: Instance ed156643-30e4-4158-b44b-ff8b7b4980e1 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:31.998703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4d690cf5-0bbc-4b8a-9ce9-b031cb8bcf34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1" status: 404 len: 111 microversion: 2.1 time: 0.192873 Sep 13 20:01:32.001882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 238/450] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:31 2022] GET /compute/v2.1/servers/ed156643-30e4-4158-b44b-ff8b7b4980e1 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:01:32.758133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-46b22c07-a0f4-4077-8b76-2289c810c57e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:32.759796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-46b22c07-a0f4-4077-8b76-2289c810c57e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:32.780684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46b22c07-a0f4-4077-8b76-2289c810c57e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:32.783721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46b22c07-a0f4-4077-8b76-2289c810c57e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:32.784403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46b22c07-a0f4-4077-8b76-2289c810c57e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:32.786537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46b22c07-a0f4-4077-8b76-2289c810c57e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:32.787834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46b22c07-a0f4-4077-8b76-2289c810c57e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:32.790153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46b22c07-a0f4-4077-8b76-2289c810c57e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:33.150208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-46b22c07-a0f4-4077-8b76-2289c810c57e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:33.160332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-46b22c07-a0f4-4077-8b76-2289c810c57e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:33.161971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-46b22c07-a0f4-4077-8b76-2289c810c57e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:33.165535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-46b22c07-a0f4-4077-8b76-2289c810c57e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.412117 Sep 13 20:01:33.170800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 239/451] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:34.115622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] validate_networks() for [('29817ba4-d6b3-4bd2-a1ab-dc4db767ab34', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:01:34.213721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-83b461fa-fbc7-41dd-abe7-b0e268230d9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:34.217431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-83b461fa-fbc7-41dd-abe7-b0e268230d9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:34.231444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83b461fa-fbc7-41dd-abe7-b0e268230d9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:34.232733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83b461fa-fbc7-41dd-abe7-b0e268230d9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:34.234017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83b461fa-fbc7-41dd-abe7-b0e268230d9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:34.235062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83b461fa-fbc7-41dd-abe7-b0e268230d9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:34.236250 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83b461fa-fbc7-41dd-abe7-b0e268230d9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:34.236872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83b461fa-fbc7-41dd-abe7-b0e268230d9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:34.473168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-83b461fa-fbc7-41dd-abe7-b0e268230d9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:34.485793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-83b461fa-fbc7-41dd-abe7-b0e268230d9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:34.488023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-83b461fa-fbc7-41dd-abe7-b0e268230d9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:34.489547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-83b461fa-fbc7-41dd-abe7-b0e268230d9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1740 microversion: 2.20 time: 0.282846 Sep 13 20:01:34.510630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 240/452] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:34 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:35.008897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:01:35.009315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:01:35.009779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:01:35.010569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:01:35.010980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:01:35.028076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:35.028554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:35.028995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:35.035728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:35.036767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:35.039858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:35.075689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Getting quotas for project 23873d995d564c0388a4649e57821c69. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:01:35.080684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Getting quotas for user 2577fc11946c4597857187ae7b464fe7 and project 23873d995d564c0388a4649e57821c69. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:01:35.094696 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:01:35.097325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:01:35.188885 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8e7f4e86-aa91-41e9-b83a-3fa5b89b95ca tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 9.460549 Sep 13 20:01:35.189958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 213/453] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:01:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 9463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:01:35.203385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-723cb72d-9680-4e59-9e31-5fcc022e076d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:35.204480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-723cb72d-9680-4e59-9e31-5fcc022e076d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:35.323565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-723cb72d-9680-4e59-9e31-5fcc022e076d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:35.335424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-723cb72d-9680-4e59-9e31-5fcc022e076d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1245 microversion: 2.1 time: 0.137080 Sep 13 20:01:35.338561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 241/454] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:35 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1245 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:35.516831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-95d44563-7e12-41d8-a91f-6861a29c9f97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:35.517493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-95d44563-7e12-41d8-a91f-6861a29c9f97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:35.535175 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-95d44563-7e12-41d8-a91f-6861a29c9f97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:35.536548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-95d44563-7e12-41d8-a91f-6861a29c9f97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:35.537255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-95d44563-7e12-41d8-a91f-6861a29c9f97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:35.539432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-95d44563-7e12-41d8-a91f-6861a29c9f97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:35.557678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-95d44563-7e12-41d8-a91f-6861a29c9f97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:35.558395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-95d44563-7e12-41d8-a91f-6861a29c9f97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:35.860959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-95d44563-7e12-41d8-a91f-6861a29c9f97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:35.876268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-95d44563-7e12-41d8-a91f-6861a29c9f97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:35.883501 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-95d44563-7e12-41d8-a91f-6861a29c9f97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:35.885055 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-95d44563-7e12-41d8-a91f-6861a29c9f97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1722 microversion: 2.20 time: 0.372449 Sep 13 20:01:35.889960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 214/455] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:35 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:36.368402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5e592d45-aca6-4584-a26a-77aacf86e788 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:36.369119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5e592d45-aca6-4584-a26a-77aacf86e788 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:36.382145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5e592d45-aca6-4584-a26a-77aacf86e788 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.385072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5e592d45-aca6-4584-a26a-77aacf86e788 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.385582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5e592d45-aca6-4584-a26a-77aacf86e788 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.386339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5e592d45-aca6-4584-a26a-77aacf86e788 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.387146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5e592d45-aca6-4584-a26a-77aacf86e788 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.387574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5e592d45-aca6-4584-a26a-77aacf86e788 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.541303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5e592d45-aca6-4584-a26a-77aacf86e788 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:36.564329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5e592d45-aca6-4584-a26a-77aacf86e788 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1249 microversion: 2.1 time: 0.203171 Sep 13 20:01:36.577453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 242/456] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:36 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1249 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:36.935469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-580a127a-2235-4848-a329-a795a80be20e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:36.936645 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-580a127a-2235-4848-a329-a795a80be20e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:36.951539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-580a127a-2235-4848-a329-a795a80be20e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.955373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-580a127a-2235-4848-a329-a795a80be20e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.957069 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-580a127a-2235-4848-a329-a795a80be20e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.961950 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-580a127a-2235-4848-a329-a795a80be20e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.962704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-580a127a-2235-4848-a329-a795a80be20e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.963307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-580a127a-2235-4848-a329-a795a80be20e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:37.363642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-580a127a-2235-4848-a329-a795a80be20e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:37.374532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-580a127a-2235-4848-a329-a795a80be20e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:37.376150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-580a127a-2235-4848-a329-a795a80be20e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:37.377699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-580a127a-2235-4848-a329-a795a80be20e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1722 microversion: 2.20 time: 0.447578 Sep 13 20:01:37.378607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 215/457] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:37.617098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-da9d5196-2dc3-4c15-a00d-e0e79f5b4d6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:37.617813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-da9d5196-2dc3-4c15-a00d-e0e79f5b4d6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:37.629457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-da9d5196-2dc3-4c15-a00d-e0e79f5b4d6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:37.630310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-da9d5196-2dc3-4c15-a00d-e0e79f5b4d6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:37.633011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-da9d5196-2dc3-4c15-a00d-e0e79f5b4d6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:37.634268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-da9d5196-2dc3-4c15-a00d-e0e79f5b4d6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:37.634939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-da9d5196-2dc3-4c15-a00d-e0e79f5b4d6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:37.635540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-da9d5196-2dc3-4c15-a00d-e0e79f5b4d6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:37.662670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:37.745740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-da9d5196-2dc3-4c15-a00d-e0e79f5b4d6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:37.766085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-da9d5196-2dc3-4c15-a00d-e0e79f5b4d6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1249 microversion: 2.1 time: 0.153227 Sep 13 20:01:37.773433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 243/458] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:37 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1249 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:38.405057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2eb55616-cc2d-4a9d-aa98-1199f002095c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:38.405843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2eb55616-cc2d-4a9d-aa98-1199f002095c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:38.413476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eb55616-cc2d-4a9d-aa98-1199f002095c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:38.413970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eb55616-cc2d-4a9d-aa98-1199f002095c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:38.414463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eb55616-cc2d-4a9d-aa98-1199f002095c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:38.415207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eb55616-cc2d-4a9d-aa98-1199f002095c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:38.415668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eb55616-cc2d-4a9d-aa98-1199f002095c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:38.416086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eb55616-cc2d-4a9d-aa98-1199f002095c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:38.793135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-315ff2c4-4be6-44a2-927b-905704aa5d5f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:38.793736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-315ff2c4-4be6-44a2-927b-905704aa5d5f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:38.800571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-315ff2c4-4be6-44a2-927b-905704aa5d5f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:38.801055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-315ff2c4-4be6-44a2-927b-905704aa5d5f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:38.801497 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-315ff2c4-4be6-44a2-927b-905704aa5d5f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:38.802230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-315ff2c4-4be6-44a2-927b-905704aa5d5f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:38.807119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-315ff2c4-4be6-44a2-927b-905704aa5d5f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:38.807595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-315ff2c4-4be6-44a2-927b-905704aa5d5f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:38.980344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2eb55616-cc2d-4a9d-aa98-1199f002095c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:39.007359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-315ff2c4-4be6-44a2-927b-905704aa5d5f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:39.007997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2eb55616-cc2d-4a9d-aa98-1199f002095c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:39.012382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2eb55616-cc2d-4a9d-aa98-1199f002095c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:39.013665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2eb55616-cc2d-4a9d-aa98-1199f002095c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1722 microversion: 2.20 time: 0.614347 Sep 13 20:01:39.019210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-315ff2c4-4be6-44a2-927b-905704aa5d5f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1297 microversion: 2.1 time: 0.229887 Sep 13 20:01:39.027518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 216/459] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1722 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:39.053597 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 244/460] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:38 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1297 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:39.525831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-306f6595-4eda-468d-99c1-51036d3790a0 req-f2d96d07-84ca-49f1-9fdb-33ff3275c349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0decb4-2f46-4f2f-860f-e8ca277f7080", "name": "network-vif-unplugged", "status": "completed", "tag": "2f770f4f-2f9f-4723-a236-5204e36adea7"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:39.569918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-306f6595-4eda-468d-99c1-51036d3790a0 req-f2d96d07-84ca-49f1-9fdb-33ff3275c349 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:39.570714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-306f6595-4eda-468d-99c1-51036d3790a0 req-f2d96d07-84ca-49f1-9fdb-33ff3275c349 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:39.571150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-306f6595-4eda-468d-99c1-51036d3790a0 req-f2d96d07-84ca-49f1-9fdb-33ff3275c349 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:39.622067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-306f6595-4eda-468d-99c1-51036d3790a0 req-f2d96d07-84ca-49f1-9fdb-33ff3275c349 service nova] Creating event network-vif-unplugged:2f770f4f-2f9f-4723-a236-5204e36adea7 for instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 on hv-cinder-85427 Sep 13 20:01:39.646221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-306f6595-4eda-468d-99c1-51036d3790a0 req-f2d96d07-84ca-49f1-9fdb-33ff3275c349 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123727 Sep 13 20:01:39.651277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 217/461] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:01:40.045910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-27e09fe4-43a7-4ae8-8210-792bc0f9d599 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:40.046553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-27e09fe4-43a7-4ae8-8210-792bc0f9d599 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:40.060960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27e09fe4-43a7-4ae8-8210-792bc0f9d599 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:40.061451 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27e09fe4-43a7-4ae8-8210-792bc0f9d599 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:40.061957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27e09fe4-43a7-4ae8-8210-792bc0f9d599 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:40.062684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27e09fe4-43a7-4ae8-8210-792bc0f9d599 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:40.063132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27e09fe4-43a7-4ae8-8210-792bc0f9d599 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:40.063547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27e09fe4-43a7-4ae8-8210-792bc0f9d599 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:40.066961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5a39456e-9132-4502-ab88-634b48319817 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:40.067958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5a39456e-9132-4502-ab88-634b48319817 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:40.088483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a39456e-9132-4502-ab88-634b48319817 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:40.091491 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a39456e-9132-4502-ab88-634b48319817 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:40.092212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a39456e-9132-4502-ab88-634b48319817 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:40.095452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a39456e-9132-4502-ab88-634b48319817 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:40.096450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a39456e-9132-4502-ab88-634b48319817 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:40.097067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a39456e-9132-4502-ab88-634b48319817 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:40.302470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5a39456e-9132-4502-ab88-634b48319817 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:40.315555 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5a39456e-9132-4502-ab88-634b48319817 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1305 microversion: 2.1 time: 0.253664 Sep 13 20:01:40.335590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 218/462] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:40 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1305 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:40.373541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-27e09fe4-43a7-4ae8-8210-792bc0f9d599 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:40.388915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-27e09fe4-43a7-4ae8-8210-792bc0f9d599 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:40.390347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-27e09fe4-43a7-4ae8-8210-792bc0f9d599 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:40.393417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-27e09fe4-43a7-4ae8-8210-792bc0f9d599 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1722 microversion: 2.20 time: 0.351447 Sep 13 20:01:40.395068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 245/463] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:40.570951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c5256804-022d-4008-8a5a-0989d7c36d89 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:40.571713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c5256804-022d-4008-8a5a-0989d7c36d89 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:40.598323 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5256804-022d-4008-8a5a-0989d7c36d89 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:40.600512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5256804-022d-4008-8a5a-0989d7c36d89 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:40.602753 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5256804-022d-4008-8a5a-0989d7c36d89 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:40.604135 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5256804-022d-4008-8a5a-0989d7c36d89 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:40.605728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5256804-022d-4008-8a5a-0989d7c36d89 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:40.607155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5256804-022d-4008-8a5a-0989d7c36d89 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:40.752184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c5256804-022d-4008-8a5a-0989d7c36d89 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/ips" status: 200 len: 145 microversion: 2.1 time: 0.186130 Sep 13 20:01:40.757733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 219/464] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 13 20:01:40 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/ips => generated 145 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:01:41.344289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fc8832ef-4b60-4706-a346-2543af5252a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:41.344885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fc8832ef-4b60-4706-a346-2543af5252a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:41.367323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc8832ef-4b60-4706-a346-2543af5252a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.367743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc8832ef-4b60-4706-a346-2543af5252a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.368204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc8832ef-4b60-4706-a346-2543af5252a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.369045 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc8832ef-4b60-4706-a346-2543af5252a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.369418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc8832ef-4b60-4706-a346-2543af5252a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.369833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc8832ef-4b60-4706-a346-2543af5252a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.424648 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-59567d2e-8ad6-47b5-a963-175f6eb53997 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:41.425801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-59567d2e-8ad6-47b5-a963-175f6eb53997 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:41.440217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59567d2e-8ad6-47b5-a963-175f6eb53997 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.443923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59567d2e-8ad6-47b5-a963-175f6eb53997 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.447249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59567d2e-8ad6-47b5-a963-175f6eb53997 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.449344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59567d2e-8ad6-47b5-a963-175f6eb53997 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.452528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59567d2e-8ad6-47b5-a963-175f6eb53997 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.455452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59567d2e-8ad6-47b5-a963-175f6eb53997 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.515869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fc8832ef-4b60-4706-a346-2543af5252a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:41.525530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fc8832ef-4b60-4706-a346-2543af5252a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1315 microversion: 2.1 time: 0.185189 Sep 13 20:01:41.533691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 246/465] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:41 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:41.801070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-59567d2e-8ad6-47b5-a963-175f6eb53997 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:41.826890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-59567d2e-8ad6-47b5-a963-175f6eb53997 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:41.828370 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-59567d2e-8ad6-47b5-a963-175f6eb53997 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:41.837863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-59567d2e-8ad6-47b5-a963-175f6eb53997 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1722 microversion: 2.20 time: 0.417529 Sep 13 20:01:41.838476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 220/466] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:41 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1722 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:42.558172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-52f87c32-abcb-4a68-ae75-150ff13dbfb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:42.558881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-52f87c32-abcb-4a68-ae75-150ff13dbfb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:42.566405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52f87c32-abcb-4a68-ae75-150ff13dbfb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:42.567240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52f87c32-abcb-4a68-ae75-150ff13dbfb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:42.567855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52f87c32-abcb-4a68-ae75-150ff13dbfb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:42.568767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52f87c32-abcb-4a68-ae75-150ff13dbfb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:42.569388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52f87c32-abcb-4a68-ae75-150ff13dbfb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:42.570759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52f87c32-abcb-4a68-ae75-150ff13dbfb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:42.690121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-52f87c32-abcb-4a68-ae75-150ff13dbfb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:42.698861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-52f87c32-abcb-4a68-ae75-150ff13dbfb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1303 microversion: 2.1 time: 0.144518 Sep 13 20:01:42.714753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 247/467] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:42 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1303 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:42.866185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f9f41436-c67f-4939-93b1-59dd2f122652 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:42.867971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f9f41436-c67f-4939-93b1-59dd2f122652 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:42.875842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f9f41436-c67f-4939-93b1-59dd2f122652 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:42.875842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f9f41436-c67f-4939-93b1-59dd2f122652 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:42.876213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f9f41436-c67f-4939-93b1-59dd2f122652 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:42.877571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f9f41436-c67f-4939-93b1-59dd2f122652 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:42.877571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f9f41436-c67f-4939-93b1-59dd2f122652 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:42.877853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f9f41436-c67f-4939-93b1-59dd2f122652 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.096996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f9f41436-c67f-4939-93b1-59dd2f122652 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:43.119404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f9f41436-c67f-4939-93b1-59dd2f122652 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:43.124547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f9f41436-c67f-4939-93b1-59dd2f122652 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:43.127534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f9f41436-c67f-4939-93b1-59dd2f122652 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1725 microversion: 2.20 time: 0.263967 Sep 13 20:01:43.128939 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 221/468] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:43.157834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0b3550aa-0898-4d33-915e-82c28eddd040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e514984-a60e-407a-8233-0eb8249e5918"}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:43.161258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0b3550aa-0898-4d33-915e-82c28eddd040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:43.168377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b3550aa-0898-4d33-915e-82c28eddd040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:43.168876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b3550aa-0898-4d33-915e-82c28eddd040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:43.169309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b3550aa-0898-4d33-915e-82c28eddd040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.170025 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b3550aa-0898-4d33-915e-82c28eddd040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:43.170506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b3550aa-0898-4d33-915e-82c28eddd040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:43.170932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b3550aa-0898-4d33-915e-82c28eddd040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.724932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d4bc4e5c-2485-4c76-84c6-72de5be67880 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:43.725760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d4bc4e5c-2485-4c76-84c6-72de5be67880 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:43.736984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4bc4e5c-2485-4c76-84c6-72de5be67880 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:43.737490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4bc4e5c-2485-4c76-84c6-72de5be67880 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:43.737972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4bc4e5c-2485-4c76-84c6-72de5be67880 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.738715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4bc4e5c-2485-4c76-84c6-72de5be67880 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:43.739217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4bc4e5c-2485-4c76-84c6-72de5be67880 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:43.739634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4bc4e5c-2485-4c76-84c6-72de5be67880 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.754403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0b3550aa-0898-4d33-915e-82c28eddd040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "POST /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.600547 Sep 13 20:01:43.755160 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 248/469] 10.222.0.52 () {62 vars in 1364 bytes} [Tue Sep 13 20:01:43 2022] POST /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 188 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:01:43.831089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d4bc4e5c-2485-4c76-84c6-72de5be67880 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:43.841740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d4bc4e5c-2485-4c76-84c6-72de5be67880 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1303 microversion: 2.1 time: 0.121167 Sep 13 20:01:43.846816 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 222/470] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:43 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:44.018161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2efcf7bd-1690-41b3-a1e3-5991278a726d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:44.018838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2efcf7bd-1690-41b3-a1e3-5991278a726d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:44.045995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2efcf7bd-1690-41b3-a1e3-5991278a726d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:44.046513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2efcf7bd-1690-41b3-a1e3-5991278a726d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:44.046944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2efcf7bd-1690-41b3-a1e3-5991278a726d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:44.047661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2efcf7bd-1690-41b3-a1e3-5991278a726d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:44.055001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2efcf7bd-1690-41b3-a1e3-5991278a726d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:44.055449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2efcf7bd-1690-41b3-a1e3-5991278a726d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:44.141614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2efcf7bd-1690-41b3-a1e3-5991278a726d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120844) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 20:01:44.391114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2efcf7bd-1690-41b3-a1e3-5991278a726d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "POST /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/action" status: 202 len: 0 microversion: 2.20 time: 0.375521 Sep 13 20:01:44.391659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 249/471] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 13 20:01:44 2022] POST /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 20:01:44.405447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ec9594b7-9acb-4987-a167-02c34ba1b162 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:44.411759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ec9594b7-9acb-4987-a167-02c34ba1b162 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:44.448701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec9594b7-9acb-4987-a167-02c34ba1b162 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:44.455633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec9594b7-9acb-4987-a167-02c34ba1b162 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:44.464092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec9594b7-9acb-4987-a167-02c34ba1b162 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:44.467749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec9594b7-9acb-4987-a167-02c34ba1b162 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:44.470594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec9594b7-9acb-4987-a167-02c34ba1b162 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:44.482742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec9594b7-9acb-4987-a167-02c34ba1b162 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:44.637296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:44.880035 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-950a7588-bff7-4f53-873b-bed18738bb3e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:44.884778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-950a7588-bff7-4f53-873b-bed18738bb3e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:44.908441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-950a7588-bff7-4f53-873b-bed18738bb3e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:44.911662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-950a7588-bff7-4f53-873b-bed18738bb3e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:44.918280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-950a7588-bff7-4f53-873b-bed18738bb3e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:44.924758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-950a7588-bff7-4f53-873b-bed18738bb3e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:44.926316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-950a7588-bff7-4f53-873b-bed18738bb3e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:44.928288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-950a7588-bff7-4f53-873b-bed18738bb3e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:45.035416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ec9594b7-9acb-4987-a167-02c34ba1b162 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:45.074935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:45.109902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ec9594b7-9acb-4987-a167-02c34ba1b162 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:45.122353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ec9594b7-9acb-4987-a167-02c34ba1b162 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:45.138467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ec9594b7-9acb-4987-a167-02c34ba1b162 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1811 microversion: 2.20 time: 0.733400 Sep 13 20:01:45.142706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 223/472] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1811 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:45.263497 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-950a7588-bff7-4f53-873b-bed18738bb3e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:45.340512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:45.365472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-950a7588-bff7-4f53-873b-bed18738bb3e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1303 microversion: 2.1 time: 0.488502 Sep 13 20:01:45.382401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 250/473] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:44 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1303 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:45.815411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1401783118", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "networks": [{"uuid": "8b3e3196-2420-49f4-80a2-d60fffd9aaaa"}]}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:45.863591 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=6 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:46.181183 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0aa7de61-6b65-423f-a0fb-759a2dbd927d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:46.182399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0aa7de61-6b65-423f-a0fb-759a2dbd927d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:46.199056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0aa7de61-6b65-423f-a0fb-759a2dbd927d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.199904 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0aa7de61-6b65-423f-a0fb-759a2dbd927d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.219653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0aa7de61-6b65-423f-a0fb-759a2dbd927d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.221029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0aa7de61-6b65-423f-a0fb-759a2dbd927d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.221530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0aa7de61-6b65-423f-a0fb-759a2dbd927d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.221984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0aa7de61-6b65-423f-a0fb-759a2dbd927d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.507139 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0aa7de61-6b65-423f-a0fb-759a2dbd927d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:46.521199 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0aa7de61-6b65-423f-a0fb-759a2dbd927d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:46.523995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0aa7de61-6b65-423f-a0fb-759a2dbd927d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:46.525637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0aa7de61-6b65-423f-a0fb-759a2dbd927d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1751 microversion: 2.20 time: 0.356482 Sep 13 20:01:46.526475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 251/474] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1751 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:46.540029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-af283d5b-1187-4366-8ab1-d58f472b373f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:46.545234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-af283d5b-1187-4366-8ab1-d58f472b373f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:46.578952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af283d5b-1187-4366-8ab1-d58f472b373f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.580505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af283d5b-1187-4366-8ab1-d58f472b373f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.581319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af283d5b-1187-4366-8ab1-d58f472b373f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.582886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af283d5b-1187-4366-8ab1-d58f472b373f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.585971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af283d5b-1187-4366-8ab1-d58f472b373f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.587368 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af283d5b-1187-4366-8ab1-d58f472b373f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.900355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-af283d5b-1187-4366-8ab1-d58f472b373f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:46.945625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-af283d5b-1187-4366-8ab1-d58f472b373f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1370 microversion: 2.1 time: 0.417431 Sep 13 20:01:46.948165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 252/475] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:46 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1370 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:47.341349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0c537600-d1d5-4864-af62-26f02f39cbc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1729d40-4430-4f6d-bd52-1b779a1121b7"}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:47.345967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0c537600-d1d5-4864-af62-26f02f39cbc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:47.365099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0c537600-d1d5-4864-af62-26f02f39cbc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:47.365882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0c537600-d1d5-4864-af62-26f02f39cbc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:47.366627 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0c537600-d1d5-4864-af62-26f02f39cbc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:47.367624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0c537600-d1d5-4864-af62-26f02f39cbc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:47.368233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0c537600-d1d5-4864-af62-26f02f39cbc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:47.368808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0c537600-d1d5-4864-af62-26f02f39cbc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:47.937857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0c537600-d1d5-4864-af62-26f02f39cbc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "POST /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.607001 Sep 13 20:01:47.940175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 253/476] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 13 20:01:47 2022] POST /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 194 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 13 20:01:47.953892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b1bf6d05-7286-4038-a4af-6037feffad43 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:47.960396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b1bf6d05-7286-4038-a4af-6037feffad43 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:47.986890 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1bf6d05-7286-4038-a4af-6037feffad43 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:47.987657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1bf6d05-7286-4038-a4af-6037feffad43 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:47.988537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1bf6d05-7286-4038-a4af-6037feffad43 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:47.989524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1bf6d05-7286-4038-a4af-6037feffad43 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:47.990442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1bf6d05-7286-4038-a4af-6037feffad43 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:47.991244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1bf6d05-7286-4038-a4af-6037feffad43 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:48.250839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b1bf6d05-7286-4038-a4af-6037feffad43 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:48.264464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b1bf6d05-7286-4038-a4af-6037feffad43 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:48.273816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b1bf6d05-7286-4038-a4af-6037feffad43 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:48.275608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b1bf6d05-7286-4038-a4af-6037feffad43 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1751 microversion: 2.20 time: 0.332693 Sep 13 20:01:48.279176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 254/477] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:47 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1751 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:48.288942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-eaaf6456-4557-4293-ae91-efbc55c5d34f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:48.291385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-eaaf6456-4557-4293-ae91-efbc55c5d34f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:48.339100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eaaf6456-4557-4293-ae91-efbc55c5d34f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:48.339100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eaaf6456-4557-4293-ae91-efbc55c5d34f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:48.339100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eaaf6456-4557-4293-ae91-efbc55c5d34f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:48.339100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eaaf6456-4557-4293-ae91-efbc55c5d34f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:48.339796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eaaf6456-4557-4293-ae91-efbc55c5d34f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:48.339796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eaaf6456-4557-4293-ae91-efbc55c5d34f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:48.405808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:48.700352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-eaaf6456-4557-4293-ae91-efbc55c5d34f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:48.719312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-eaaf6456-4557-4293-ae91-efbc55c5d34f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1370 microversion: 2.1 time: 0.438887 Sep 13 20:01:48.719868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 255/478] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:48 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1370 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:48.797598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-ec43aaab-8d35-44d6-85fe-81fc2435631f req-d6db2b11-c066-432f-a206-639cb6eb8e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f881820-7e22-41c7-b39e-9f204af9a23c", "tag": "3ba9501e-1d87-4e9c-919d-9db2338fa99d"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:48.823773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-ec43aaab-8d35-44d6-85fe-81fc2435631f req-d6db2b11-c066-432f-a206-639cb6eb8e7a service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:48.828558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-ec43aaab-8d35-44d6-85fe-81fc2435631f req-d6db2b11-c066-432f-a206-639cb6eb8e7a service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:48.828558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-ec43aaab-8d35-44d6-85fe-81fc2435631f req-d6db2b11-c066-432f-a206-639cb6eb8e7a service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:48.859005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-ec43aaab-8d35-44d6-85fe-81fc2435631f req-d6db2b11-c066-432f-a206-639cb6eb8e7a service nova] Creating event network-changed:3ba9501e-1d87-4e9c-919d-9db2338fa99d for instance 3f881820-7e22-41c7-b39e-9f204af9a23c on hv-cinder-85427 Sep 13 20:01:48.869820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-ec43aaab-8d35-44d6-85fe-81fc2435631f req-d6db2b11-c066-432f-a206-639cb6eb8e7a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084485 Sep 13 20:01:48.871041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 256/479] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:01:49.327310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cb000d13-936a-412c-bde2-c92e58469031 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:49.327998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cb000d13-936a-412c-bde2-c92e58469031 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:49.335913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cb000d13-936a-412c-bde2-c92e58469031 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:49.336403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cb000d13-936a-412c-bde2-c92e58469031 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:49.336834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cb000d13-936a-412c-bde2-c92e58469031 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:49.337541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cb000d13-936a-412c-bde2-c92e58469031 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:49.337983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cb000d13-936a-412c-bde2-c92e58469031 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:49.338427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cb000d13-936a-412c-bde2-c92e58469031 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:49.619445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cb000d13-936a-412c-bde2-c92e58469031 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:49.633092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cb000d13-936a-412c-bde2-c92e58469031 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:49.634617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cb000d13-936a-412c-bde2-c92e58469031 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:49.635805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cb000d13-936a-412c-bde2-c92e58469031 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1751 microversion: 2.20 time: 0.317116 Sep 13 20:01:49.636364 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 257/480] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1751 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:49.745428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ba7c6426-b7be-4a77-a767-17378c716663 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:49.746683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ba7c6426-b7be-4a77-a767-17378c716663 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:49.756219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba7c6426-b7be-4a77-a767-17378c716663 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:49.758973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba7c6426-b7be-4a77-a767-17378c716663 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:49.759625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba7c6426-b7be-4a77-a767-17378c716663 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:49.760554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba7c6426-b7be-4a77-a767-17378c716663 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:49.767306 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba7c6426-b7be-4a77-a767-17378c716663 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:49.768066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba7c6426-b7be-4a77-a767-17378c716663 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:50.649414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ba7c6426-b7be-4a77-a767-17378c716663 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:50.658790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ba7c6426-b7be-4a77-a767-17378c716663 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1370 microversion: 2.1 time: 0.917392 Sep 13 20:01:50.661435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 258/481] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:49 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1370 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:50.669929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-68101292-8441-49e9-8ed7-c0786d283e87 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:50.671300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-68101292-8441-49e9-8ed7-c0786d283e87 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:50.678762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-68101292-8441-49e9-8ed7-c0786d283e87 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:50.679527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-68101292-8441-49e9-8ed7-c0786d283e87 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:50.680121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-68101292-8441-49e9-8ed7-c0786d283e87 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:50.680983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-68101292-8441-49e9-8ed7-c0786d283e87 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:50.681574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-68101292-8441-49e9-8ed7-c0786d283e87 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:50.682138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-68101292-8441-49e9-8ed7-c0786d283e87 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:50.875261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-68101292-8441-49e9-8ed7-c0786d283e87 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:50.885002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-68101292-8441-49e9-8ed7-c0786d283e87 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:50.887838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-68101292-8441-49e9-8ed7-c0786d283e87 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:50.889199 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-68101292-8441-49e9-8ed7-c0786d283e87 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1751 microversion: 2.20 time: 0.226597 Sep 13 20:01:50.889980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 259/482] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:51.710644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2fc33055-d633-4c8b-a4c6-4cf5e6709dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:51.712095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2fc33055-d633-4c8b-a4c6-4cf5e6709dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:51.728798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:51.732237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fc33055-d633-4c8b-a4c6-4cf5e6709dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.743227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fc33055-d633-4c8b-a4c6-4cf5e6709dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.743968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fc33055-d633-4c8b-a4c6-4cf5e6709dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.744872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fc33055-d633-4c8b-a4c6-4cf5e6709dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.746180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fc33055-d633-4c8b-a4c6-4cf5e6709dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.746888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fc33055-d633-4c8b-a4c6-4cf5e6709dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.980690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2fc33055-d633-4c8b-a4c6-4cf5e6709dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:51.990153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2fc33055-d633-4c8b-a4c6-4cf5e6709dd7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1370 microversion: 2.1 time: 0.284081 Sep 13 20:01:52.003688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 260/483] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:51 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1370 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:52.012514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-20534097-0813-4c45-b4e9-545b6b05685f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:52.014138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-20534097-0813-4c45-b4e9-545b6b05685f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:52.027732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20534097-0813-4c45-b4e9-545b6b05685f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:52.029140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20534097-0813-4c45-b4e9-545b6b05685f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:52.030238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20534097-0813-4c45-b4e9-545b6b05685f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:52.031939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20534097-0813-4c45-b4e9-545b6b05685f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:52.032809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20534097-0813-4c45-b4e9-545b6b05685f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:52.033755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20534097-0813-4c45-b4e9-545b6b05685f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:52.331022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-20534097-0813-4c45-b4e9-545b6b05685f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:52.343136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-20534097-0813-4c45-b4e9-545b6b05685f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:52.345376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-20534097-0813-4c45-b4e9-545b6b05685f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:52.346551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-20534097-0813-4c45-b4e9-545b6b05685f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1751 microversion: 2.20 time: 0.341189 Sep 13 20:01:52.347448 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 261/484] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1751 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:52.991445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] validate_networks() for [('8b3e3196-2420-49f4-80a2-d60fffd9aaaa', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:01:53.026834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bc568f87-28f0-4854-896d-307c5c6a061e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:53.030068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bc568f87-28f0-4854-896d-307c5c6a061e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:53.046319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc568f87-28f0-4854-896d-307c5c6a061e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:53.047841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc568f87-28f0-4854-896d-307c5c6a061e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:53.048832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc568f87-28f0-4854-896d-307c5c6a061e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:53.050746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc568f87-28f0-4854-896d-307c5c6a061e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:53.051497 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc568f87-28f0-4854-896d-307c5c6a061e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:53.052177 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc568f87-28f0-4854-896d-307c5c6a061e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:53.304908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bc568f87-28f0-4854-896d-307c5c6a061e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:53.316087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bc568f87-28f0-4854-896d-307c5c6a061e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1370 microversion: 2.1 time: 0.299352 Sep 13 20:01:53.316964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 262/485] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:53 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:53.374598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-12686d00-6605-4584-b6a4-fb47cec3fc3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:53.376137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-12686d00-6605-4584-b6a4-fb47cec3fc3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:53.383587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12686d00-6605-4584-b6a4-fb47cec3fc3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:53.384352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12686d00-6605-4584-b6a4-fb47cec3fc3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:53.384943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12686d00-6605-4584-b6a4-fb47cec3fc3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:53.386131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12686d00-6605-4584-b6a4-fb47cec3fc3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:53.386788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12686d00-6605-4584-b6a4-fb47cec3fc3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:53.387455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12686d00-6605-4584-b6a4-fb47cec3fc3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:53.695114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-12686d00-6605-4584-b6a4-fb47cec3fc3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:53.718798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-12686d00-6605-4584-b6a4-fb47cec3fc3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:53.721490 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-12686d00-6605-4584-b6a4-fb47cec3fc3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:53.722831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-12686d00-6605-4584-b6a4-fb47cec3fc3e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1751 microversion: 2.20 time: 0.352375 Sep 13 20:01:53.724575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 263/486] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:53 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1751 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:01:53.772163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:01:53.772950 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:01:53.773588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:01:53.774165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:01:53.774761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:01:53.777013 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:53.796489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:53.796981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:53.797412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:53.799782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:53.800553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:53.801300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:53.842624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Getting quotas for project e0a89bb1e9c24a3d8ee45633959e59ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:01:53.849961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Getting quotas for user 7c17f29c73f643ca83a08f4e44e6279b and project e0a89bb1e9c24a3d8ee45633959e59ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:01:53.874657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:01:53.878317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:01:54.006880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7dcf8d19-cd79-430f-8797-d8f76dae8d46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.197055 Sep 13 20:01:54.007742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 224/487] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:01:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 8199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:01:54.034219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0baf3b39-e0e2-4a65-b8eb-3a441c159ce3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:54.039282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0baf3b39-e0e2-4a65-b8eb-3a441c159ce3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:54.138424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0baf3b39-e0e2-4a65-b8eb-3a441c159ce3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:54.148627 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0baf3b39-e0e2-4a65-b8eb-3a441c159ce3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1219 microversion: 2.1 time: 0.132852 Sep 13 20:01:54.149657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 264/488] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:54 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:54.251758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-23e6e2bd-fb16-4393-96dc-47c6f894852e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Action: 'create', calling method: .version_select at 0x7f984660a670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-947354718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWUgjra7I233GmIAbQPga3nrDR7K+RFWDMnTyHfd+kqt+6It1uWhegkXPSlV8R/nMPZc5NvxkZAjwVWhrX45SlxQSnqNhlREPgD8Z/maLw7gRmAlj9S6YGOeHaeRLf5MQ=="}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:54.280435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-23e6e2bd-fb16-4393-96dc-47c6f894852e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Getting quotas for project c401b957669e43bdabf08fa232b461be. Resources: {'key_pairs'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:01:54.286477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-23e6e2bd-fb16-4393-96dc-47c6f894852e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Getting quotas for user 66b7e2cda35c473597343822e622a3bd and project c401b957669e43bdabf08fa232b461be. Resources: {'key_pairs'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:01:54.340944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b34a42db-1f10-4419-8f55-2428776e30ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:54.341845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b34a42db-1f10-4419-8f55-2428776e30ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:54.353685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b34a42db-1f10-4419-8f55-2428776e30ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:54.354555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b34a42db-1f10-4419-8f55-2428776e30ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:54.355597 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b34a42db-1f10-4419-8f55-2428776e30ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:54.356954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b34a42db-1f10-4419-8f55-2428776e30ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:54.357319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-23e6e2bd-fb16-4393-96dc-47c6f894852e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.110943 Sep 13 20:01:54.358230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b34a42db-1f10-4419-8f55-2428776e30ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:54.359066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b34a42db-1f10-4419-8f55-2428776e30ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:54.362603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 225/489] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 13 20:01:54 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:01:54.556756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1214509057", "imageRef": "8a042c66-47bd-438a-bef0-f20ec24ac2d6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-947354718", "networks": [{"uuid": "13388aab-c879-4185-8e9e-4d8ecdf4faa4"}]}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:54.671662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b34a42db-1f10-4419-8f55-2428776e30ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:54.682040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b34a42db-1f10-4419-8f55-2428776e30ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1370 microversion: 2.1 time: 0.344795 Sep 13 20:01:54.682855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 265/490] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:54 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1370 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:54.694922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] validate_networks() for [('13388aab-c879-4185-8e9e-4d8ecdf4faa4', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:01:54.764282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-41173c00-93f3-44de-a282-ea4d2a4965f2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:54.764895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-41173c00-93f3-44de-a282-ea4d2a4965f2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:54.771319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41173c00-93f3-44de-a282-ea4d2a4965f2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:54.772080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41173c00-93f3-44de-a282-ea4d2a4965f2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:54.772678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41173c00-93f3-44de-a282-ea4d2a4965f2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:54.773543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41173c00-93f3-44de-a282-ea4d2a4965f2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:54.774135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41173c00-93f3-44de-a282-ea4d2a4965f2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:54.774725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41173c00-93f3-44de-a282-ea4d2a4965f2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:54.996663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-41173c00-93f3-44de-a282-ea4d2a4965f2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:55.016122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-41173c00-93f3-44de-a282-ea4d2a4965f2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:55.031594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-41173c00-93f3-44de-a282-ea4d2a4965f2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:55.035195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-41173c00-93f3-44de-a282-ea4d2a4965f2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1753 microversion: 2.20 time: 0.274742 Sep 13 20:01:55.059690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 266/491] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:54 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1753 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:01:55.178099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dbc62daa-abc7-4c62-a776-7197f277a9cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:55.178968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dbc62daa-abc7-4c62-a776-7197f277a9cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:55.196433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dbc62daa-abc7-4c62-a776-7197f277a9cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:55.201020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dbc62daa-abc7-4c62-a776-7197f277a9cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:55.202580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dbc62daa-abc7-4c62-a776-7197f277a9cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:55.204991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dbc62daa-abc7-4c62-a776-7197f277a9cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:55.208925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dbc62daa-abc7-4c62-a776-7197f277a9cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:55.210102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dbc62daa-abc7-4c62-a776-7197f277a9cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:55.261038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:01:55.261629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:01:55.262221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:01:55.262672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:01:55.263382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:01:55.276125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:55.276616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:55.277046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:55.278472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:55.279209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:55.279892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:55.298027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dbc62daa-abc7-4c62-a776-7197f277a9cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:55.298271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Getting quotas for project c401b957669e43bdabf08fa232b461be. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:01:55.302591 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Getting quotas for user 66b7e2cda35c473597343822e622a3bd and project c401b957669e43bdabf08fa232b461be. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:01:55.307415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dbc62daa-abc7-4c62-a776-7197f277a9cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1271 microversion: 2.1 time: 0.135959 Sep 13 20:01:55.308041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 267/492] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:55 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:55.320624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:01:55.324711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a042c66-47bd-438a-bef0-f20ec24ac2d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:01:55.423893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-55271503-e43e-4832-9151-de08f6417942 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870608 Sep 13 20:01:55.424989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 226/493] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:01:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:01:55.440542 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c27d86a9-40b7-472e-9d3d-9aa311b61139 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:55.441446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c27d86a9-40b7-472e-9d3d-9aa311b61139 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:55.531386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c27d86a9-40b7-472e-9d3d-9aa311b61139 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:55.538762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c27d86a9-40b7-472e-9d3d-9aa311b61139 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1258 microversion: 2.1 time: 0.105575 Sep 13 20:01:55.539349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 268/494] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:55 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1258 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:55.707415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cbda13b6-8d62-4369-8e7d-46c0255f6dbc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:55.708387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cbda13b6-8d62-4369-8e7d-46c0255f6dbc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:55.715009 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbda13b6-8d62-4369-8e7d-46c0255f6dbc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:55.715460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbda13b6-8d62-4369-8e7d-46c0255f6dbc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:55.716122 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbda13b6-8d62-4369-8e7d-46c0255f6dbc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:55.716857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbda13b6-8d62-4369-8e7d-46c0255f6dbc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:55.717530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbda13b6-8d62-4369-8e7d-46c0255f6dbc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:55.718180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbda13b6-8d62-4369-8e7d-46c0255f6dbc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:55.978517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-cbda13b6-8d62-4369-8e7d-46c0255f6dbc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:55.988582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cbda13b6-8d62-4369-8e7d-46c0255f6dbc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1370 microversion: 2.1 time: 0.285089 Sep 13 20:01:55.991764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 227/495] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:55 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:56.070303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c449febe-6116-4f34-917b-7be1a90fbb58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:56.071059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c449febe-6116-4f34-917b-7be1a90fbb58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:56.082299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c449febe-6116-4f34-917b-7be1a90fbb58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.084735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c449febe-6116-4f34-917b-7be1a90fbb58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.085520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c449febe-6116-4f34-917b-7be1a90fbb58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.086584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c449febe-6116-4f34-917b-7be1a90fbb58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.087317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c449febe-6116-4f34-917b-7be1a90fbb58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.087931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c449febe-6116-4f34-917b-7be1a90fbb58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.185344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7e496493-afaf-459a-b639-506c5a11d45b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:56.194355 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e496493-afaf-459a-b639-506c5a11d45b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.194991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e496493-afaf-459a-b639-506c5a11d45b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.195502 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e496493-afaf-459a-b639-506c5a11d45b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.271239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c449febe-6116-4f34-917b-7be1a90fbb58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:56.281481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c449febe-6116-4f34-917b-7be1a90fbb58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:56.283376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c449febe-6116-4f34-917b-7be1a90fbb58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:56.284782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c449febe-6116-4f34-917b-7be1a90fbb58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1753 microversion: 2.20 time: 0.221205 Sep 13 20:01:56.285492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 269/496] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1753 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:56.288664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7e496493-afaf-459a-b639-506c5a11d45b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Going to try to stop instance {{(pid=120845) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 20:01:56.339340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-30aa8223-ea09-444f-92c3-1a380cc1c60b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:56.340712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-30aa8223-ea09-444f-92c3-1a380cc1c60b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:56.353153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30aa8223-ea09-444f-92c3-1a380cc1c60b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.353685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7e496493-afaf-459a-b639-506c5a11d45b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "POST /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/action" status: 202 len: 0 microversion: 2.1 time: 0.173615 Sep 13 20:01:56.354554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30aa8223-ea09-444f-92c3-1a380cc1c60b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.355104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 228/497] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 13 20:01:56 2022] POST /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:01:56.355986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30aa8223-ea09-444f-92c3-1a380cc1c60b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.357274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30aa8223-ea09-444f-92c3-1a380cc1c60b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.358026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30aa8223-ea09-444f-92c3-1a380cc1c60b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.359045 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30aa8223-ea09-444f-92c3-1a380cc1c60b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.365358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-547545e6-d39b-41ff-a05c-ed63d7e0463d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:56.366770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-547545e6-d39b-41ff-a05c-ed63d7e0463d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:56.379437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-547545e6-d39b-41ff-a05c-ed63d7e0463d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.380762 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-547545e6-d39b-41ff-a05c-ed63d7e0463d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.381346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-547545e6-d39b-41ff-a05c-ed63d7e0463d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.382584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-547545e6-d39b-41ff-a05c-ed63d7e0463d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.383328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-547545e6-d39b-41ff-a05c-ed63d7e0463d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.384082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-547545e6-d39b-41ff-a05c-ed63d7e0463d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.476519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-30aa8223-ea09-444f-92c3-1a380cc1c60b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:56.489724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-30aa8223-ea09-444f-92c3-1a380cc1c60b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1277 microversion: 2.1 time: 0.161525 Sep 13 20:01:56.490831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 270/498] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:56 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:56.562011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9b1d11cd-7937-46b0-a132-e4223dab8034 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:56.562901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9b1d11cd-7937-46b0-a132-e4223dab8034 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:56.574124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b1d11cd-7937-46b0-a132-e4223dab8034 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.574124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b1d11cd-7937-46b0-a132-e4223dab8034 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.574685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b1d11cd-7937-46b0-a132-e4223dab8034 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.576019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b1d11cd-7937-46b0-a132-e4223dab8034 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.576818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b1d11cd-7937-46b0-a132-e4223dab8034 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.577592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b1d11cd-7937-46b0-a132-e4223dab8034 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.711102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9b1d11cd-7937-46b0-a132-e4223dab8034 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:56.727066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9b1d11cd-7937-46b0-a132-e4223dab8034 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1254 microversion: 2.1 time: 0.168982 Sep 13 20:01:56.742555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 271/499] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:56 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1254 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:56.805956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-547545e6-d39b-41ff-a05c-ed63d7e0463d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:56.828825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-547545e6-d39b-41ff-a05c-ed63d7e0463d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.468480 Sep 13 20:01:56.829426 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 229/500] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:56 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:57.026885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7affaa9b-f902-49cd-8616-0572eb9d2112 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:57.028275 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7affaa9b-f902-49cd-8616-0572eb9d2112 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:57.040119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7affaa9b-f902-49cd-8616-0572eb9d2112 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.041486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7affaa9b-f902-49cd-8616-0572eb9d2112 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.042396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7affaa9b-f902-49cd-8616-0572eb9d2112 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.044161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7affaa9b-f902-49cd-8616-0572eb9d2112 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.045000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7affaa9b-f902-49cd-8616-0572eb9d2112 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.045793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7affaa9b-f902-49cd-8616-0572eb9d2112 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.327488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c1773ea9-87f9-42d1-b636-bcac59a8de88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:57.328738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c1773ea9-87f9-42d1-b636-bcac59a8de88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:57.346786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c1773ea9-87f9-42d1-b636-bcac59a8de88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.347553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c1773ea9-87f9-42d1-b636-bcac59a8de88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.348189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c1773ea9-87f9-42d1-b636-bcac59a8de88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.352047 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c1773ea9-87f9-42d1-b636-bcac59a8de88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.352842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c1773ea9-87f9-42d1-b636-bcac59a8de88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.353443 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c1773ea9-87f9-42d1-b636-bcac59a8de88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.387583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7affaa9b-f902-49cd-8616-0572eb9d2112 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:57.404749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7affaa9b-f902-49cd-8616-0572eb9d2112 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1370 microversion: 2.1 time: 0.385871 Sep 13 20:01:57.405938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 272/501] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:57 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1370 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:57.414133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-03828eb1-7838-44c6-9e1a-76126abbf1e7 req-f63033c3-d6f0-4c5b-9d44-e63238c905ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f881820-7e22-41c7-b39e-9f204af9a23c", "name": "network-vif-plugged", "status": "completed", "tag": "3ba9501e-1d87-4e9c-919d-9db2338fa99d"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:57.432522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-03828eb1-7838-44c6-9e1a-76126abbf1e7 req-f63033c3-d6f0-4c5b-9d44-e63238c905ae service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.434080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-03828eb1-7838-44c6-9e1a-76126abbf1e7 req-f63033c3-d6f0-4c5b-9d44-e63238c905ae service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.434629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-03828eb1-7838-44c6-9e1a-76126abbf1e7 req-f63033c3-d6f0-4c5b-9d44-e63238c905ae service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.457264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-03828eb1-7838-44c6-9e1a-76126abbf1e7 req-f63033c3-d6f0-4c5b-9d44-e63238c905ae service nova] Creating event network-vif-plugged:3ba9501e-1d87-4e9c-919d-9db2338fa99d for instance 3f881820-7e22-41c7-b39e-9f204af9a23c on hv-cinder-85427 Sep 13 20:01:57.468434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-03828eb1-7838-44c6-9e1a-76126abbf1e7 req-f63033c3-d6f0-4c5b-9d44-e63238c905ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060300 Sep 13 20:01:57.475874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 273/502] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:01:57.517721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8367c231-6ae4-423c-85dc-ec7ba4b30282 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:57.518446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8367c231-6ae4-423c-85dc-ec7ba4b30282 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:57.540184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8367c231-6ae4-423c-85dc-ec7ba4b30282 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.540678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8367c231-6ae4-423c-85dc-ec7ba4b30282 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.541112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8367c231-6ae4-423c-85dc-ec7ba4b30282 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.559070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8367c231-6ae4-423c-85dc-ec7ba4b30282 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.559588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8367c231-6ae4-423c-85dc-ec7ba4b30282 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.564725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8367c231-6ae4-423c-85dc-ec7ba4b30282 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.772266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c1773ea9-87f9-42d1-b636-bcac59a8de88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:57.782353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c1773ea9-87f9-42d1-b636-bcac59a8de88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:57.783934 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c1773ea9-87f9-42d1-b636-bcac59a8de88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:57.785459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c1773ea9-87f9-42d1-b636-bcac59a8de88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.462845 Sep 13 20:01:57.785995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 230/503] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:57.791150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9a26e003-dc6e-4974-9b72-4d160d9ba666 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:57.792038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9a26e003-dc6e-4974-9b72-4d160d9ba666 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:57.799410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a26e003-dc6e-4974-9b72-4d160d9ba666 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.800099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a26e003-dc6e-4974-9b72-4d160d9ba666 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.800779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a26e003-dc6e-4974-9b72-4d160d9ba666 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.801667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a26e003-dc6e-4974-9b72-4d160d9ba666 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.802269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a26e003-dc6e-4974-9b72-4d160d9ba666 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.802883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a26e003-dc6e-4974-9b72-4d160d9ba666 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.835312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8367c231-6ae4-423c-85dc-ec7ba4b30282 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:57.844751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8367c231-6ae4-423c-85dc-ec7ba4b30282 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1319 microversion: 2.1 time: 0.331872 Sep 13 20:01:57.855108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 274/504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:57 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:57.864953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-603b8f42-1848-41ce-90d8-e9dd5d52c6e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:57.865582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-603b8f42-1848-41ce-90d8-e9dd5d52c6e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:57.883510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-603b8f42-1848-41ce-90d8-e9dd5d52c6e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.885926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-603b8f42-1848-41ce-90d8-e9dd5d52c6e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.891505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-603b8f42-1848-41ce-90d8-e9dd5d52c6e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.892279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-603b8f42-1848-41ce-90d8-e9dd5d52c6e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.893352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-603b8f42-1848-41ce-90d8-e9dd5d52c6e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.893788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-603b8f42-1848-41ce-90d8-e9dd5d52c6e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.904080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:57.919506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9a26e003-dc6e-4974-9b72-4d160d9ba666 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:57.935244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9a26e003-dc6e-4974-9b72-4d160d9ba666 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1310 microversion: 2.1 time: 0.147912 Sep 13 20:01:57.935838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 231/505] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:57 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1310 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:58.133639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-603b8f42-1848-41ce-90d8-e9dd5d52c6e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:58.144549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-603b8f42-1848-41ce-90d8-e9dd5d52c6e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.288158 Sep 13 20:01:58.145134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 275/506] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:57 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:58.429420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9ef9ffad-e242-4a6d-9da0-fb2a7b36d28d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:58.431618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9ef9ffad-e242-4a6d-9da0-fb2a7b36d28d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:58.439093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ef9ffad-e242-4a6d-9da0-fb2a7b36d28d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:58.439851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ef9ffad-e242-4a6d-9da0-fb2a7b36d28d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:58.440452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ef9ffad-e242-4a6d-9da0-fb2a7b36d28d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:58.441440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ef9ffad-e242-4a6d-9da0-fb2a7b36d28d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:58.442252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ef9ffad-e242-4a6d-9da0-fb2a7b36d28d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:58.443005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ef9ffad-e242-4a6d-9da0-fb2a7b36d28d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:58.828663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f1d167d9-1f61-4d85-8c17-f3b993eeee9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:58.831470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f1d167d9-1f61-4d85-8c17-f3b993eeee9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:58.840569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1d167d9-1f61-4d85-8c17-f3b993eeee9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:58.841051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1d167d9-1f61-4d85-8c17-f3b993eeee9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:58.841492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1d167d9-1f61-4d85-8c17-f3b993eeee9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:58.842184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1d167d9-1f61-4d85-8c17-f3b993eeee9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:58.842662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1d167d9-1f61-4d85-8c17-f3b993eeee9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:58.843076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1d167d9-1f61-4d85-8c17-f3b993eeee9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:59.050329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f1d167d9-1f61-4d85-8c17-f3b993eeee9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:59.060760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f1d167d9-1f61-4d85-8c17-f3b993eeee9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:59.063129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f1d167d9-1f61-4d85-8c17-f3b993eeee9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:59.064458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f1d167d9-1f61-4d85-8c17-f3b993eeee9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.246669 Sep 13 20:01:59.065358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 276/507] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:01:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:01:59.089911 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-15f7d892-caf9-472f-8663-2aace2c4bac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:59.095986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-15f7d892-caf9-472f-8663-2aace2c4bac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:59.104384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15f7d892-caf9-472f-8663-2aace2c4bac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:59.104963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15f7d892-caf9-472f-8663-2aace2c4bac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:59.105392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15f7d892-caf9-472f-8663-2aace2c4bac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:59.109059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15f7d892-caf9-472f-8663-2aace2c4bac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:59.109537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15f7d892-caf9-472f-8663-2aace2c4bac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:59.111948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15f7d892-caf9-472f-8663-2aace2c4bac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:59.138831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9ef9ffad-e242-4a6d-9da0-fb2a7b36d28d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:59.150648 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9ef9ffad-e242-4a6d-9da0-fb2a7b36d28d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1370 microversion: 2.1 time: 0.723253 Sep 13 20:01:59.151630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 232/508] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:58 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1370 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:59.170109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b7f4d500-0f65-4c7c-8793-386e7c7c5fcc tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:59.171862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b7f4d500-0f65-4c7c-8793-386e7c7c5fcc tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:59.182504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b7f4d500-0f65-4c7c-8793-386e7c7c5fcc tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:59.187430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b7f4d500-0f65-4c7c-8793-386e7c7c5fcc tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:59.187752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b7f4d500-0f65-4c7c-8793-386e7c7c5fcc tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:59.188558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b7f4d500-0f65-4c7c-8793-386e7c7c5fcc tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:59.188939 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b7f4d500-0f65-4c7c-8793-386e7c7c5fcc tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:59.189362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b7f4d500-0f65-4c7c-8793-386e7c7c5fcc tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:59.333935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b7f4d500-0f65-4c7c-8793-386e7c7c5fcc tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:59.342922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b7f4d500-0f65-4c7c-8793-386e7c7c5fcc tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1316 microversion: 2.1 time: 0.188091 Sep 13 20:01:59.355138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 233/509] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:59 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:59.366529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-06c73dc5-7a4f-49d6-8474-9956cd652b0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:59.367441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-06c73dc5-7a4f-49d6-8474-9956cd652b0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:59.382068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06c73dc5-7a4f-49d6-8474-9956cd652b0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:59.382880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06c73dc5-7a4f-49d6-8474-9956cd652b0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:59.383458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06c73dc5-7a4f-49d6-8474-9956cd652b0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:59.384465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06c73dc5-7a4f-49d6-8474-9956cd652b0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:59.386413 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06c73dc5-7a4f-49d6-8474-9956cd652b0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:59.386413 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06c73dc5-7a4f-49d6-8474-9956cd652b0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:59.458652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-15f7d892-caf9-472f-8663-2aace2c4bac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:59.472718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-15f7d892-caf9-472f-8663-2aace2c4bac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1319 microversion: 2.1 time: 0.405823 Sep 13 20:01:59.473814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 277/510] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:59 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:59.552595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-df0ab7a9-37f5-42ff-ac9e-a60da55c6958 req-994204e9-13cc-4036-9fb0-b8d0e491c916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de498757-f0f1-4f8b-a415-4d6b12f64d37", "tag": "9aeccc5e-2b60-45ce-b5df-124a9dc9d3ac"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:59.565153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-df0ab7a9-37f5-42ff-ac9e-a60da55c6958 req-994204e9-13cc-4036-9fb0-b8d0e491c916 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:59.565855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-df0ab7a9-37f5-42ff-ac9e-a60da55c6958 req-994204e9-13cc-4036-9fb0-b8d0e491c916 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:59.566557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-df0ab7a9-37f5-42ff-ac9e-a60da55c6958 req-994204e9-13cc-4036-9fb0-b8d0e491c916 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:59.591499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-df0ab7a9-37f5-42ff-ac9e-a60da55c6958 req-994204e9-13cc-4036-9fb0-b8d0e491c916 service nova] Creating event network-changed:9aeccc5e-2b60-45ce-b5df-124a9dc9d3ac for instance de498757-f0f1-4f8b-a415-4d6b12f64d37 on hv-cinder-85427 Sep 13 20:01:59.604186 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-df0ab7a9-37f5-42ff-ac9e-a60da55c6958 req-994204e9-13cc-4036-9fb0-b8d0e491c916 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055331 Sep 13 20:01:59.604814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 278/511] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:01:59.793155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-06c73dc5-7a4f-49d6-8474-9956cd652b0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:59.813364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-06c73dc5-7a4f-49d6-8474-9956cd652b0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.455667 Sep 13 20:01:59.843658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 234/512] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:59 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:00.101567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9456ba90-03f7-4d7a-95f7-7b451a0be001 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:00.103311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9456ba90-03f7-4d7a-95f7-7b451a0be001 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:00.112271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9456ba90-03f7-4d7a-95f7-7b451a0be001 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:00.113080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9456ba90-03f7-4d7a-95f7-7b451a0be001 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:00.113847 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9456ba90-03f7-4d7a-95f7-7b451a0be001 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:00.114968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9456ba90-03f7-4d7a-95f7-7b451a0be001 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:00.115650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9456ba90-03f7-4d7a-95f7-7b451a0be001 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:00.116143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9456ba90-03f7-4d7a-95f7-7b451a0be001 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:00.213620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-10f58e50-f684-4a3f-974c-7ddce3341ee7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:00.224054 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-10f58e50-f684-4a3f-974c-7ddce3341ee7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:00.249310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10f58e50-f684-4a3f-974c-7ddce3341ee7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:00.252069 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10f58e50-f684-4a3f-974c-7ddce3341ee7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:00.253787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10f58e50-f684-4a3f-974c-7ddce3341ee7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:00.257777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10f58e50-f684-4a3f-974c-7ddce3341ee7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:00.261060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10f58e50-f684-4a3f-974c-7ddce3341ee7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:00.262574 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10f58e50-f684-4a3f-974c-7ddce3341ee7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:00.368564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9456ba90-03f7-4d7a-95f7-7b451a0be001 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:00.400817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9456ba90-03f7-4d7a-95f7-7b451a0be001 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:00.408989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9456ba90-03f7-4d7a-95f7-7b451a0be001 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:00.410716 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9456ba90-03f7-4d7a-95f7-7b451a0be001 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.314929 Sep 13 20:02:00.438689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 279/513] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:00 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:00.459423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ea944fc4-fe5a-4263-aa94-cf19e9ee7140 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:00.460386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ea944fc4-fe5a-4263-aa94-cf19e9ee7140 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:00.471907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ea944fc4-fe5a-4263-aa94-cf19e9ee7140 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:00.472734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ea944fc4-fe5a-4263-aa94-cf19e9ee7140 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:00.473345 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ea944fc4-fe5a-4263-aa94-cf19e9ee7140 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:00.474208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ea944fc4-fe5a-4263-aa94-cf19e9ee7140 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:00.474850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ea944fc4-fe5a-4263-aa94-cf19e9ee7140 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:00.475423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ea944fc4-fe5a-4263-aa94-cf19e9ee7140 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:00.944905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ea944fc4-fe5a-4263-aa94-cf19e9ee7140 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:00.954095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ea944fc4-fe5a-4263-aa94-cf19e9ee7140 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.513412 Sep 13 20:02:00.959125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 280/514] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:00 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:00.977365 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ef2aa562-ce65-4748-a2c9-9f54b4832256 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:00.979785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ef2aa562-ce65-4748-a2c9-9f54b4832256 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:01.001951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef2aa562-ce65-4748-a2c9-9f54b4832256 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:01.006748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef2aa562-ce65-4748-a2c9-9f54b4832256 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:01.007356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef2aa562-ce65-4748-a2c9-9f54b4832256 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:01.008122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef2aa562-ce65-4748-a2c9-9f54b4832256 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:01.008592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef2aa562-ce65-4748-a2c9-9f54b4832256 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:01.009016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef2aa562-ce65-4748-a2c9-9f54b4832256 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:01.053548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-10f58e50-f684-4a3f-974c-7ddce3341ee7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:01.069332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-10f58e50-f684-4a3f-974c-7ddce3341ee7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1564 microversion: 2.1 time: 0.880168 Sep 13 20:02:01.070714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 235/515] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:00 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1564 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:01.079669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-704998fb-1828-4416-9e04-923b2fe5a70e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:01.083001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-704998fb-1828-4416-9e04-923b2fe5a70e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:01.106254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-704998fb-1828-4416-9e04-923b2fe5a70e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:01.106968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-704998fb-1828-4416-9e04-923b2fe5a70e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:01.109525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-704998fb-1828-4416-9e04-923b2fe5a70e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:01.110291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-704998fb-1828-4416-9e04-923b2fe5a70e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:01.111143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-704998fb-1828-4416-9e04-923b2fe5a70e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:01.111260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-704998fb-1828-4416-9e04-923b2fe5a70e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:01.598111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ef2aa562-ce65-4748-a2c9-9f54b4832256 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:01.608990 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ef2aa562-ce65-4748-a2c9-9f54b4832256 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1319 microversion: 2.1 time: 0.644394 Sep 13 20:02:01.610227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 281/516] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:00 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1319 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:01.637200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dea4f186-b1d3-4ce3-a67b-c7b07bd292cf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:01.637956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dea4f186-b1d3-4ce3-a67b-c7b07bd292cf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:01.645719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dea4f186-b1d3-4ce3-a67b-c7b07bd292cf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:01.658820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dea4f186-b1d3-4ce3-a67b-c7b07bd292cf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:01.659273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dea4f186-b1d3-4ce3-a67b-c7b07bd292cf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:01.660075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dea4f186-b1d3-4ce3-a67b-c7b07bd292cf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:01.662453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dea4f186-b1d3-4ce3-a67b-c7b07bd292cf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:01.663001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dea4f186-b1d3-4ce3-a67b-c7b07bd292cf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:01.722067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-704998fb-1828-4416-9e04-923b2fe5a70e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:01.730821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-704998fb-1828-4416-9e04-923b2fe5a70e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.658402 Sep 13 20:02:01.731407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 236/517] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:01.736692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-35792ac4-bdc4-48ad-ab90-ee21294070d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:01.751794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-35792ac4-bdc4-48ad-ab90-ee21294070d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:01.768270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35792ac4-bdc4-48ad-ab90-ee21294070d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:01.769004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35792ac4-bdc4-48ad-ab90-ee21294070d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:01.769638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35792ac4-bdc4-48ad-ab90-ee21294070d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:01.770361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35792ac4-bdc4-48ad-ab90-ee21294070d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:01.770845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35792ac4-bdc4-48ad-ab90-ee21294070d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:01.771264 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35792ac4-bdc4-48ad-ab90-ee21294070d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:01.836310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dea4f186-b1d3-4ce3-a67b-c7b07bd292cf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203082 Sep 13 20:02:01.837888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 282/518] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 13 20:02:01 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:01.987431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-276a1899-ba1d-4526-bd8e-6bd24029cebf tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:01.988467 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-276a1899-ba1d-4526-bd8e-6bd24029cebf tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:02.001425 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-276a1899-ba1d-4526-bd8e-6bd24029cebf tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:02.002316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-276a1899-ba1d-4526-bd8e-6bd24029cebf tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:02.003030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-276a1899-ba1d-4526-bd8e-6bd24029cebf tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:02.007919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-276a1899-ba1d-4526-bd8e-6bd24029cebf tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:02.008847 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-276a1899-ba1d-4526-bd8e-6bd24029cebf tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:02.009567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-276a1899-ba1d-4526-bd8e-6bd24029cebf tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:02.518626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-276a1899-ba1d-4526-bd8e-6bd24029cebf tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:02.535541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-276a1899-ba1d-4526-bd8e-6bd24029cebf tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.552325 Sep 13 20:02:02.536898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 283/519] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:01 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:02.634330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c1cb0c1d-9634-4ccf-942b-bedfe081f191 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:02.635227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c1cb0c1d-9634-4ccf-942b-bedfe081f191 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:02.647146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1cb0c1d-9634-4ccf-942b-bedfe081f191 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:02.648012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1cb0c1d-9634-4ccf-942b-bedfe081f191 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:02.657555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1cb0c1d-9634-4ccf-942b-bedfe081f191 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:02.659198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1cb0c1d-9634-4ccf-942b-bedfe081f191 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:02.660758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1cb0c1d-9634-4ccf-942b-bedfe081f191 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:02.661538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1cb0c1d-9634-4ccf-942b-bedfe081f191 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:02.663123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-35792ac4-bdc4-48ad-ab90-ee21294070d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:02.676313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-35792ac4-bdc4-48ad-ab90-ee21294070d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:02.677828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-35792ac4-bdc4-48ad-ab90-ee21294070d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:02.679065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-35792ac4-bdc4-48ad-ab90-ee21294070d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.946352 Sep 13 20:02:02.697894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 237/520] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:02.759707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fb835e9c-0cb6-4a84-9bea-3cb7619aeedf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:02.760601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fb835e9c-0cb6-4a84-9bea-3cb7619aeedf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:02.774258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb835e9c-0cb6-4a84-9bea-3cb7619aeedf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:02.775317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb835e9c-0cb6-4a84-9bea-3cb7619aeedf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:02.776006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb835e9c-0cb6-4a84-9bea-3cb7619aeedf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:02.776950 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb835e9c-0cb6-4a84-9bea-3cb7619aeedf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:02.777560 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb835e9c-0cb6-4a84-9bea-3cb7619aeedf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:02.782926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb835e9c-0cb6-4a84-9bea-3cb7619aeedf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:03.024102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c1cb0c1d-9634-4ccf-942b-bedfe081f191 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:03.046274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c1cb0c1d-9634-4ccf-942b-bedfe081f191 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1319 microversion: 2.1 time: 0.417499 Sep 13 20:02:03.054060 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 284/521] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:02 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:03.587809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cc434fd9-220c-4056-b775-4f5c3179f3f8 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:03.590539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cc434fd9-220c-4056-b775-4f5c3179f3f8 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:03.623256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc434fd9-220c-4056-b775-4f5c3179f3f8 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:03.624196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc434fd9-220c-4056-b775-4f5c3179f3f8 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:03.625000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc434fd9-220c-4056-b775-4f5c3179f3f8 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:03.625960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc434fd9-220c-4056-b775-4f5c3179f3f8 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:03.627230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc434fd9-220c-4056-b775-4f5c3179f3f8 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:03.628216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc434fd9-220c-4056-b775-4f5c3179f3f8 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:03.700317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fb835e9c-0cb6-4a84-9bea-3cb7619aeedf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:03.734424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fb835e9c-0cb6-4a84-9bea-3cb7619aeedf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.978422 Sep 13 20:02:03.745493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 238/522] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:02 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:03.754411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e05c3b7a-37ed-407e-bf70-cbf6fe201eeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:03.766706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e05c3b7a-37ed-407e-bf70-cbf6fe201eeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:03.786931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e05c3b7a-37ed-407e-bf70-cbf6fe201eeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:03.797222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e05c3b7a-37ed-407e-bf70-cbf6fe201eeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:03.798506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e05c3b7a-37ed-407e-bf70-cbf6fe201eeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:03.800052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e05c3b7a-37ed-407e-bf70-cbf6fe201eeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:03.801254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e05c3b7a-37ed-407e-bf70-cbf6fe201eeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:03.802308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e05c3b7a-37ed-407e-bf70-cbf6fe201eeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:03.986138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cc434fd9-220c-4056-b775-4f5c3179f3f8 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:04.001523 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cc434fd9-220c-4056-b775-4f5c3179f3f8 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.442756 Sep 13 20:02:04.002801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 285/523] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:03 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:04.080469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9d29316b-92a4-4edf-9e12-ed5c16cbebd7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:04.081154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9d29316b-92a4-4edf-9e12-ed5c16cbebd7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:04.094021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9d29316b-92a4-4edf-9e12-ed5c16cbebd7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:04.097253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9d29316b-92a4-4edf-9e12-ed5c16cbebd7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:04.097793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9d29316b-92a4-4edf-9e12-ed5c16cbebd7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:04.101715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9d29316b-92a4-4edf-9e12-ed5c16cbebd7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:04.104424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9d29316b-92a4-4edf-9e12-ed5c16cbebd7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:04.104960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9d29316b-92a4-4edf-9e12-ed5c16cbebd7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:04.578838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9d29316b-92a4-4edf-9e12-ed5c16cbebd7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:04.596765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9d29316b-92a4-4edf-9e12-ed5c16cbebd7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1319 microversion: 2.1 time: 0.521131 Sep 13 20:02:04.597426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 286/524] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:04 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:04.729104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e05c3b7a-37ed-407e-bf70-cbf6fe201eeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:04.744177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e05c3b7a-37ed-407e-bf70-cbf6fe201eeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:04.748767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e05c3b7a-37ed-407e-bf70-cbf6fe201eeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:04.755790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e05c3b7a-37ed-407e-bf70-cbf6fe201eeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 1.008267 Sep 13 20:02:04.756667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 239/525] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:04.774647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f5339685-1c0c-4b0d-9611-9a890e9f4d12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:04.775298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f5339685-1c0c-4b0d-9611-9a890e9f4d12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:04.782231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5339685-1c0c-4b0d-9611-9a890e9f4d12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:04.782797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5339685-1c0c-4b0d-9611-9a890e9f4d12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:04.783192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5339685-1c0c-4b0d-9611-9a890e9f4d12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:04.792277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5339685-1c0c-4b0d-9611-9a890e9f4d12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:04.792784 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5339685-1c0c-4b0d-9611-9a890e9f4d12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:04.793226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5339685-1c0c-4b0d-9611-9a890e9f4d12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:05.028704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-31767e12-066a-462d-bda1-94243a792118 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:05.029335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-31767e12-066a-462d-bda1-94243a792118 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:05.038499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31767e12-066a-462d-bda1-94243a792118 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:05.042193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31767e12-066a-462d-bda1-94243a792118 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:05.042863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31767e12-066a-462d-bda1-94243a792118 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:05.043788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31767e12-066a-462d-bda1-94243a792118 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:05.047008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31767e12-066a-462d-bda1-94243a792118 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:05.047630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31767e12-066a-462d-bda1-94243a792118 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:05.104378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f5339685-1c0c-4b0d-9611-9a890e9f4d12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:05.119888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f5339685-1c0c-4b0d-9611-9a890e9f4d12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.349240 Sep 13 20:02:05.121087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 287/526] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:04 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:05.288194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=4 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:05.297531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-3ad0cd54-5249-4d6a-92d2-9204c3fdfb6f req-efcd1a0f-967a-4d40-a02e-634634d05e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e", "tag": "bdaedf1b-a56e-4be7-a8ed-5597bad3622d"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:05.311298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=16 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:05.318531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-3ad0cd54-5249-4d6a-92d2-9204c3fdfb6f req-efcd1a0f-967a-4d40-a02e-634634d05e74 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:05.319258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-3ad0cd54-5249-4d6a-92d2-9204c3fdfb6f req-efcd1a0f-967a-4d40-a02e-634634d05e74 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:05.319827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-3ad0cd54-5249-4d6a-92d2-9204c3fdfb6f req-efcd1a0f-967a-4d40-a02e-634634d05e74 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:05.333289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-3ad0cd54-5249-4d6a-92d2-9204c3fdfb6f req-efcd1a0f-967a-4d40-a02e-634634d05e74 service nova] Creating event network-changed:bdaedf1b-a56e-4be7-a8ed-5597bad3622d for instance 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e on hv-cinder-85427 Sep 13 20:02:05.339481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-3ad0cd54-5249-4d6a-92d2-9204c3fdfb6f req-efcd1a0f-967a-4d40-a02e-634634d05e74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047421 Sep 13 20:02:05.340652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 288/527] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:05.470818 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-31767e12-066a-462d-bda1-94243a792118 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:05.484096 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-31767e12-066a-462d-bda1-94243a792118 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.459724 Sep 13 20:02:05.508365 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 240/528] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:05 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:05.620617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=4 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:05.625393 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-53314c05-7093-499d-900a-d931ffbe353e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:05.626473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-53314c05-7093-499d-900a-d931ffbe353e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:05.641864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53314c05-7093-499d-900a-d931ffbe353e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:05.642863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53314c05-7093-499d-900a-d931ffbe353e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:05.645258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53314c05-7093-499d-900a-d931ffbe353e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:05.646267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53314c05-7093-499d-900a-d931ffbe353e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:05.647249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53314c05-7093-499d-900a-d931ffbe353e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:05.648385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53314c05-7093-499d-900a-d931ffbe353e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:05.787503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-28b58fd0-6f28-4536-aad7-c1aabebb7a3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:05.788817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-28b58fd0-6f28-4536-aad7-c1aabebb7a3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:05.800944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28b58fd0-6f28-4536-aad7-c1aabebb7a3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:05.801674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28b58fd0-6f28-4536-aad7-c1aabebb7a3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:05.802283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28b58fd0-6f28-4536-aad7-c1aabebb7a3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:05.803577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28b58fd0-6f28-4536-aad7-c1aabebb7a3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:05.804352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28b58fd0-6f28-4536-aad7-c1aabebb7a3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:05.807946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28b58fd0-6f28-4536-aad7-c1aabebb7a3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:05.878252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:06.054863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-53314c05-7093-499d-900a-d931ffbe353e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:06.082695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-53314c05-7093-499d-900a-d931ffbe353e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1319 microversion: 2.1 time: 0.455944 Sep 13 20:02:06.102956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 289/529] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:05 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:06.146651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-78c324fc-e877-4e8d-baa4-d03af4da667a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:06.149513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-78c324fc-e877-4e8d-baa4-d03af4da667a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:06.163864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-78c324fc-e877-4e8d-baa4-d03af4da667a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:06.164736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-78c324fc-e877-4e8d-baa4-d03af4da667a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:06.165634 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-78c324fc-e877-4e8d-baa4-d03af4da667a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:06.166657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-78c324fc-e877-4e8d-baa4-d03af4da667a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:06.167281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-78c324fc-e877-4e8d-baa4-d03af4da667a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:06.167858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-78c324fc-e877-4e8d-baa4-d03af4da667a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:06.213218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-28b58fd0-6f28-4536-aad7-c1aabebb7a3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:06.231930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-28b58fd0-6f28-4536-aad7-c1aabebb7a3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:06.260161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-28b58fd0-6f28-4536-aad7-c1aabebb7a3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:06.262154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-28b58fd0-6f28-4536-aad7-c1aabebb7a3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.478303 Sep 13 20:02:06.267452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 241/530] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:06.519611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-155428ef-e276-4973-8583-d3f1da106b25 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:06.521209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-155428ef-e276-4973-8583-d3f1da106b25 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:06.538975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-155428ef-e276-4973-8583-d3f1da106b25 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:06.541754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-155428ef-e276-4973-8583-d3f1da106b25 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:06.544594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-155428ef-e276-4973-8583-d3f1da106b25 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:06.549919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-155428ef-e276-4973-8583-d3f1da106b25 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:06.551685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-155428ef-e276-4973-8583-d3f1da106b25 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:06.552351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-155428ef-e276-4973-8583-d3f1da106b25 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:06.761289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-78c324fc-e877-4e8d-baa4-d03af4da667a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:06.782660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-78c324fc-e877-4e8d-baa4-d03af4da667a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.632102 Sep 13 20:02:06.786845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 290/531] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:06.937998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-155428ef-e276-4973-8583-d3f1da106b25 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:06.947205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-155428ef-e276-4973-8583-d3f1da106b25 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.432071 Sep 13 20:02:06.948093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 242/532] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:06 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:07.108709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-54c8d298-bed4-440a-875d-ee64def4a900 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:07.109325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-54c8d298-bed4-440a-875d-ee64def4a900 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:07.128026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54c8d298-bed4-440a-875d-ee64def4a900 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:07.128675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54c8d298-bed4-440a-875d-ee64def4a900 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:07.129119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54c8d298-bed4-440a-875d-ee64def4a900 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:07.129967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54c8d298-bed4-440a-875d-ee64def4a900 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:07.134352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54c8d298-bed4-440a-875d-ee64def4a900 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:07.140127 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54c8d298-bed4-440a-875d-ee64def4a900 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:07.296460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e31bdbbf-64ab-48c3-a4d9-1db8ed923a10 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:07.297083 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e31bdbbf-64ab-48c3-a4d9-1db8ed923a10 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:07.314511 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e31bdbbf-64ab-48c3-a4d9-1db8ed923a10 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:07.315008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e31bdbbf-64ab-48c3-a4d9-1db8ed923a10 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:07.316025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e31bdbbf-64ab-48c3-a4d9-1db8ed923a10 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:07.316872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e31bdbbf-64ab-48c3-a4d9-1db8ed923a10 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:07.317336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e31bdbbf-64ab-48c3-a4d9-1db8ed923a10 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:07.317758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e31bdbbf-64ab-48c3-a4d9-1db8ed923a10 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:07.449785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-54c8d298-bed4-440a-875d-ee64def4a900 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:07.460742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-54c8d298-bed4-440a-875d-ee64def4a900 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1319 microversion: 2.1 time: 0.355779 Sep 13 20:02:07.471469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 291/533] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:07 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:07.479057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-198ab12e-b48c-4762-b651-b9b28dedb464 req-e8480833-347c-4baf-9f44-e490edb8fd50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f881820-7e22-41c7-b39e-9f204af9a23c", "tag": "3ba9501e-1d87-4e9c-919d-9db2338fa99d"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:07.514143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-198ab12e-b48c-4762-b651-b9b28dedb464 req-e8480833-347c-4baf-9f44-e490edb8fd50 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:07.514652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-198ab12e-b48c-4762-b651-b9b28dedb464 req-e8480833-347c-4baf-9f44-e490edb8fd50 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:07.515077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-198ab12e-b48c-4762-b651-b9b28dedb464 req-e8480833-347c-4baf-9f44-e490edb8fd50 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:07.566646 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-198ab12e-b48c-4762-b651-b9b28dedb464 req-e8480833-347c-4baf-9f44-e490edb8fd50 service nova] Creating event network-changed:3ba9501e-1d87-4e9c-919d-9db2338fa99d for instance 3f881820-7e22-41c7-b39e-9f204af9a23c on hv-cinder-85427 Sep 13 20:02:07.584963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-198ab12e-b48c-4762-b651-b9b28dedb464 req-e8480833-347c-4baf-9f44-e490edb8fd50 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111879 Sep 13 20:02:07.585738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 292/534] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:07.763977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e31bdbbf-64ab-48c3-a4d9-1db8ed923a10 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:07.774719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e31bdbbf-64ab-48c3-a4d9-1db8ed923a10 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:07.790752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e31bdbbf-64ab-48c3-a4d9-1db8ed923a10 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:07.794127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e31bdbbf-64ab-48c3-a4d9-1db8ed923a10 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.503177 Sep 13 20:02:07.797223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 243/535] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:07.822118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b83c6f55-1749-4271-8b83-779e67b64256 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:07.822912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b83c6f55-1749-4271-8b83-779e67b64256 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:07.834603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b83c6f55-1749-4271-8b83-779e67b64256 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:07.834977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b83c6f55-1749-4271-8b83-779e67b64256 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:07.845200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b83c6f55-1749-4271-8b83-779e67b64256 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:07.846317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b83c6f55-1749-4271-8b83-779e67b64256 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:07.847229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b83c6f55-1749-4271-8b83-779e67b64256 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:07.847994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b83c6f55-1749-4271-8b83-779e67b64256 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:07.990396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-43641128-af97-4fb7-984b-305c8cd4bd78 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:08.003921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-43641128-af97-4fb7-984b-305c8cd4bd78 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:08.059634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43641128-af97-4fb7-984b-305c8cd4bd78 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:08.061694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43641128-af97-4fb7-984b-305c8cd4bd78 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:08.062510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43641128-af97-4fb7-984b-305c8cd4bd78 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:08.082730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43641128-af97-4fb7-984b-305c8cd4bd78 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:08.083760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43641128-af97-4fb7-984b-305c8cd4bd78 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:08.084528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43641128-af97-4fb7-984b-305c8cd4bd78 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:08.119014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b83c6f55-1749-4271-8b83-779e67b64256 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:08.132156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b83c6f55-1749-4271-8b83-779e67b64256 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.314753 Sep 13 20:02:08.132748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 293/536] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:08.487677 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b0b66da0-df25-431f-86c2-1514bd592127 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:08.489174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b0b66da0-df25-431f-86c2-1514bd592127 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:08.504529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b0b66da0-df25-431f-86c2-1514bd592127 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:08.505461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b0b66da0-df25-431f-86c2-1514bd592127 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:08.506141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b0b66da0-df25-431f-86c2-1514bd592127 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:08.507431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b0b66da0-df25-431f-86c2-1514bd592127 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:08.508094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b0b66da0-df25-431f-86c2-1514bd592127 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:08.509611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b0b66da0-df25-431f-86c2-1514bd592127 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:08.520168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:08.758804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-43641128-af97-4fb7-984b-305c8cd4bd78 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:08.772383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-43641128-af97-4fb7-984b-305c8cd4bd78 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.797216 Sep 13 20:02:08.782569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 244/537] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:07 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:08.817014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b0b66da0-df25-431f-86c2-1514bd592127 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:08.828955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8f27b864-1b08-4746-84e5-355de69b9ca2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:08.830202 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8f27b864-1b08-4746-84e5-355de69b9ca2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:08.834939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b0b66da0-df25-431f-86c2-1514bd592127 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1319 microversion: 2.1 time: 0.351561 Sep 13 20:02:08.848453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f27b864-1b08-4746-84e5-355de69b9ca2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:08.850144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f27b864-1b08-4746-84e5-355de69b9ca2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:08.851200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 294/538] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:08 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:08.853134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f27b864-1b08-4746-84e5-355de69b9ca2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:08.859046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f27b864-1b08-4746-84e5-355de69b9ca2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:08.867395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f27b864-1b08-4746-84e5-355de69b9ca2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:08.872580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f27b864-1b08-4746-84e5-355de69b9ca2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:09.163047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4c2aaa55-3587-4c80-a775-92893d13abf8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:09.164692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4c2aaa55-3587-4c80-a775-92893d13abf8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:09.179750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c2aaa55-3587-4c80-a775-92893d13abf8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:09.180571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c2aaa55-3587-4c80-a775-92893d13abf8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:09.194090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c2aaa55-3587-4c80-a775-92893d13abf8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:09.195025 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c2aaa55-3587-4c80-a775-92893d13abf8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:09.195553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c2aaa55-3587-4c80-a775-92893d13abf8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:09.197852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c2aaa55-3587-4c80-a775-92893d13abf8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:09.635264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4c2aaa55-3587-4c80-a775-92893d13abf8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:09.680422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4c2aaa55-3587-4c80-a775-92893d13abf8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.523578 Sep 13 20:02:09.683306 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 295/539] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:09.812182 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c8f52a3d-d93a-4cdd-a64e-300a9a97de69 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:09.851077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c8f52a3d-d93a-4cdd-a64e-300a9a97de69 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:09.901260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8f52a3d-d93a-4cdd-a64e-300a9a97de69 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:09.902256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8f52a3d-d93a-4cdd-a64e-300a9a97de69 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:09.902256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8f52a3d-d93a-4cdd-a64e-300a9a97de69 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:09.903058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8f52a3d-d93a-4cdd-a64e-300a9a97de69 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:09.903526 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8f52a3d-d93a-4cdd-a64e-300a9a97de69 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:09.903951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8f52a3d-d93a-4cdd-a64e-300a9a97de69 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:10.299346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8f27b864-1b08-4746-84e5-355de69b9ca2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:10.328254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8f27b864-1b08-4746-84e5-355de69b9ca2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:10.337392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8f27b864-1b08-4746-84e5-355de69b9ca2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:10.345283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8f27b864-1b08-4746-84e5-355de69b9ca2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 1.517754 Sep 13 20:02:10.350684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 245/540] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:02:10.387425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-caf07968-77bb-4cb9-b15c-b4d6c25ff68d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:10.395008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-caf07968-77bb-4cb9-b15c-b4d6c25ff68d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:10.422650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-caf07968-77bb-4cb9-b15c-b4d6c25ff68d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:10.428559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-caf07968-77bb-4cb9-b15c-b4d6c25ff68d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:10.431749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-caf07968-77bb-4cb9-b15c-b4d6c25ff68d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:10.437102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-caf07968-77bb-4cb9-b15c-b4d6c25ff68d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:10.440086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-caf07968-77bb-4cb9-b15c-b4d6c25ff68d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:10.440620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-caf07968-77bb-4cb9-b15c-b4d6c25ff68d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:10.734035 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c8f52a3d-d93a-4cdd-a64e-300a9a97de69 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:10.748173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c8f52a3d-d93a-4cdd-a64e-300a9a97de69 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.945431 Sep 13 20:02:10.748809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 296/541] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:09 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:10.763283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4741cf75-d390-4aa9-b9d7-8581cc21fd25 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:10.763938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4741cf75-d390-4aa9-b9d7-8581cc21fd25 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:10.779938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4741cf75-d390-4aa9-b9d7-8581cc21fd25 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:10.780461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4741cf75-d390-4aa9-b9d7-8581cc21fd25 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:10.780961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4741cf75-d390-4aa9-b9d7-8581cc21fd25 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:10.781711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4741cf75-d390-4aa9-b9d7-8581cc21fd25 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:10.782177 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4741cf75-d390-4aa9-b9d7-8581cc21fd25 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:10.784387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4741cf75-d390-4aa9-b9d7-8581cc21fd25 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:10.964854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-caf07968-77bb-4cb9-b15c-b4d6c25ff68d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:10.985469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-caf07968-77bb-4cb9-b15c-b4d6c25ff68d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1319 microversion: 2.1 time: 0.632429 Sep 13 20:02:10.986458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 246/542] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:10 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1319 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:11.194675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4741cf75-d390-4aa9-b9d7-8581cc21fd25 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:11.205651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4741cf75-d390-4aa9-b9d7-8581cc21fd25 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.449474 Sep 13 20:02:11.206649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 297/543] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:10 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:11.395396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9522cf6f-7c5c-4ac9-8e8f-fb79210d5fa5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:11.396520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9522cf6f-7c5c-4ac9-8e8f-fb79210d5fa5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:11.416184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9522cf6f-7c5c-4ac9-8e8f-fb79210d5fa5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:11.417079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9522cf6f-7c5c-4ac9-8e8f-fb79210d5fa5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:11.418943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9522cf6f-7c5c-4ac9-8e8f-fb79210d5fa5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:11.421468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9522cf6f-7c5c-4ac9-8e8f-fb79210d5fa5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:11.425408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9522cf6f-7c5c-4ac9-8e8f-fb79210d5fa5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:11.426125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9522cf6f-7c5c-4ac9-8e8f-fb79210d5fa5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:11.797511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-592c5260-f091-4981-a6f9-d84e32715989 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:11.799210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-592c5260-f091-4981-a6f9-d84e32715989 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:11.830715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9522cf6f-7c5c-4ac9-8e8f-fb79210d5fa5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:11.832590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-592c5260-f091-4981-a6f9-d84e32715989 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:11.835196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-592c5260-f091-4981-a6f9-d84e32715989 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:11.839110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-592c5260-f091-4981-a6f9-d84e32715989 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:11.840402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-592c5260-f091-4981-a6f9-d84e32715989 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:11.842115 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-592c5260-f091-4981-a6f9-d84e32715989 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:11.844272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-592c5260-f091-4981-a6f9-d84e32715989 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:11.845233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9522cf6f-7c5c-4ac9-8e8f-fb79210d5fa5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:11.847555 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9522cf6f-7c5c-4ac9-8e8f-fb79210d5fa5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:11.856584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9522cf6f-7c5c-4ac9-8e8f-fb79210d5fa5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.466999 Sep 13 20:02:11.857637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 247/544] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:11 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:11.863054 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-9dc620f7-55c6-4cab-a9b2-f4f07787ad57 req-f991be5a-13fe-4a66-8ce0-9fac5d76d8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de498757-f0f1-4f8b-a415-4d6b12f64d37", "name": "network-vif-plugged", "status": "completed", "tag": "9aeccc5e-2b60-45ce-b5df-124a9dc9d3ac"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:11.910673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-9dc620f7-55c6-4cab-a9b2-f4f07787ad57 req-f991be5a-13fe-4a66-8ce0-9fac5d76d8b5 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:11.913249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-9dc620f7-55c6-4cab-a9b2-f4f07787ad57 req-f991be5a-13fe-4a66-8ce0-9fac5d76d8b5 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:11.914835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-9dc620f7-55c6-4cab-a9b2-f4f07787ad57 req-f991be5a-13fe-4a66-8ce0-9fac5d76d8b5 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:11.962676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-9dc620f7-55c6-4cab-a9b2-f4f07787ad57 req-f991be5a-13fe-4a66-8ce0-9fac5d76d8b5 service nova] Creating event network-vif-plugged:9aeccc5e-2b60-45ce-b5df-124a9dc9d3ac for instance de498757-f0f1-4f8b-a415-4d6b12f64d37 on hv-cinder-85427 Sep 13 20:02:11.984866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-9dc620f7-55c6-4cab-a9b2-f4f07787ad57 req-f991be5a-13fe-4a66-8ce0-9fac5d76d8b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123166 Sep 13 20:02:11.985665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 248/545] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:12.042796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-09e9cf28-823d-438a-a165-0f9ea067b141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:12.043869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-09e9cf28-823d-438a-a165-0f9ea067b141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:12.056133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09e9cf28-823d-438a-a165-0f9ea067b141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:12.067579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09e9cf28-823d-438a-a165-0f9ea067b141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:12.068321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09e9cf28-823d-438a-a165-0f9ea067b141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:12.069252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09e9cf28-823d-438a-a165-0f9ea067b141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:12.077666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09e9cf28-823d-438a-a165-0f9ea067b141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:12.078467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09e9cf28-823d-438a-a165-0f9ea067b141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:12.268543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-592c5260-f091-4981-a6f9-d84e32715989 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:12.281603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-592c5260-f091-4981-a6f9-d84e32715989 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.495024 Sep 13 20:02:12.282720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 298/546] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:11 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:12.289220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5c8befce-3128-4366-8aaa-3c9fd2ebe9c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:12.289927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5c8befce-3128-4366-8aaa-3c9fd2ebe9c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:12.304294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c8befce-3128-4366-8aaa-3c9fd2ebe9c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:12.304804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c8befce-3128-4366-8aaa-3c9fd2ebe9c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:12.305244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c8befce-3128-4366-8aaa-3c9fd2ebe9c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:12.305981 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c8befce-3128-4366-8aaa-3c9fd2ebe9c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:12.306448 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c8befce-3128-4366-8aaa-3c9fd2ebe9c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:12.307344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c8befce-3128-4366-8aaa-3c9fd2ebe9c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:12.651470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5c8befce-3128-4366-8aaa-3c9fd2ebe9c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:12.660934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5c8befce-3128-4366-8aaa-3c9fd2ebe9c1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.376948 Sep 13 20:02:12.674399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 299/547] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:12 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:12.775637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-09e9cf28-823d-438a-a165-0f9ea067b141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:12.790319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-09e9cf28-823d-438a-a165-0f9ea067b141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1319 microversion: 2.1 time: 0.763438 Sep 13 20:02:12.790967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 249/548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:12 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1319 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:12.909981 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-49b21ea2-006e-4159-8101-50b2f314ba07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:12.910956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-49b21ea2-006e-4159-8101-50b2f314ba07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:12.921857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49b21ea2-006e-4159-8101-50b2f314ba07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:12.922149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49b21ea2-006e-4159-8101-50b2f314ba07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:12.922587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49b21ea2-006e-4159-8101-50b2f314ba07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:12.923302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49b21ea2-006e-4159-8101-50b2f314ba07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:12.923757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49b21ea2-006e-4159-8101-50b2f314ba07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:12.924182 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49b21ea2-006e-4159-8101-50b2f314ba07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:13.315954 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-51e0059e-eb0c-44c5-8644-113cfda026a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:13.316830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-51e0059e-eb0c-44c5-8644-113cfda026a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:13.350454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-51e0059e-eb0c-44c5-8644-113cfda026a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:13.350954 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-51e0059e-eb0c-44c5-8644-113cfda026a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:13.351570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-51e0059e-eb0c-44c5-8644-113cfda026a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:13.352490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-51e0059e-eb0c-44c5-8644-113cfda026a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:13.353106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-51e0059e-eb0c-44c5-8644-113cfda026a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:13.353673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-51e0059e-eb0c-44c5-8644-113cfda026a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:13.393010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-49b21ea2-006e-4159-8101-50b2f314ba07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:13.408254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-49b21ea2-006e-4159-8101-50b2f314ba07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:13.410102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-49b21ea2-006e-4159-8101-50b2f314ba07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:13.411794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-49b21ea2-006e-4159-8101-50b2f314ba07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.511407 Sep 13 20:02:13.424172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 300/549] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:13.702205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d77aa111-43a7-4adf-a744-03378808c76e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:13.710763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d77aa111-43a7-4adf-a744-03378808c76e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:13.762358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d77aa111-43a7-4adf-a744-03378808c76e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:13.766941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d77aa111-43a7-4adf-a744-03378808c76e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:13.767827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d77aa111-43a7-4adf-a744-03378808c76e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:13.776759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d77aa111-43a7-4adf-a744-03378808c76e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:13.777319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d77aa111-43a7-4adf-a744-03378808c76e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:13.778078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d77aa111-43a7-4adf-a744-03378808c76e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.118864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d77aa111-43a7-4adf-a744-03378808c76e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:14.138982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d77aa111-43a7-4adf-a744-03378808c76e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.453135 Sep 13 20:02:14.140138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 301/550] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:14.145861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-76f34550-9bbf-45aa-9dd0-d35984cb7e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:14.146913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-76f34550-9bbf-45aa-9dd0-d35984cb7e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:14.154855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76f34550-9bbf-45aa-9dd0-d35984cb7e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:14.155738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76f34550-9bbf-45aa-9dd0-d35984cb7e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:14.156417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76f34550-9bbf-45aa-9dd0-d35984cb7e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.157386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76f34550-9bbf-45aa-9dd0-d35984cb7e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:14.158129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76f34550-9bbf-45aa-9dd0-d35984cb7e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:14.159051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76f34550-9bbf-45aa-9dd0-d35984cb7e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.409785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-51e0059e-eb0c-44c5-8644-113cfda026a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:14.419918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-51e0059e-eb0c-44c5-8644-113cfda026a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 1.115555 Sep 13 20:02:14.426981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 250/551] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:13 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:14.448765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a22d246b-f751-4f1a-8acd-540f4dc3d575 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:14.449722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a22d246b-f751-4f1a-8acd-540f4dc3d575 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:14.467807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a22d246b-f751-4f1a-8acd-540f4dc3d575 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:14.472122 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a22d246b-f751-4f1a-8acd-540f4dc3d575 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:14.476447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a22d246b-f751-4f1a-8acd-540f4dc3d575 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.478185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a22d246b-f751-4f1a-8acd-540f4dc3d575 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:14.482225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a22d246b-f751-4f1a-8acd-540f4dc3d575 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:14.483041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a22d246b-f751-4f1a-8acd-540f4dc3d575 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.528899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-76f34550-9bbf-45aa-9dd0-d35984cb7e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:14.548233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-76f34550-9bbf-45aa-9dd0-d35984cb7e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1319 microversion: 2.1 time: 0.404014 Sep 13 20:02:14.549244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 302/552] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:14 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:14.891143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a22d246b-f751-4f1a-8acd-540f4dc3d575 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:14.904357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a22d246b-f751-4f1a-8acd-540f4dc3d575 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:14.908198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a22d246b-f751-4f1a-8acd-540f4dc3d575 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:14.911962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a22d246b-f751-4f1a-8acd-540f4dc3d575 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.467301 Sep 13 20:02:14.913787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 251/553] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:02:15.170397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-56b52118-4963-4894-ba9e-9c6e795b9458 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:15.171269 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-56b52118-4963-4894-ba9e-9c6e795b9458 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:15.195882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-56b52118-4963-4894-ba9e-9c6e795b9458 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.196606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-56b52118-4963-4894-ba9e-9c6e795b9458 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.200286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-56b52118-4963-4894-ba9e-9c6e795b9458 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.202702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-56b52118-4963-4894-ba9e-9c6e795b9458 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.204499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-56b52118-4963-4894-ba9e-9c6e795b9458 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.205034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-56b52118-4963-4894-ba9e-9c6e795b9458 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.459517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e8839b4a-8d6e-4f95-be2d-50bcdab85761 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:15.463794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e8839b4a-8d6e-4f95-be2d-50bcdab85761 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:15.486521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8839b4a-8d6e-4f95-be2d-50bcdab85761 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.488222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8839b4a-8d6e-4f95-be2d-50bcdab85761 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.492280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8839b4a-8d6e-4f95-be2d-50bcdab85761 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.495311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8839b4a-8d6e-4f95-be2d-50bcdab85761 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.499066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8839b4a-8d6e-4f95-be2d-50bcdab85761 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.501379 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8839b4a-8d6e-4f95-be2d-50bcdab85761 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.515574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-56b52118-4963-4894-ba9e-9c6e795b9458 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:15.534135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-56b52118-4963-4894-ba9e-9c6e795b9458 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.369125 Sep 13 20:02:15.542180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 303/554] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:15.576179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2ae5b058-05b4-40ca-a5f0-a345a15a7527 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:15.576811 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2ae5b058-05b4-40ca-a5f0-a345a15a7527 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:15.587179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2ae5b058-05b4-40ca-a5f0-a345a15a7527 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.587672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2ae5b058-05b4-40ca-a5f0-a345a15a7527 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.588105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2ae5b058-05b4-40ca-a5f0-a345a15a7527 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.588827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2ae5b058-05b4-40ca-a5f0-a345a15a7527 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.589280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2ae5b058-05b4-40ca-a5f0-a345a15a7527 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.589702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2ae5b058-05b4-40ca-a5f0-a345a15a7527 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.923641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2ae5b058-05b4-40ca-a5f0-a345a15a7527 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:15.934866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2ae5b058-05b4-40ca-a5f0-a345a15a7527 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1319 microversion: 2.1 time: 0.362727 Sep 13 20:02:15.935381 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 304/555] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:15 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:15.949852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7b57e832-9b8d-4636-a3d1-c02d46be796c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:15.950853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7b57e832-9b8d-4636-a3d1-c02d46be796c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:15.965061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7b57e832-9b8d-4636-a3d1-c02d46be796c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.967149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7b57e832-9b8d-4636-a3d1-c02d46be796c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.969877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7b57e832-9b8d-4636-a3d1-c02d46be796c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.970821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7b57e832-9b8d-4636-a3d1-c02d46be796c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.971813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e8839b4a-8d6e-4f95-be2d-50bcdab85761 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:15.972476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7b57e832-9b8d-4636-a3d1-c02d46be796c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.973050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7b57e832-9b8d-4636-a3d1-c02d46be796c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.982204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e8839b4a-8d6e-4f95-be2d-50bcdab85761 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.528412 Sep 13 20:02:16.001775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 252/556] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:15 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:16.339816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7b57e832-9b8d-4636-a3d1-c02d46be796c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:16.364070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7b57e832-9b8d-4636-a3d1-c02d46be796c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:16.367791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7b57e832-9b8d-4636-a3d1-c02d46be796c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:16.374769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7b57e832-9b8d-4636-a3d1-c02d46be796c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.434635 Sep 13 20:02:16.395808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 305/557] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:16.584997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e0aca272-faee-4e73-a397-c69076a7eb7e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:16.586256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e0aca272-faee-4e73-a397-c69076a7eb7e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:16.600956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0aca272-faee-4e73-a397-c69076a7eb7e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:16.601805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0aca272-faee-4e73-a397-c69076a7eb7e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:16.602451 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0aca272-faee-4e73-a397-c69076a7eb7e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:16.603409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0aca272-faee-4e73-a397-c69076a7eb7e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:16.604054 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0aca272-faee-4e73-a397-c69076a7eb7e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:16.604665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0aca272-faee-4e73-a397-c69076a7eb7e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:16.965975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1d99cfac-071d-41d2-84ca-c10a3de8be3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:16.966748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1d99cfac-071d-41d2-84ca-c10a3de8be3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:16.976881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d99cfac-071d-41d2-84ca-c10a3de8be3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:16.978693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d99cfac-071d-41d2-84ca-c10a3de8be3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:16.984522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d99cfac-071d-41d2-84ca-c10a3de8be3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:16.985628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d99cfac-071d-41d2-84ca-c10a3de8be3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:16.986968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d99cfac-071d-41d2-84ca-c10a3de8be3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:16.987564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d99cfac-071d-41d2-84ca-c10a3de8be3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:17.321470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1d99cfac-071d-41d2-84ca-c10a3de8be3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:17.351944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1d99cfac-071d-41d2-84ca-c10a3de8be3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1507 microversion: 2.1 time: 0.390435 Sep 13 20:02:17.358064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 306/558] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:16 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:17.378650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-96449fe0-1e9c-4dd6-beb3-9e0251c4f4f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:17.381875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-96449fe0-1e9c-4dd6-beb3-9e0251c4f4f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:17.407598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96449fe0-1e9c-4dd6-beb3-9e0251c4f4f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:17.417294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96449fe0-1e9c-4dd6-beb3-9e0251c4f4f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:17.424263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96449fe0-1e9c-4dd6-beb3-9e0251c4f4f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:17.431379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96449fe0-1e9c-4dd6-beb3-9e0251c4f4f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:17.432233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96449fe0-1e9c-4dd6-beb3-9e0251c4f4f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:17.432942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96449fe0-1e9c-4dd6-beb3-9e0251c4f4f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:17.475973 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e0aca272-faee-4e73-a397-c69076a7eb7e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:17.485516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e0aca272-faee-4e73-a397-c69076a7eb7e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1723 microversion: 2.1 time: 0.904856 Sep 13 20:02:17.486309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 253/559] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:16 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1723 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:17.504598 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1ab68c26-432e-4e02-8718-26b601c5b7ae tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f99cdb4-f2d0-4077-b85b-d4cf6739ede0", "device": "/dev/sdb"}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:17.515034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1ab68c26-432e-4e02-8718-26b601c5b7ae tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:17.528884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ab68c26-432e-4e02-8718-26b601c5b7ae tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:17.530284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ab68c26-432e-4e02-8718-26b601c5b7ae tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:17.530924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ab68c26-432e-4e02-8718-26b601c5b7ae tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:17.535857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ab68c26-432e-4e02-8718-26b601c5b7ae tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:17.536617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ab68c26-432e-4e02-8718-26b601c5b7ae tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:17.549000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ab68c26-432e-4e02-8718-26b601c5b7ae tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:17.741777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-96449fe0-1e9c-4dd6-beb3-9e0251c4f4f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:17.751804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-96449fe0-1e9c-4dd6-beb3-9e0251c4f4f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.390941 Sep 13 20:02:17.753563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 307/560] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:17 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:17.777796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-851bcbb6-1167-4aa0-854d-d2130de83d04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:17.779689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-851bcbb6-1167-4aa0-854d-d2130de83d04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:17.785591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:17.787871 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-851bcbb6-1167-4aa0-854d-d2130de83d04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:17.788577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-851bcbb6-1167-4aa0-854d-d2130de83d04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:17.790212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-851bcbb6-1167-4aa0-854d-d2130de83d04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:17.791177 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-851bcbb6-1167-4aa0-854d-d2130de83d04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:17.791797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-851bcbb6-1167-4aa0-854d-d2130de83d04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:17.793327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-851bcbb6-1167-4aa0-854d-d2130de83d04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:18.073002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-851bcbb6-1167-4aa0-854d-d2130de83d04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:18.094958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-851bcbb6-1167-4aa0-854d-d2130de83d04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:18.097092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-851bcbb6-1167-4aa0-854d-d2130de83d04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:18.098845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1ab68c26-432e-4e02-8718-26b601c5b7ae tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "POST /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.604392 Sep 13 20:02:18.099857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-851bcbb6-1167-4aa0-854d-d2130de83d04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.328204 Sep 13 20:02:18.100559 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 308/561] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:17 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:18.127165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 254/562] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 13 20:02:17 2022] POST /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37/os-volume_attachments => generated 194 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:18.513356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c779c760-b25a-4f81-b6e9-fc48dea895cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:18.516235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c779c760-b25a-4f81-b6e9-fc48dea895cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:18.559866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c779c760-b25a-4f81-b6e9-fc48dea895cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:18.564314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c779c760-b25a-4f81-b6e9-fc48dea895cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:18.575210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c779c760-b25a-4f81-b6e9-fc48dea895cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:18.576570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c779c760-b25a-4f81-b6e9-fc48dea895cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:18.579811 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c779c760-b25a-4f81-b6e9-fc48dea895cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:18.585710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c779c760-b25a-4f81-b6e9-fc48dea895cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:18.784375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6d523bcc-cf2e-48aa-81b9-e30af8992387 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:18.786167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6d523bcc-cf2e-48aa-81b9-e30af8992387 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:18.811691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:18.820863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6d523bcc-cf2e-48aa-81b9-e30af8992387 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:18.822279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6d523bcc-cf2e-48aa-81b9-e30af8992387 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:18.824494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6d523bcc-cf2e-48aa-81b9-e30af8992387 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:18.826350 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6d523bcc-cf2e-48aa-81b9-e30af8992387 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:18.827263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6d523bcc-cf2e-48aa-81b9-e30af8992387 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:18.829867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6d523bcc-cf2e-48aa-81b9-e30af8992387 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:18.939349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c779c760-b25a-4f81-b6e9-fc48dea895cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:18.955317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c779c760-b25a-4f81-b6e9-fc48dea895cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1700 microversion: 2.1 time: 0.449119 Sep 13 20:02:18.978846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 309/563] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1700 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:18.991290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a1b0b921-4059-4b4b-b146-9366058203bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:19.000252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1b0b921-4059-4b4b-b146-9366058203bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:19.001370 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1b0b921-4059-4b4b-b146-9366058203bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:19.002092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1b0b921-4059-4b4b-b146-9366058203bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:19.184156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a1b0b921-4059-4b4b-b146-9366058203bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Going to try to start instance {{(pid=120844) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 20:02:19.225254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:19.264614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a1b0b921-4059-4b4b-b146-9366058203bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "POST /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/action" status: 202 len: 0 microversion: 2.1 time: 0.279063 Sep 13 20:02:19.265419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 310/564] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 13 20:02:18 2022] POST /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:02:19.273013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-77c4d9af-c9a9-45a3-ba52-50d0a99ef201 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:19.275555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-77c4d9af-c9a9-45a3-ba52-50d0a99ef201 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:19.302613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77c4d9af-c9a9-45a3-ba52-50d0a99ef201 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:19.303128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77c4d9af-c9a9-45a3-ba52-50d0a99ef201 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:19.305237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77c4d9af-c9a9-45a3-ba52-50d0a99ef201 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:19.306022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77c4d9af-c9a9-45a3-ba52-50d0a99ef201 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:19.307385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77c4d9af-c9a9-45a3-ba52-50d0a99ef201 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:19.307872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77c4d9af-c9a9-45a3-ba52-50d0a99ef201 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:19.398232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6d523bcc-cf2e-48aa-81b9-e30af8992387 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:19.415993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6d523bcc-cf2e-48aa-81b9-e30af8992387 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.637757 Sep 13 20:02:19.422315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 255/565] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:18 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:19.438229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-01ccb67a-ccb9-4550-92da-64404c8ba3a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:19.445217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-01ccb67a-ccb9-4550-92da-64404c8ba3a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:19.491590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01ccb67a-ccb9-4550-92da-64404c8ba3a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:19.494109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01ccb67a-ccb9-4550-92da-64404c8ba3a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:19.494779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01ccb67a-ccb9-4550-92da-64404c8ba3a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:19.498334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01ccb67a-ccb9-4550-92da-64404c8ba3a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:19.499344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01ccb67a-ccb9-4550-92da-64404c8ba3a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:19.504965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01ccb67a-ccb9-4550-92da-64404c8ba3a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:19.555810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-77c4d9af-c9a9-45a3-ba52-50d0a99ef201 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:19.600560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-77c4d9af-c9a9-45a3-ba52-50d0a99ef201 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:19.603243 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-77c4d9af-c9a9-45a3-ba52-50d0a99ef201 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:19.604957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-77c4d9af-c9a9-45a3-ba52-50d0a99ef201 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.337492 Sep 13 20:02:19.607049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 311/566] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:20.009593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-01ccb67a-ccb9-4550-92da-64404c8ba3a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:20.023841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-01ccb67a-ccb9-4550-92da-64404c8ba3a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1709 microversion: 2.1 time: 0.598527 Sep 13 20:02:20.026434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 256/567] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1709 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:20.447297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7d3af0d1-c15b-463c-a156-d8e1f4238874 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:20.450298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7d3af0d1-c15b-463c-a156-d8e1f4238874 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:20.480545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d3af0d1-c15b-463c-a156-d8e1f4238874 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:20.481270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d3af0d1-c15b-463c-a156-d8e1f4238874 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:20.481818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d3af0d1-c15b-463c-a156-d8e1f4238874 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:20.482798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d3af0d1-c15b-463c-a156-d8e1f4238874 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:20.483346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d3af0d1-c15b-463c-a156-d8e1f4238874 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:20.483916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d3af0d1-c15b-463c-a156-d8e1f4238874 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:20.634720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-86f101dd-6e2f-4380-84fd-3b59f402b7d4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:20.636358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-86f101dd-6e2f-4380-84fd-3b59f402b7d4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:20.644026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-86f101dd-6e2f-4380-84fd-3b59f402b7d4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:20.650478 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-86f101dd-6e2f-4380-84fd-3b59f402b7d4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:20.654831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-86f101dd-6e2f-4380-84fd-3b59f402b7d4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:20.656245 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-86f101dd-6e2f-4380-84fd-3b59f402b7d4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:20.657994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-86f101dd-6e2f-4380-84fd-3b59f402b7d4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:20.658894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-86f101dd-6e2f-4380-84fd-3b59f402b7d4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:20.699394 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:20.853379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7d3af0d1-c15b-463c-a156-d8e1f4238874 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:20.882738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7d3af0d1-c15b-463c-a156-d8e1f4238874 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.439838 Sep 13 20:02:20.887624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 312/568] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:20 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:21.054130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-811fe87f-9a54-49b0-afa4-0f0f74c2a3d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:21.055089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-811fe87f-9a54-49b0-afa4-0f0f74c2a3d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:21.065466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-811fe87f-9a54-49b0-afa4-0f0f74c2a3d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:21.067032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-811fe87f-9a54-49b0-afa4-0f0f74c2a3d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:21.067684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-811fe87f-9a54-49b0-afa4-0f0f74c2a3d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:21.070314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-811fe87f-9a54-49b0-afa4-0f0f74c2a3d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:21.073278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-811fe87f-9a54-49b0-afa4-0f0f74c2a3d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:21.077242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-811fe87f-9a54-49b0-afa4-0f0f74c2a3d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:21.247803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-86f101dd-6e2f-4380-84fd-3b59f402b7d4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:21.261746 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-86f101dd-6e2f-4380-84fd-3b59f402b7d4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:21.279577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-86f101dd-6e2f-4380-84fd-3b59f402b7d4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:21.299871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-86f101dd-6e2f-4380-84fd-3b59f402b7d4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.654723 Sep 13 20:02:21.300521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 257/569] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:21.474873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-811fe87f-9a54-49b0-afa4-0f0f74c2a3d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:21.498951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-811fe87f-9a54-49b0-afa4-0f0f74c2a3d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1709 microversion: 2.1 time: 0.448621 Sep 13 20:02:21.500087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 313/570] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:21 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1709 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:21.910563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d48faac2-bcca-442a-b9ac-36ff30f360ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:21.911288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d48faac2-bcca-442a-b9ac-36ff30f360ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:21.938836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d48faac2-bcca-442a-b9ac-36ff30f360ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:21.943553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d48faac2-bcca-442a-b9ac-36ff30f360ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:21.946527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d48faac2-bcca-442a-b9ac-36ff30f360ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:21.949423 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d48faac2-bcca-442a-b9ac-36ff30f360ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:21.950175 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d48faac2-bcca-442a-b9ac-36ff30f360ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:21.951508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d48faac2-bcca-442a-b9ac-36ff30f360ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:22.244427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d48faac2-bcca-442a-b9ac-36ff30f360ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:22.256308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d48faac2-bcca-442a-b9ac-36ff30f360ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.350168 Sep 13 20:02:22.257671 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 258/571] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:21 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:22.334472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-07b77f89-f41b-4208-81f1-4b9a0b88e5c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:22.335302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-07b77f89-f41b-4208-81f1-4b9a0b88e5c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:22.349919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07b77f89-f41b-4208-81f1-4b9a0b88e5c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:22.365130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07b77f89-f41b-4208-81f1-4b9a0b88e5c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:22.379293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07b77f89-f41b-4208-81f1-4b9a0b88e5c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:22.382628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07b77f89-f41b-4208-81f1-4b9a0b88e5c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:22.383481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07b77f89-f41b-4208-81f1-4b9a0b88e5c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:22.387441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07b77f89-f41b-4208-81f1-4b9a0b88e5c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:22.544125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a342a578-e2a0-4ca0-b1b4-29214edcf746 tempest-TestShelveInstance-1135103935 tempest-TestShelveInstance-1135103935-project] Action: 'create', calling method: .version_select at 0x7f98463d6160>, body: {"keypair": {"name": "tempest-TestShelveInstance-293906173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHaZKwYOapJWyiNBU4Ox5evFOu81uUmlooPjd2RVs/GsaUi+Qd4aaXSVVgsfEqhpwFcaRmo3T/XL+9j61QBjlTvBGKnZzibuJ8X06dEeA+cVMFJNRFM3WnLpbOcVtN6yw=="}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:22.567004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-a342a578-e2a0-4ca0-b1b4-29214edcf746 tempest-TestShelveInstance-1135103935 tempest-TestShelveInstance-1135103935-project] Getting quotas for project 12334580a162423aaf7e5ea84cd0d590. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:02:22.589755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-a342a578-e2a0-4ca0-b1b4-29214edcf746 tempest-TestShelveInstance-1135103935 tempest-TestShelveInstance-1135103935-project] Getting quotas for user 624d22e884154931a198491481459d93 and project 12334580a162423aaf7e5ea84cd0d590. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:02:22.644566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a342a578-e2a0-4ca0-b1b4-29214edcf746 tempest-TestShelveInstance-1135103935 tempest-TestShelveInstance-1135103935-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.510287 Sep 13 20:02:22.647555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 314/572] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 13 20:02:22 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:02:22.656789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-42c5352a-0490-468e-8e79-8b3a13029114 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:22.657404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-42c5352a-0490-468e-8e79-8b3a13029114 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:22.675494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42c5352a-0490-468e-8e79-8b3a13029114 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:22.679073 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42c5352a-0490-468e-8e79-8b3a13029114 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:22.681181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42c5352a-0490-468e-8e79-8b3a13029114 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:22.683161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42c5352a-0490-468e-8e79-8b3a13029114 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:22.685527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42c5352a-0490-468e-8e79-8b3a13029114 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:22.686276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42c5352a-0490-468e-8e79-8b3a13029114 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:22.724676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-07b77f89-f41b-4208-81f1-4b9a0b88e5c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:22.739916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-07b77f89-f41b-4208-81f1-4b9a0b88e5c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:22.744660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-07b77f89-f41b-4208-81f1-4b9a0b88e5c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:22.750717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-07b77f89-f41b-4208-81f1-4b9a0b88e5c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.418712 Sep 13 20:02:22.751869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 259/573] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:22 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:23.286012 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b6b77e00-ab41-47d1-93d7-6363b9e15bc3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:23.287480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b6b77e00-ab41-47d1-93d7-6363b9e15bc3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:23.301252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6b77e00-ab41-47d1-93d7-6363b9e15bc3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.302093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6b77e00-ab41-47d1-93d7-6363b9e15bc3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.307002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6b77e00-ab41-47d1-93d7-6363b9e15bc3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:23.311433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6b77e00-ab41-47d1-93d7-6363b9e15bc3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.311914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6b77e00-ab41-47d1-93d7-6363b9e15bc3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.312352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6b77e00-ab41-47d1-93d7-6363b9e15bc3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:23.376380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-42c5352a-0490-468e-8e79-8b3a13029114 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:23.404026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-42c5352a-0490-468e-8e79-8b3a13029114 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1709 microversion: 2.1 time: 0.754547 Sep 13 20:02:23.425595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 315/574] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1709 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:23.625593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b6b77e00-ab41-47d1-93d7-6363b9e15bc3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:23.645481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b6b77e00-ab41-47d1-93d7-6363b9e15bc3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.362797 Sep 13 20:02:23.654042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 260/575] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:23 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:23.782411 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-69824918-2eb9-4b09-9f2c-f3c4d982bf00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:23.783947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-69824918-2eb9-4b09-9f2c-f3c4d982bf00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:23.804911 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69824918-2eb9-4b09-9f2c-f3c4d982bf00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.805500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69824918-2eb9-4b09-9f2c-f3c4d982bf00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.806123 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69824918-2eb9-4b09-9f2c-f3c4d982bf00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:23.807022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69824918-2eb9-4b09-9f2c-f3c4d982bf00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.807767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69824918-2eb9-4b09-9f2c-f3c4d982bf00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.808174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69824918-2eb9-4b09-9f2c-f3c4d982bf00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:24.072054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-69824918-2eb9-4b09-9f2c-f3c4d982bf00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:24.086855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-69824918-2eb9-4b09-9f2c-f3c4d982bf00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:24.088672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-69824918-2eb9-4b09-9f2c-f3c4d982bf00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:24.090612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-69824918-2eb9-4b09-9f2c-f3c4d982bf00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.312214 Sep 13 20:02:24.091823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 316/576] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:23 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:24.441582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2e335836-fc3b-4fd3-81eb-b17082fb5895 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:24.442247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2e335836-fc3b-4fd3-81eb-b17082fb5895 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:24.449493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e335836-fc3b-4fd3-81eb-b17082fb5895 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:24.449948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e335836-fc3b-4fd3-81eb-b17082fb5895 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:24.450445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e335836-fc3b-4fd3-81eb-b17082fb5895 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:24.451439 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e335836-fc3b-4fd3-81eb-b17082fb5895 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:24.452052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e335836-fc3b-4fd3-81eb-b17082fb5895 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:24.452486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e335836-fc3b-4fd3-81eb-b17082fb5895 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:24.624936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2e335836-fc3b-4fd3-81eb-b17082fb5895 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:24.636601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2e335836-fc3b-4fd3-81eb-b17082fb5895 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1709 microversion: 2.1 time: 0.198904 Sep 13 20:02:24.637564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 261/577] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:24 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1709 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:24.672208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4fb9a69c-5323-4eab-b080-05b24f726f71 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:24.672823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4fb9a69c-5323-4eab-b080-05b24f726f71 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:24.679591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fb9a69c-5323-4eab-b080-05b24f726f71 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:24.680063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fb9a69c-5323-4eab-b080-05b24f726f71 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:24.680725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fb9a69c-5323-4eab-b080-05b24f726f71 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:24.681446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fb9a69c-5323-4eab-b080-05b24f726f71 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:24.682072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fb9a69c-5323-4eab-b080-05b24f726f71 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:24.682635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fb9a69c-5323-4eab-b080-05b24f726f71 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:24.855329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4fb9a69c-5323-4eab-b080-05b24f726f71 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:24.865579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4fb9a69c-5323-4eab-b080-05b24f726f71 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.196943 Sep 13 20:02:24.878942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 317/578] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:24 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:25.123249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5c146202-cf79-4937-9d3d-439018a4470b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:25.123859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5c146202-cf79-4937-9d3d-439018a4470b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:25.130306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c146202-cf79-4937-9d3d-439018a4470b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.130919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c146202-cf79-4937-9d3d-439018a4470b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.131538 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c146202-cf79-4937-9d3d-439018a4470b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.132510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c146202-cf79-4937-9d3d-439018a4470b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.133138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c146202-cf79-4937-9d3d-439018a4470b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.133731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c146202-cf79-4937-9d3d-439018a4470b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.311007 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5c146202-cf79-4937-9d3d-439018a4470b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:25.326100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5c146202-cf79-4937-9d3d-439018a4470b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:25.328060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5c146202-cf79-4937-9d3d-439018a4470b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:25.329445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5c146202-cf79-4937-9d3d-439018a4470b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.210831 Sep 13 20:02:25.346395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 262/579] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:25.661637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f2e5e2b5-9471-46e0-baf5-499d0435f528 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:25.662458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f2e5e2b5-9471-46e0-baf5-499d0435f528 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:25.669392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2e5e2b5-9471-46e0-baf5-499d0435f528 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.669931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2e5e2b5-9471-46e0-baf5-499d0435f528 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.670300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2e5e2b5-9471-46e0-baf5-499d0435f528 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.671355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2e5e2b5-9471-46e0-baf5-499d0435f528 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.672014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2e5e2b5-9471-46e0-baf5-499d0435f528 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.672465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2e5e2b5-9471-46e0-baf5-499d0435f528 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.852214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f2e5e2b5-9471-46e0-baf5-499d0435f528 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:25.861821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f2e5e2b5-9471-46e0-baf5-499d0435f528 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1709 microversion: 2.1 time: 0.204731 Sep 13 20:02:25.870035 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 318/580] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1709 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:25.893762 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b2244148-351f-40bc-825b-2fdf80102c22 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:25.895205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b2244148-351f-40bc-825b-2fdf80102c22 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:25.902070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b2244148-351f-40bc-825b-2fdf80102c22 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.902591 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b2244148-351f-40bc-825b-2fdf80102c22 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.903022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b2244148-351f-40bc-825b-2fdf80102c22 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.903749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b2244148-351f-40bc-825b-2fdf80102c22 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.904175 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b2244148-351f-40bc-825b-2fdf80102c22 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.904583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b2244148-351f-40bc-825b-2fdf80102c22 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:26.062461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b2244148-351f-40bc-825b-2fdf80102c22 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:26.073238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b2244148-351f-40bc-825b-2fdf80102c22 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.185154 Sep 13 20:02:26.073735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 263/581] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:25 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:26.357279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bc79b4aa-23eb-4f62-bd30-5345effb6386 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:26.357775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bc79b4aa-23eb-4f62-bd30-5345effb6386 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:26.364421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc79b4aa-23eb-4f62-bd30-5345effb6386 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:26.364887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc79b4aa-23eb-4f62-bd30-5345effb6386 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:26.365304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc79b4aa-23eb-4f62-bd30-5345effb6386 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:26.365983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc79b4aa-23eb-4f62-bd30-5345effb6386 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:26.366457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc79b4aa-23eb-4f62-bd30-5345effb6386 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:26.366865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc79b4aa-23eb-4f62-bd30-5345effb6386 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:26.525557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bc79b4aa-23eb-4f62-bd30-5345effb6386 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:26.535019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bc79b4aa-23eb-4f62-bd30-5345effb6386 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:26.536456 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bc79b4aa-23eb-4f62-bd30-5345effb6386 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:26.538335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bc79b4aa-23eb-4f62-bd30-5345effb6386 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.184665 Sep 13 20:02:26.539670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 319/582] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:26.887897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6a378279-e3be-40e3-99f6-8f71fff2e3b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:26.888585 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6a378279-e3be-40e3-99f6-8f71fff2e3b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:26.897306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a378279-e3be-40e3-99f6-8f71fff2e3b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:26.898166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a378279-e3be-40e3-99f6-8f71fff2e3b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:26.899025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a378279-e3be-40e3-99f6-8f71fff2e3b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:26.900253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a378279-e3be-40e3-99f6-8f71fff2e3b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:26.901211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a378279-e3be-40e3-99f6-8f71fff2e3b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:26.901847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a378279-e3be-40e3-99f6-8f71fff2e3b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:27.049759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6a378279-e3be-40e3-99f6-8f71fff2e3b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:27.059837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6a378279-e3be-40e3-99f6-8f71fff2e3b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1709 microversion: 2.1 time: 0.176671 Sep 13 20:02:27.060409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 264/583] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1709 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:27.097222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-93a322af-44a0-4a77-9a83-2bf808c8d2d4 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:27.098568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-93a322af-44a0-4a77-9a83-2bf808c8d2d4 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:27.107090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93a322af-44a0-4a77-9a83-2bf808c8d2d4 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:27.107578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93a322af-44a0-4a77-9a83-2bf808c8d2d4 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:27.108009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93a322af-44a0-4a77-9a83-2bf808c8d2d4 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:27.108708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93a322af-44a0-4a77-9a83-2bf808c8d2d4 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:27.109188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93a322af-44a0-4a77-9a83-2bf808c8d2d4 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:27.110248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93a322af-44a0-4a77-9a83-2bf808c8d2d4 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:27.261515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-93a322af-44a0-4a77-9a83-2bf808c8d2d4 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:27.270295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-93a322af-44a0-4a77-9a83-2bf808c8d2d4 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.177128 Sep 13 20:02:27.270912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 320/584] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:27 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:27.565043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2737174f-9a45-4664-a911-59d8def678b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:27.565989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2737174f-9a45-4664-a911-59d8def678b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:27.574332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2737174f-9a45-4664-a911-59d8def678b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:27.574851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2737174f-9a45-4664-a911-59d8def678b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:27.575284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2737174f-9a45-4664-a911-59d8def678b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:27.576015 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2737174f-9a45-4664-a911-59d8def678b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:27.576483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2737174f-9a45-4664-a911-59d8def678b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:27.576867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2737174f-9a45-4664-a911-59d8def678b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:27.721532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2737174f-9a45-4664-a911-59d8def678b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:27.731482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2737174f-9a45-4664-a911-59d8def678b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:27.732921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2737174f-9a45-4664-a911-59d8def678b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:27.734408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2737174f-9a45-4664-a911-59d8def678b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.173808 Sep 13 20:02:27.735003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 265/585] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:27 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:28.085288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b1955afd-006f-4b8f-bc03-46415be1f8a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:28.085876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b1955afd-006f-4b8f-bc03-46415be1f8a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:28.093716 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1955afd-006f-4b8f-bc03-46415be1f8a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.094231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1955afd-006f-4b8f-bc03-46415be1f8a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.094731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1955afd-006f-4b8f-bc03-46415be1f8a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.095895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1955afd-006f-4b8f-bc03-46415be1f8a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.096625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1955afd-006f-4b8f-bc03-46415be1f8a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.097077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1955afd-006f-4b8f-bc03-46415be1f8a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.246538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b1955afd-006f-4b8f-bc03-46415be1f8a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:28.255553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b1955afd-006f-4b8f-bc03-46415be1f8a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1713 microversion: 2.1 time: 0.175721 Sep 13 20:02:28.256195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 321/586] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1713 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:28.294707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dbbe43df-97a1-4f43-9ddb-6fad5b2dc70e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:28.295292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dbbe43df-97a1-4f43-9ddb-6fad5b2dc70e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:28.302048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbbe43df-97a1-4f43-9ddb-6fad5b2dc70e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.302553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbbe43df-97a1-4f43-9ddb-6fad5b2dc70e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.302984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbbe43df-97a1-4f43-9ddb-6fad5b2dc70e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.303735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbbe43df-97a1-4f43-9ddb-6fad5b2dc70e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.304187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbbe43df-97a1-4f43-9ddb-6fad5b2dc70e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.304584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbbe43df-97a1-4f43-9ddb-6fad5b2dc70e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.452629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dbbe43df-97a1-4f43-9ddb-6fad5b2dc70e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:28.461510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dbbe43df-97a1-4f43-9ddb-6fad5b2dc70e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.170679 Sep 13 20:02:28.462080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 266/587] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:28 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:28.761132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-08228ee8-f019-470f-823a-01ed7be23eaf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:28.761727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-08228ee8-f019-470f-823a-01ed7be23eaf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:28.768576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08228ee8-f019-470f-823a-01ed7be23eaf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.769056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08228ee8-f019-470f-823a-01ed7be23eaf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.769469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08228ee8-f019-470f-823a-01ed7be23eaf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.770172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08228ee8-f019-470f-823a-01ed7be23eaf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.770643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08228ee8-f019-470f-823a-01ed7be23eaf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.771059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08228ee8-f019-470f-823a-01ed7be23eaf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.933751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-08228ee8-f019-470f-823a-01ed7be23eaf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:28.955447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-08228ee8-f019-470f-823a-01ed7be23eaf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:28.959619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-08228ee8-f019-470f-823a-01ed7be23eaf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:28.962605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-08228ee8-f019-470f-823a-01ed7be23eaf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.204806 Sep 13 20:02:28.964202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 322/588] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:29.484584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-67d6f238-be62-4e90-8e0e-3368bebac8ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:29.485193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-67d6f238-be62-4e90-8e0e-3368bebac8ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:29.492172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67d6f238-be62-4e90-8e0e-3368bebac8ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:29.492645 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67d6f238-be62-4e90-8e0e-3368bebac8ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:29.493087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67d6f238-be62-4e90-8e0e-3368bebac8ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:29.493780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67d6f238-be62-4e90-8e0e-3368bebac8ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:29.494220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67d6f238-be62-4e90-8e0e-3368bebac8ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:29.494705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67d6f238-be62-4e90-8e0e-3368bebac8ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:29.684302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-67d6f238-be62-4e90-8e0e-3368bebac8ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:29.697602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-67d6f238-be62-4e90-8e0e-3368bebac8ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.216056 Sep 13 20:02:29.698165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 267/589] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:29 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:29.992969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-44d2c6bb-9204-4d4a-b3e5-dd9654c5a2c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:29.993649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-44d2c6bb-9204-4d4a-b3e5-dd9654c5a2c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:30.000467 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44d2c6bb-9204-4d4a-b3e5-dd9654c5a2c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:30.000948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44d2c6bb-9204-4d4a-b3e5-dd9654c5a2c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:30.001367 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44d2c6bb-9204-4d4a-b3e5-dd9654c5a2c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:30.002053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44d2c6bb-9204-4d4a-b3e5-dd9654c5a2c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:30.002515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44d2c6bb-9204-4d4a-b3e5-dd9654c5a2c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:30.002926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44d2c6bb-9204-4d4a-b3e5-dd9654c5a2c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:30.145870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-44d2c6bb-9204-4d4a-b3e5-dd9654c5a2c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:30.155093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-44d2c6bb-9204-4d4a-b3e5-dd9654c5a2c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:30.156580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-44d2c6bb-9204-4d4a-b3e5-dd9654c5a2c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:30.157787 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-44d2c6bb-9204-4d4a-b3e5-dd9654c5a2c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.168927 Sep 13 20:02:30.158790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 323/590] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:29 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:30.722046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6826f2a4-22c7-4eb8-9e97-ee8f8743061b tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:30.722740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6826f2a4-22c7-4eb8-9e97-ee8f8743061b tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:30.729674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6826f2a4-22c7-4eb8-9e97-ee8f8743061b tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:30.730151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6826f2a4-22c7-4eb8-9e97-ee8f8743061b tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:30.730611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6826f2a4-22c7-4eb8-9e97-ee8f8743061b tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:30.731308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6826f2a4-22c7-4eb8-9e97-ee8f8743061b tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:30.731754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6826f2a4-22c7-4eb8-9e97-ee8f8743061b tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:30.732167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6826f2a4-22c7-4eb8-9e97-ee8f8743061b tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:30.897298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6826f2a4-22c7-4eb8-9e97-ee8f8743061b tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:30.905589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6826f2a4-22c7-4eb8-9e97-ee8f8743061b tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.187264 Sep 13 20:02:30.906177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 268/591] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:30 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:31.184281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a787894e-e3c9-4a7d-9bb5-6e79ad7925a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:31.185150 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a787894e-e3c9-4a7d-9bb5-6e79ad7925a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:31.192633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a787894e-e3c9-4a7d-9bb5-6e79ad7925a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:31.193134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a787894e-e3c9-4a7d-9bb5-6e79ad7925a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:31.193560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a787894e-e3c9-4a7d-9bb5-6e79ad7925a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:31.194277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a787894e-e3c9-4a7d-9bb5-6e79ad7925a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:31.194775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a787894e-e3c9-4a7d-9bb5-6e79ad7925a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:31.195222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a787894e-e3c9-4a7d-9bb5-6e79ad7925a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:31.337342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a787894e-e3c9-4a7d-9bb5-6e79ad7925a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:31.346579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a787894e-e3c9-4a7d-9bb5-6e79ad7925a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:31.347999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a787894e-e3c9-4a7d-9bb5-6e79ad7925a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:31.349245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a787894e-e3c9-4a7d-9bb5-6e79ad7925a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.169086 Sep 13 20:02:31.349769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 324/592] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:31.930481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-662b408d-ab44-4fef-b172-b5dbaf0d3d38 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:31.931221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-662b408d-ab44-4fef-b172-b5dbaf0d3d38 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:31.939218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-662b408d-ab44-4fef-b172-b5dbaf0d3d38 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:31.939813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-662b408d-ab44-4fef-b172-b5dbaf0d3d38 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:31.940291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-662b408d-ab44-4fef-b172-b5dbaf0d3d38 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:31.941009 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-662b408d-ab44-4fef-b172-b5dbaf0d3d38 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:31.941559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-662b408d-ab44-4fef-b172-b5dbaf0d3d38 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:31.941988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-662b408d-ab44-4fef-b172-b5dbaf0d3d38 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:32.090861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-662b408d-ab44-4fef-b172-b5dbaf0d3d38 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:32.099662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-662b408d-ab44-4fef-b172-b5dbaf0d3d38 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.173342 Sep 13 20:02:32.100281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 269/593] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:31 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:32.376585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e8321eae-c3e0-4318-9520-31c513e645df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:32.380830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e8321eae-c3e0-4318-9520-31c513e645df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:32.385810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8321eae-c3e0-4318-9520-31c513e645df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:32.386297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8321eae-c3e0-4318-9520-31c513e645df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:32.386765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8321eae-c3e0-4318-9520-31c513e645df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:32.387466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8321eae-c3e0-4318-9520-31c513e645df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:32.387913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8321eae-c3e0-4318-9520-31c513e645df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:32.388328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8321eae-c3e0-4318-9520-31c513e645df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:32.548360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e8321eae-c3e0-4318-9520-31c513e645df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:32.560782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e8321eae-c3e0-4318-9520-31c513e645df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:32.562240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e8321eae-c3e0-4318-9520-31c513e645df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:32.563481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e8321eae-c3e0-4318-9520-31c513e645df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.191684 Sep 13 20:02:32.564083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 325/594] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:33.137311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-437d7adf-52b1-441d-b0e1-be58f722d1d0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:33.137881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-437d7adf-52b1-441d-b0e1-be58f722d1d0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:33.145382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-437d7adf-52b1-441d-b0e1-be58f722d1d0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:33.145869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-437d7adf-52b1-441d-b0e1-be58f722d1d0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:33.146295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-437d7adf-52b1-441d-b0e1-be58f722d1d0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:33.147034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-437d7adf-52b1-441d-b0e1-be58f722d1d0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:33.147478 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-437d7adf-52b1-441d-b0e1-be58f722d1d0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:33.147901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-437d7adf-52b1-441d-b0e1-be58f722d1d0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:33.286709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-437d7adf-52b1-441d-b0e1-be58f722d1d0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:33.295458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-437d7adf-52b1-441d-b0e1-be58f722d1d0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.162129 Sep 13 20:02:33.296051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 270/595] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:33 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:33.590432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3d83a204-d8d6-4aa9-8dc8-9b10db1d5f00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:33.591263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3d83a204-d8d6-4aa9-8dc8-9b10db1d5f00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:33.593165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=4 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:33.605369 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d83a204-d8d6-4aa9-8dc8-9b10db1d5f00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:33.605865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d83a204-d8d6-4aa9-8dc8-9b10db1d5f00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:33.606313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d83a204-d8d6-4aa9-8dc8-9b10db1d5f00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:33.607087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d83a204-d8d6-4aa9-8dc8-9b10db1d5f00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:33.607534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d83a204-d8d6-4aa9-8dc8-9b10db1d5f00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:33.608061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d83a204-d8d6-4aa9-8dc8-9b10db1d5f00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:33.756275 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3d83a204-d8d6-4aa9-8dc8-9b10db1d5f00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:33.765997 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3d83a204-d8d6-4aa9-8dc8-9b10db1d5f00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:33.767599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3d83a204-d8d6-4aa9-8dc8-9b10db1d5f00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:33.768785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3d83a204-d8d6-4aa9-8dc8-9b10db1d5f00 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.182410 Sep 13 20:02:33.769602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 326/596] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:34.319938 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cda860b9-7816-4561-a1d3-3303da73345a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:34.320565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cda860b9-7816-4561-a1d3-3303da73345a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:34.327476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cda860b9-7816-4561-a1d3-3303da73345a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:34.327964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cda860b9-7816-4561-a1d3-3303da73345a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:34.328399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cda860b9-7816-4561-a1d3-3303da73345a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:34.329106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cda860b9-7816-4561-a1d3-3303da73345a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:34.329547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cda860b9-7816-4561-a1d3-3303da73345a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:34.329982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cda860b9-7816-4561-a1d3-3303da73345a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:34.477088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-cda860b9-7816-4561-a1d3-3303da73345a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:34.488813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cda860b9-7816-4561-a1d3-3303da73345a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.173046 Sep 13 20:02:34.489254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 271/597] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:34 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:34.797600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-de574789-c34e-491c-8347-7eab24976be5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:34.798169 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-de574789-c34e-491c-8347-7eab24976be5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:34.805583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de574789-c34e-491c-8347-7eab24976be5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:34.806067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de574789-c34e-491c-8347-7eab24976be5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:34.806614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de574789-c34e-491c-8347-7eab24976be5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:34.807301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de574789-c34e-491c-8347-7eab24976be5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:34.807740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de574789-c34e-491c-8347-7eab24976be5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:34.808146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de574789-c34e-491c-8347-7eab24976be5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:34.827414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:34.950751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-de574789-c34e-491c-8347-7eab24976be5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:34.962399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-de574789-c34e-491c-8347-7eab24976be5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:34.965210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-de574789-c34e-491c-8347-7eab24976be5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:34.967092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-de574789-c34e-491c-8347-7eab24976be5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.173590 Sep 13 20:02:34.967985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 327/598] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:34 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:35.491991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-e3827681-6732-4e12-9eb9-bdb01abaaba2 req-62b11a1c-ae54-4f7a-a23e-af1c2d15a0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e", "name": "network-vif-plugged", "status": "completed", "tag": "bdaedf1b-a56e-4be7-a8ed-5597bad3622d"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:35.503110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-e3827681-6732-4e12-9eb9-bdb01abaaba2 req-62b11a1c-ae54-4f7a-a23e-af1c2d15a0a0 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:35.503694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-e3827681-6732-4e12-9eb9-bdb01abaaba2 req-62b11a1c-ae54-4f7a-a23e-af1c2d15a0a0 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:35.504170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-e3827681-6732-4e12-9eb9-bdb01abaaba2 req-62b11a1c-ae54-4f7a-a23e-af1c2d15a0a0 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:35.511995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7745ffc3-9249-45ac-8f3d-8d3fd206bb75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:35.512620 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7745ffc3-9249-45ac-8f3d-8d3fd206bb75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:35.519537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7745ffc3-9249-45ac-8f3d-8d3fd206bb75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:35.520057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7745ffc3-9249-45ac-8f3d-8d3fd206bb75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:35.520462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7745ffc3-9249-45ac-8f3d-8d3fd206bb75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:35.521185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7745ffc3-9249-45ac-8f3d-8d3fd206bb75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:35.521683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7745ffc3-9249-45ac-8f3d-8d3fd206bb75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:35.522136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7745ffc3-9249-45ac-8f3d-8d3fd206bb75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:35.528049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-e3827681-6732-4e12-9eb9-bdb01abaaba2 req-62b11a1c-ae54-4f7a-a23e-af1c2d15a0a0 service nova] Creating event network-vif-plugged:bdaedf1b-a56e-4be7-a8ed-5597bad3622d for instance 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e on hv-cinder-85427 Sep 13 20:02:35.533908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-e3827681-6732-4e12-9eb9-bdb01abaaba2 req-62b11a1c-ae54-4f7a-a23e-af1c2d15a0a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045659 Sep 13 20:02:35.535090 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 272/599] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:35.671116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7745ffc3-9249-45ac-8f3d-8d3fd206bb75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:35.683421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7745ffc3-9249-45ac-8f3d-8d3fd206bb75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.175261 Sep 13 20:02:35.684202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 328/600] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:35 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:35.994983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-02d43d4b-af1e-4a19-a62d-2f61fdbe90fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:35.995690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-02d43d4b-af1e-4a19-a62d-2f61fdbe90fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:36.002382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-02d43d4b-af1e-4a19-a62d-2f61fdbe90fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:36.002876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-02d43d4b-af1e-4a19-a62d-2f61fdbe90fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:36.003309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-02d43d4b-af1e-4a19-a62d-2f61fdbe90fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:36.004009 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-02d43d4b-af1e-4a19-a62d-2f61fdbe90fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:36.004460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-02d43d4b-af1e-4a19-a62d-2f61fdbe90fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:36.004945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-02d43d4b-af1e-4a19-a62d-2f61fdbe90fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:36.152496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-02d43d4b-af1e-4a19-a62d-2f61fdbe90fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:36.162092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-02d43d4b-af1e-4a19-a62d-2f61fdbe90fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:36.163566 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-02d43d4b-af1e-4a19-a62d-2f61fdbe90fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:36.164733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-02d43d4b-af1e-4a19-a62d-2f61fdbe90fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.174335 Sep 13 20:02:36.165303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 273/601] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:35 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:36.709356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ed360798-bfd0-4937-b17f-7c150b3ed930 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:36.710092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ed360798-bfd0-4937-b17f-7c150b3ed930 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:36.717089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed360798-bfd0-4937-b17f-7c150b3ed930 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:36.717588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed360798-bfd0-4937-b17f-7c150b3ed930 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:36.718017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed360798-bfd0-4937-b17f-7c150b3ed930 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:36.718800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed360798-bfd0-4937-b17f-7c150b3ed930 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:36.719247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed360798-bfd0-4937-b17f-7c150b3ed930 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:36.719677 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed360798-bfd0-4937-b17f-7c150b3ed930 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:36.862859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ed360798-bfd0-4937-b17f-7c150b3ed930 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:36.872566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ed360798-bfd0-4937-b17f-7c150b3ed930 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.167539 Sep 13 20:02:36.873144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 329/602] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:36 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:37.189983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b427d375-7180-4815-8ee7-65ff56dda642 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:37.190642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b427d375-7180-4815-8ee7-65ff56dda642 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:37.197660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b427d375-7180-4815-8ee7-65ff56dda642 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:37.198147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b427d375-7180-4815-8ee7-65ff56dda642 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:37.198643 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b427d375-7180-4815-8ee7-65ff56dda642 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:37.199348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b427d375-7180-4815-8ee7-65ff56dda642 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:37.199798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b427d375-7180-4815-8ee7-65ff56dda642 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:37.200222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b427d375-7180-4815-8ee7-65ff56dda642 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:37.335022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b427d375-7180-4815-8ee7-65ff56dda642 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:37.337357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:37.345073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b427d375-7180-4815-8ee7-65ff56dda642 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:37.346529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b427d375-7180-4815-8ee7-65ff56dda642 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:37.347693 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b427d375-7180-4815-8ee7-65ff56dda642 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.161727 Sep 13 20:02:37.348247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 274/603] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:37.899629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4d5f7ebc-15b8-4740-a676-3846ee786b48 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:37.900234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4d5f7ebc-15b8-4740-a676-3846ee786b48 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:37.909383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d5f7ebc-15b8-4740-a676-3846ee786b48 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:37.909937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d5f7ebc-15b8-4740-a676-3846ee786b48 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:37.910414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d5f7ebc-15b8-4740-a676-3846ee786b48 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:37.911267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d5f7ebc-15b8-4740-a676-3846ee786b48 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:37.911880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d5f7ebc-15b8-4740-a676-3846ee786b48 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:37.912566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d5f7ebc-15b8-4740-a676-3846ee786b48 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:38.053973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4d5f7ebc-15b8-4740-a676-3846ee786b48 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:38.062022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4d5f7ebc-15b8-4740-a676-3846ee786b48 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.168749 Sep 13 20:02:38.062621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 330/604] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:37 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:38.383037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5df25459-2498-4405-b500-9a28ad60c2cb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:38.383601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5df25459-2498-4405-b500-9a28ad60c2cb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:38.390711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5df25459-2498-4405-b500-9a28ad60c2cb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:38.391194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5df25459-2498-4405-b500-9a28ad60c2cb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:38.391629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5df25459-2498-4405-b500-9a28ad60c2cb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:38.392324 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5df25459-2498-4405-b500-9a28ad60c2cb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:38.392772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5df25459-2498-4405-b500-9a28ad60c2cb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:38.393199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5df25459-2498-4405-b500-9a28ad60c2cb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:38.540338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5df25459-2498-4405-b500-9a28ad60c2cb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:38.549635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5df25459-2498-4405-b500-9a28ad60c2cb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:38.551080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5df25459-2498-4405-b500-9a28ad60c2cb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:38.552225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5df25459-2498-4405-b500-9a28ad60c2cb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.174841 Sep 13 20:02:38.552810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 275/605] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:39.085769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-52fe09d2-7e40-4152-b28d-9a1dd6d89c50 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:39.086397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-52fe09d2-7e40-4152-b28d-9a1dd6d89c50 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:39.093203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52fe09d2-7e40-4152-b28d-9a1dd6d89c50 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:39.093672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52fe09d2-7e40-4152-b28d-9a1dd6d89c50 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:39.094095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52fe09d2-7e40-4152-b28d-9a1dd6d89c50 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:39.094801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52fe09d2-7e40-4152-b28d-9a1dd6d89c50 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:39.095240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52fe09d2-7e40-4152-b28d-9a1dd6d89c50 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:39.095655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52fe09d2-7e40-4152-b28d-9a1dd6d89c50 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:39.234869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-52fe09d2-7e40-4152-b28d-9a1dd6d89c50 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:39.242927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-52fe09d2-7e40-4152-b28d-9a1dd6d89c50 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.161047 Sep 13 20:02:39.243476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 331/606] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:39 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:39.581178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c3a83316-f1cf-40c3-83ab-e56d5516df98 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:39.581851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c3a83316-f1cf-40c3-83ab-e56d5516df98 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:39.590165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3a83316-f1cf-40c3-83ab-e56d5516df98 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:39.590687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3a83316-f1cf-40c3-83ab-e56d5516df98 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:39.591118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3a83316-f1cf-40c3-83ab-e56d5516df98 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:39.591813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3a83316-f1cf-40c3-83ab-e56d5516df98 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:39.592266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3a83316-f1cf-40c3-83ab-e56d5516df98 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:39.592689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3a83316-f1cf-40c3-83ab-e56d5516df98 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:39.735398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c3a83316-f1cf-40c3-83ab-e56d5516df98 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:39.744503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c3a83316-f1cf-40c3-83ab-e56d5516df98 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:39.745944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c3a83316-f1cf-40c3-83ab-e56d5516df98 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:39.747147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c3a83316-f1cf-40c3-83ab-e56d5516df98 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.172366 Sep 13 20:02:39.747697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 276/607] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:40.266699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f8a9c265-61ba-4b36-a63f-5fc95d8d43f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:40.267320 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f8a9c265-61ba-4b36-a63f-5fc95d8d43f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:40.275044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8a9c265-61ba-4b36-a63f-5fc95d8d43f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:40.275504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8a9c265-61ba-4b36-a63f-5fc95d8d43f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:40.275957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8a9c265-61ba-4b36-a63f-5fc95d8d43f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:40.276664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8a9c265-61ba-4b36-a63f-5fc95d8d43f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:40.277154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8a9c265-61ba-4b36-a63f-5fc95d8d43f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:40.277575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8a9c265-61ba-4b36-a63f-5fc95d8d43f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:40.409788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f8a9c265-61ba-4b36-a63f-5fc95d8d43f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:40.418124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f8a9c265-61ba-4b36-a63f-5fc95d8d43f5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.155415 Sep 13 20:02:40.418749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 332/608] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:40 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:40.772596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c4cd7383-521b-4dde-84f3-410d0488bff0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:40.773203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c4cd7383-521b-4dde-84f3-410d0488bff0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:40.780231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4cd7383-521b-4dde-84f3-410d0488bff0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:40.780759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4cd7383-521b-4dde-84f3-410d0488bff0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:40.781216 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4cd7383-521b-4dde-84f3-410d0488bff0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:40.781886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4cd7383-521b-4dde-84f3-410d0488bff0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:40.782334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4cd7383-521b-4dde-84f3-410d0488bff0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:40.782823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4cd7383-521b-4dde-84f3-410d0488bff0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:40.929984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c4cd7383-521b-4dde-84f3-410d0488bff0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:40.939731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c4cd7383-521b-4dde-84f3-410d0488bff0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:40.941132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c4cd7383-521b-4dde-84f3-410d0488bff0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:40.942272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c4cd7383-521b-4dde-84f3-410d0488bff0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.173697 Sep 13 20:02:40.942867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 277/609] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:41.440887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-64a77d67-0932-4f6f-ac23-a9e9e5f749ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:41.441514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-64a77d67-0932-4f6f-ac23-a9e9e5f749ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:41.453083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64a77d67-0932-4f6f-ac23-a9e9e5f749ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:41.453602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64a77d67-0932-4f6f-ac23-a9e9e5f749ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:41.454033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64a77d67-0932-4f6f-ac23-a9e9e5f749ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:41.459138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64a77d67-0932-4f6f-ac23-a9e9e5f749ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:41.459599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64a77d67-0932-4f6f-ac23-a9e9e5f749ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:41.460023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64a77d67-0932-4f6f-ac23-a9e9e5f749ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:41.608522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-64a77d67-0932-4f6f-ac23-a9e9e5f749ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:41.616727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-64a77d67-0932-4f6f-ac23-a9e9e5f749ba tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.179951 Sep 13 20:02:41.617335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 333/610] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:41 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:41.977450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-774875f0-e128-4dc6-9a4d-2b844b93d89a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:41.978351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-774875f0-e128-4dc6-9a4d-2b844b93d89a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:41.988578 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-774875f0-e128-4dc6-9a4d-2b844b93d89a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:41.989326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-774875f0-e128-4dc6-9a4d-2b844b93d89a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:41.989917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-774875f0-e128-4dc6-9a4d-2b844b93d89a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:41.990994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-774875f0-e128-4dc6-9a4d-2b844b93d89a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:41.992115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-774875f0-e128-4dc6-9a4d-2b844b93d89a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:41.992251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-774875f0-e128-4dc6-9a4d-2b844b93d89a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:42.144437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-774875f0-e128-4dc6-9a4d-2b844b93d89a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:42.157625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-774875f0-e128-4dc6-9a4d-2b844b93d89a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:42.159859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-774875f0-e128-4dc6-9a4d-2b844b93d89a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:42.161567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-774875f0-e128-4dc6-9a4d-2b844b93d89a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.190337 Sep 13 20:02:42.162413 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 278/611] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:41 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:42.640812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b9454d2c-fc78-4da8-bfdc-54dd21ddd45f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:42.641384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b9454d2c-fc78-4da8-bfdc-54dd21ddd45f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:42.648339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9454d2c-fc78-4da8-bfdc-54dd21ddd45f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:42.648827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9454d2c-fc78-4da8-bfdc-54dd21ddd45f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:42.649259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9454d2c-fc78-4da8-bfdc-54dd21ddd45f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:42.650024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9454d2c-fc78-4da8-bfdc-54dd21ddd45f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:42.650600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9454d2c-fc78-4da8-bfdc-54dd21ddd45f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:42.651010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9454d2c-fc78-4da8-bfdc-54dd21ddd45f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:42.794191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b9454d2c-fc78-4da8-bfdc-54dd21ddd45f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:42.802271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b9454d2c-fc78-4da8-bfdc-54dd21ddd45f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.165642 Sep 13 20:02:42.802883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 334/612] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:42 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:43.187738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-61b9b3ef-2a0b-414d-b7eb-67c455bc06db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:43.188750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-61b9b3ef-2a0b-414d-b7eb-67c455bc06db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:43.195342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61b9b3ef-2a0b-414d-b7eb-67c455bc06db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:43.195342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61b9b3ef-2a0b-414d-b7eb-67c455bc06db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:43.195342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61b9b3ef-2a0b-414d-b7eb-67c455bc06db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:43.196907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61b9b3ef-2a0b-414d-b7eb-67c455bc06db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:43.197609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61b9b3ef-2a0b-414d-b7eb-67c455bc06db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:43.198138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61b9b3ef-2a0b-414d-b7eb-67c455bc06db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:43.336168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-61b9b3ef-2a0b-414d-b7eb-67c455bc06db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:43.345432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-61b9b3ef-2a0b-414d-b7eb-67c455bc06db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:43.346875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-61b9b3ef-2a0b-414d-b7eb-67c455bc06db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:43.348033 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-61b9b3ef-2a0b-414d-b7eb-67c455bc06db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.164456 Sep 13 20:02:43.348576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 279/613] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:43.825868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-11a9e84f-d752-49c8-8e5e-b15fbd04dde9 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:43.826440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-11a9e84f-d752-49c8-8e5e-b15fbd04dde9 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:43.833460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11a9e84f-d752-49c8-8e5e-b15fbd04dde9 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:43.833940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11a9e84f-d752-49c8-8e5e-b15fbd04dde9 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:43.834399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11a9e84f-d752-49c8-8e5e-b15fbd04dde9 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:43.835081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11a9e84f-d752-49c8-8e5e-b15fbd04dde9 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:43.835528 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11a9e84f-d752-49c8-8e5e-b15fbd04dde9 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:43.835940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11a9e84f-d752-49c8-8e5e-b15fbd04dde9 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:43.977216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-11a9e84f-d752-49c8-8e5e-b15fbd04dde9 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:43.988811 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-11a9e84f-d752-49c8-8e5e-b15fbd04dde9 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.166875 Sep 13 20:02:43.989589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 335/614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:43 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:44.374031 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3825051d-f7e6-47cf-9783-8ea635d3cdfc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:44.374699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3825051d-f7e6-47cf-9783-8ea635d3cdfc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:44.381570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3825051d-f7e6-47cf-9783-8ea635d3cdfc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:44.382092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3825051d-f7e6-47cf-9783-8ea635d3cdfc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:44.382668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3825051d-f7e6-47cf-9783-8ea635d3cdfc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:44.383390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3825051d-f7e6-47cf-9783-8ea635d3cdfc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:44.383895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3825051d-f7e6-47cf-9783-8ea635d3cdfc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:44.384311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3825051d-f7e6-47cf-9783-8ea635d3cdfc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:44.529412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3825051d-f7e6-47cf-9783-8ea635d3cdfc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:44.538562 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3825051d-f7e6-47cf-9783-8ea635d3cdfc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:44.540258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3825051d-f7e6-47cf-9783-8ea635d3cdfc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:44.541478 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3825051d-f7e6-47cf-9783-8ea635d3cdfc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.171405 Sep 13 20:02:44.541993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 280/615] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:45.013329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e5f04ee0-8373-4a48-b4a9-34fd6bebad75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:45.013931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e5f04ee0-8373-4a48-b4a9-34fd6bebad75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:45.021596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5f04ee0-8373-4a48-b4a9-34fd6bebad75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:45.022070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5f04ee0-8373-4a48-b4a9-34fd6bebad75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:45.022525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5f04ee0-8373-4a48-b4a9-34fd6bebad75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:45.023245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5f04ee0-8373-4a48-b4a9-34fd6bebad75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:45.023683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5f04ee0-8373-4a48-b4a9-34fd6bebad75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:45.024136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5f04ee0-8373-4a48-b4a9-34fd6bebad75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:45.168968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e5f04ee0-8373-4a48-b4a9-34fd6bebad75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:45.177503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e5f04ee0-8373-4a48-b4a9-34fd6bebad75 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.168786 Sep 13 20:02:45.178091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 336/616] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:45 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:45.567281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c132e06f-9614-4505-8ee1-756cfd0dbe02 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:45.568139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c132e06f-9614-4505-8ee1-756cfd0dbe02 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:45.575214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c132e06f-9614-4505-8ee1-756cfd0dbe02 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:45.575495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c132e06f-9614-4505-8ee1-756cfd0dbe02 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:45.575931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c132e06f-9614-4505-8ee1-756cfd0dbe02 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:45.576637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c132e06f-9614-4505-8ee1-756cfd0dbe02 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:45.577089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c132e06f-9614-4505-8ee1-756cfd0dbe02 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:45.577512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c132e06f-9614-4505-8ee1-756cfd0dbe02 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:45.716926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c132e06f-9614-4505-8ee1-756cfd0dbe02 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:45.726018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c132e06f-9614-4505-8ee1-756cfd0dbe02 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:45.727492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c132e06f-9614-4505-8ee1-756cfd0dbe02 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:45.728653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c132e06f-9614-4505-8ee1-756cfd0dbe02 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.165352 Sep 13 20:02:45.729184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 281/617] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:46.202205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-940b3812-05a8-4adc-986f-8858659a824d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:46.202863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-940b3812-05a8-4adc-986f-8858659a824d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:46.210984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-940b3812-05a8-4adc-986f-8858659a824d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:46.211469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-940b3812-05a8-4adc-986f-8858659a824d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:46.212005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-940b3812-05a8-4adc-986f-8858659a824d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:46.212676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-940b3812-05a8-4adc-986f-8858659a824d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:46.213151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-940b3812-05a8-4adc-986f-8858659a824d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:46.213567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-940b3812-05a8-4adc-986f-8858659a824d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:46.361690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-940b3812-05a8-4adc-986f-8858659a824d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:46.371465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-940b3812-05a8-4adc-986f-8858659a824d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.173226 Sep 13 20:02:46.372004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 337/618] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:46 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:46.754486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2242f6ad-effa-4dca-a823-2e414b0aaa58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:46.755204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2242f6ad-effa-4dca-a823-2e414b0aaa58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:46.763213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2242f6ad-effa-4dca-a823-2e414b0aaa58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:46.763697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2242f6ad-effa-4dca-a823-2e414b0aaa58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:46.764125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2242f6ad-effa-4dca-a823-2e414b0aaa58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:46.764812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2242f6ad-effa-4dca-a823-2e414b0aaa58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:46.765258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2242f6ad-effa-4dca-a823-2e414b0aaa58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:46.765677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2242f6ad-effa-4dca-a823-2e414b0aaa58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:46.923460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2242f6ad-effa-4dca-a823-2e414b0aaa58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:46.933397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2242f6ad-effa-4dca-a823-2e414b0aaa58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:46.935366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2242f6ad-effa-4dca-a823-2e414b0aaa58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:46.936717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2242f6ad-effa-4dca-a823-2e414b0aaa58 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.186235 Sep 13 20:02:46.937344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 282/619] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:02:47.394879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cbcf9d8d-93f5-4d68-9e33-5e4c98339152 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:47.395727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cbcf9d8d-93f5-4d68-9e33-5e4c98339152 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:47.403045 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbcf9d8d-93f5-4d68-9e33-5e4c98339152 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:47.403524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbcf9d8d-93f5-4d68-9e33-5e4c98339152 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:47.403952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbcf9d8d-93f5-4d68-9e33-5e4c98339152 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:47.404640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbcf9d8d-93f5-4d68-9e33-5e4c98339152 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:47.405089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbcf9d8d-93f5-4d68-9e33-5e4c98339152 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:47.405560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbcf9d8d-93f5-4d68-9e33-5e4c98339152 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:47.549363 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cbcf9d8d-93f5-4d68-9e33-5e4c98339152 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:47.557937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cbcf9d8d-93f5-4d68-9e33-5e4c98339152 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.166972 Sep 13 20:02:47.558541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 338/620] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:47 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:47.970079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-835eca3a-9669-48db-91d4-9bb8e9583550 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:47.970728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-835eca3a-9669-48db-91d4-9bb8e9583550 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:47.977477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-835eca3a-9669-48db-91d4-9bb8e9583550 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:47.977959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-835eca3a-9669-48db-91d4-9bb8e9583550 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:47.978398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-835eca3a-9669-48db-91d4-9bb8e9583550 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:47.979147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-835eca3a-9669-48db-91d4-9bb8e9583550 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:47.979600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-835eca3a-9669-48db-91d4-9bb8e9583550 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:47.980002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-835eca3a-9669-48db-91d4-9bb8e9583550 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:48.115267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-835eca3a-9669-48db-91d4-9bb8e9583550 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:48.128548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-835eca3a-9669-48db-91d4-9bb8e9583550 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:48.130868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-835eca3a-9669-48db-91d4-9bb8e9583550 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:48.132576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-835eca3a-9669-48db-91d4-9bb8e9583550 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.166365 Sep 13 20:02:48.133294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 283/621] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:47 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:48.581748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c21b4660-1a93-42dd-98fa-da3039571df1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:48.582391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c21b4660-1a93-42dd-98fa-da3039571df1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:48.584845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:48.590527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c21b4660-1a93-42dd-98fa-da3039571df1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:48.590983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c21b4660-1a93-42dd-98fa-da3039571df1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:48.591406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c21b4660-1a93-42dd-98fa-da3039571df1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:48.592096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c21b4660-1a93-42dd-98fa-da3039571df1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:48.592538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c21b4660-1a93-42dd-98fa-da3039571df1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:48.592958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c21b4660-1a93-42dd-98fa-da3039571df1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:48.738842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c21b4660-1a93-42dd-98fa-da3039571df1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:48.747299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c21b4660-1a93-42dd-98fa-da3039571df1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.169806 Sep 13 20:02:48.747865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 339/622] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:48 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:49.067187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b1380fd0-0f9a-4805-8f33-081c00f61dba tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4ab2bc2-da34-4229-8613-f11e1bd84ef5"}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:49.069673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b1380fd0-0f9a-4805-8f33-081c00f61dba tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:49.072287 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=58 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:49.078257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1380fd0-0f9a-4805-8f33-081c00f61dba tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:49.078845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1380fd0-0f9a-4805-8f33-081c00f61dba tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:49.079289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1380fd0-0f9a-4805-8f33-081c00f61dba tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:49.080390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1380fd0-0f9a-4805-8f33-081c00f61dba tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:49.080913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1380fd0-0f9a-4805-8f33-081c00f61dba tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:49.081380 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1380fd0-0f9a-4805-8f33-081c00f61dba tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:49.158102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1ae1f473-4eb9-4f7f-a62b-c18f5abc25fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:49.158871 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1ae1f473-4eb9-4f7f-a62b-c18f5abc25fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:49.165188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ae1f473-4eb9-4f7f-a62b-c18f5abc25fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:49.165676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ae1f473-4eb9-4f7f-a62b-c18f5abc25fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:49.166094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ae1f473-4eb9-4f7f-a62b-c18f5abc25fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:49.166824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ae1f473-4eb9-4f7f-a62b-c18f5abc25fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:49.167261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ae1f473-4eb9-4f7f-a62b-c18f5abc25fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:49.167674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ae1f473-4eb9-4f7f-a62b-c18f5abc25fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:49.300830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1ae1f473-4eb9-4f7f-a62b-c18f5abc25fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:49.310414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1ae1f473-4eb9-4f7f-a62b-c18f5abc25fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:49.311819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1ae1f473-4eb9-4f7f-a62b-c18f5abc25fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:49.312976 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1ae1f473-4eb9-4f7f-a62b-c18f5abc25fc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.158934 Sep 13 20:02:49.315880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 340/623] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:02:49.771260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-33c87056-951a-4b06-a78c-cd161bcfdb10 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:49.771926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-33c87056-951a-4b06-a78c-cd161bcfdb10 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:49.779185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c87056-951a-4b06-a78c-cd161bcfdb10 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:49.779660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c87056-951a-4b06-a78c-cd161bcfdb10 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:49.780064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c87056-951a-4b06-a78c-cd161bcfdb10 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:49.780745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c87056-951a-4b06-a78c-cd161bcfdb10 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:49.781205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c87056-951a-4b06-a78c-cd161bcfdb10 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:49.781616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c87056-951a-4b06-a78c-cd161bcfdb10 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:49.914105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-33c87056-951a-4b06-a78c-cd161bcfdb10 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:49.921848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-33c87056-951a-4b06-a78c-cd161bcfdb10 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.154797 Sep 13 20:02:49.922430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 341/624] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:49 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:50.342687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f34f0258-ad77-4955-b677-0f388d8e2e60 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:50.343566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f34f0258-ad77-4955-b677-0f388d8e2e60 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:50.353441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f34f0258-ad77-4955-b677-0f388d8e2e60 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:50.353919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f34f0258-ad77-4955-b677-0f388d8e2e60 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:50.354346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f34f0258-ad77-4955-b677-0f388d8e2e60 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:50.355071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f34f0258-ad77-4955-b677-0f388d8e2e60 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:50.355516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f34f0258-ad77-4955-b677-0f388d8e2e60 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:50.355927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f34f0258-ad77-4955-b677-0f388d8e2e60 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:50.489873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f34f0258-ad77-4955-b677-0f388d8e2e60 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:50.498865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f34f0258-ad77-4955-b677-0f388d8e2e60 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:50.500295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f34f0258-ad77-4955-b677-0f388d8e2e60 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:50.501464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f34f0258-ad77-4955-b677-0f388d8e2e60 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.165505 Sep 13 20:02:50.502031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 342/625] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:50.945875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-757dadc3-2321-4a7e-b841-c64567beabd3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:50.946517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-757dadc3-2321-4a7e-b841-c64567beabd3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:50.953296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-757dadc3-2321-4a7e-b841-c64567beabd3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:50.953912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-757dadc3-2321-4a7e-b841-c64567beabd3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:50.954378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-757dadc3-2321-4a7e-b841-c64567beabd3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:50.955438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-757dadc3-2321-4a7e-b841-c64567beabd3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:50.955884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-757dadc3-2321-4a7e-b841-c64567beabd3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:50.956464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-757dadc3-2321-4a7e-b841-c64567beabd3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:51.092941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-757dadc3-2321-4a7e-b841-c64567beabd3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:51.100928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-757dadc3-2321-4a7e-b841-c64567beabd3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.159471 Sep 13 20:02:51.101458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 343/626] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:50 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:51.528546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-560fe6cb-7889-4fb6-9163-0c9cd4d0323a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:51.529179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-560fe6cb-7889-4fb6-9163-0c9cd4d0323a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:51.536407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-560fe6cb-7889-4fb6-9163-0c9cd4d0323a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:51.536946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-560fe6cb-7889-4fb6-9163-0c9cd4d0323a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:51.537417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-560fe6cb-7889-4fb6-9163-0c9cd4d0323a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:51.538106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-560fe6cb-7889-4fb6-9163-0c9cd4d0323a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:51.538589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-560fe6cb-7889-4fb6-9163-0c9cd4d0323a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:51.539030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-560fe6cb-7889-4fb6-9163-0c9cd4d0323a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:51.543105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:51.675285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-560fe6cb-7889-4fb6-9163-0c9cd4d0323a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:51.685968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-560fe6cb-7889-4fb6-9163-0c9cd4d0323a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:51.687420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-560fe6cb-7889-4fb6-9163-0c9cd4d0323a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:51.688575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-560fe6cb-7889-4fb6-9163-0c9cd4d0323a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.164686 Sep 13 20:02:51.689136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 344/627] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:02:52.126021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f7c6e027-4304-4ddb-a429-6fd9715a65a5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:52.126864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f7c6e027-4304-4ddb-a429-6fd9715a65a5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:52.133886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c6e027-4304-4ddb-a429-6fd9715a65a5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:52.134393 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c6e027-4304-4ddb-a429-6fd9715a65a5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:52.134859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c6e027-4304-4ddb-a429-6fd9715a65a5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:52.135548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c6e027-4304-4ddb-a429-6fd9715a65a5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:52.136246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c6e027-4304-4ddb-a429-6fd9715a65a5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:52.136419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c6e027-4304-4ddb-a429-6fd9715a65a5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:52.332851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f7c6e027-4304-4ddb-a429-6fd9715a65a5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:52.341374 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f7c6e027-4304-4ddb-a429-6fd9715a65a5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.219358 Sep 13 20:02:52.341985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 345/628] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:52 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:52.713676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3799fb99-8b8e-473d-812d-2c1f19f86307 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:52.714281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3799fb99-8b8e-473d-812d-2c1f19f86307 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:52.720713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3799fb99-8b8e-473d-812d-2c1f19f86307 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:52.721297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3799fb99-8b8e-473d-812d-2c1f19f86307 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:52.721648 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3799fb99-8b8e-473d-812d-2c1f19f86307 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:52.722343 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3799fb99-8b8e-473d-812d-2c1f19f86307 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:52.722849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3799fb99-8b8e-473d-812d-2c1f19f86307 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:52.723249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3799fb99-8b8e-473d-812d-2c1f19f86307 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:52.861646 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3799fb99-8b8e-473d-812d-2c1f19f86307 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:52.871969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3799fb99-8b8e-473d-812d-2c1f19f86307 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:52.873680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3799fb99-8b8e-473d-812d-2c1f19f86307 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:52.874993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3799fb99-8b8e-473d-812d-2c1f19f86307 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.165644 Sep 13 20:02:52.875594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 346/629] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:02:53.366129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9cd4dfa9-81ed-4602-9e3c-f020f890b6ad tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:53.367092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9cd4dfa9-81ed-4602-9e3c-f020f890b6ad tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:53.374294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9cd4dfa9-81ed-4602-9e3c-f020f890b6ad tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:53.374956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9cd4dfa9-81ed-4602-9e3c-f020f890b6ad tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:53.375504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9cd4dfa9-81ed-4602-9e3c-f020f890b6ad tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:53.376388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9cd4dfa9-81ed-4602-9e3c-f020f890b6ad tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:53.376995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9cd4dfa9-81ed-4602-9e3c-f020f890b6ad tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:53.377515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9cd4dfa9-81ed-4602-9e3c-f020f890b6ad tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:53.566499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9cd4dfa9-81ed-4602-9e3c-f020f890b6ad tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:53.581003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9cd4dfa9-81ed-4602-9e3c-f020f890b6ad tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.218638 Sep 13 20:02:53.581995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 347/630] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:53 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:53.902462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-52939d80-b170-4746-9e01-7c64ed045f16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:53.903432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-52939d80-b170-4746-9e01-7c64ed045f16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:53.914734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52939d80-b170-4746-9e01-7c64ed045f16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:53.915591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52939d80-b170-4746-9e01-7c64ed045f16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:53.916427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52939d80-b170-4746-9e01-7c64ed045f16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:53.917661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52939d80-b170-4746-9e01-7c64ed045f16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:53.918482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52939d80-b170-4746-9e01-7c64ed045f16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:53.919254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52939d80-b170-4746-9e01-7c64ed045f16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:54.067461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-52939d80-b170-4746-9e01-7c64ed045f16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:54.083745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-52939d80-b170-4746-9e01-7c64ed045f16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:54.085680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-52939d80-b170-4746-9e01-7c64ed045f16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:54.087821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-52939d80-b170-4746-9e01-7c64ed045f16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.190617 Sep 13 20:02:54.088806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 348/631] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:53 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:02:54.619242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fad98c18-cf4f-461d-9c54-5ca383fe3b30 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:54.619944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fad98c18-cf4f-461d-9c54-5ca383fe3b30 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:54.627275 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fad98c18-cf4f-461d-9c54-5ca383fe3b30 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:54.627761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fad98c18-cf4f-461d-9c54-5ca383fe3b30 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:54.628182 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fad98c18-cf4f-461d-9c54-5ca383fe3b30 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:54.628872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fad98c18-cf4f-461d-9c54-5ca383fe3b30 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:54.629316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fad98c18-cf4f-461d-9c54-5ca383fe3b30 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:54.629727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fad98c18-cf4f-461d-9c54-5ca383fe3b30 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:54.780150 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fad98c18-cf4f-461d-9c54-5ca383fe3b30 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:54.788709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fad98c18-cf4f-461d-9c54-5ca383fe3b30 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.173348 Sep 13 20:02:54.789298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 349/632] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:54 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:55.115335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4fffd04b-12a3-42ee-adcb-c29721183e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:55.115986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4fffd04b-12a3-42ee-adcb-c29721183e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:55.123238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fffd04b-12a3-42ee-adcb-c29721183e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:55.123727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fffd04b-12a3-42ee-adcb-c29721183e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:55.124169 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fffd04b-12a3-42ee-adcb-c29721183e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:55.124918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fffd04b-12a3-42ee-adcb-c29721183e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:55.125370 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fffd04b-12a3-42ee-adcb-c29721183e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:55.125967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fffd04b-12a3-42ee-adcb-c29721183e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:55.275765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4fffd04b-12a3-42ee-adcb-c29721183e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:55.285568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4fffd04b-12a3-42ee-adcb-c29721183e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:55.287062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4fffd04b-12a3-42ee-adcb-c29721183e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:55.288307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4fffd04b-12a3-42ee-adcb-c29721183e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.177403 Sep 13 20:02:55.288896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 350/633] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:02:55.816390 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d14478ed-10f5-4aa6-96da-4474feca4c42 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:55.817636 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d14478ed-10f5-4aa6-96da-4474feca4c42 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:55.826689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d14478ed-10f5-4aa6-96da-4474feca4c42 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:55.827107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d14478ed-10f5-4aa6-96da-4474feca4c42 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:55.827656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d14478ed-10f5-4aa6-96da-4474feca4c42 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:55.828576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d14478ed-10f5-4aa6-96da-4474feca4c42 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:55.829114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d14478ed-10f5-4aa6-96da-4474feca4c42 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:55.830075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d14478ed-10f5-4aa6-96da-4474feca4c42 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:55.988474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d14478ed-10f5-4aa6-96da-4474feca4c42 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:56.008001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d14478ed-10f5-4aa6-96da-4474feca4c42 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.198075 Sep 13 20:02:56.009117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 351/634] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:55 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:56.320111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f44c2705-5e21-410d-b680-7388d19d03d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:56.321632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f44c2705-5e21-410d-b680-7388d19d03d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:56.333666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f44c2705-5e21-410d-b680-7388d19d03d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:56.334505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f44c2705-5e21-410d-b680-7388d19d03d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:56.335191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f44c2705-5e21-410d-b680-7388d19d03d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:56.336262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f44c2705-5e21-410d-b680-7388d19d03d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:56.337001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f44c2705-5e21-410d-b680-7388d19d03d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:56.337758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f44c2705-5e21-410d-b680-7388d19d03d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:56.518530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f44c2705-5e21-410d-b680-7388d19d03d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:56.528270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f44c2705-5e21-410d-b680-7388d19d03d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:56.529720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f44c2705-5e21-410d-b680-7388d19d03d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:56.530980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f44c2705-5e21-410d-b680-7388d19d03d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.218936 Sep 13 20:02:56.531548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 352/635] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:02:57.032083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e5d8bbf6-3956-4ef5-afa3-39c23b133c56 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:57.032777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e5d8bbf6-3956-4ef5-afa3-39c23b133c56 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:57.041047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5d8bbf6-3956-4ef5-afa3-39c23b133c56 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:57.041585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5d8bbf6-3956-4ef5-afa3-39c23b133c56 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:57.042064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5d8bbf6-3956-4ef5-afa3-39c23b133c56 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:57.042904 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5d8bbf6-3956-4ef5-afa3-39c23b133c56 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:57.043410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5d8bbf6-3956-4ef5-afa3-39c23b133c56 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:57.043876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5d8bbf6-3956-4ef5-afa3-39c23b133c56 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:57.196617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e5d8bbf6-3956-4ef5-afa3-39c23b133c56 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:57.205921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e5d8bbf6-3956-4ef5-afa3-39c23b133c56 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.177792 Sep 13 20:02:57.206568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 353/636] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:57 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:57.558401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e0fee364-fc68-4c2f-b430-b6cbb7ee9193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:57.558975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e0fee364-fc68-4c2f-b430-b6cbb7ee9193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:57.566007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0fee364-fc68-4c2f-b430-b6cbb7ee9193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:57.566605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0fee364-fc68-4c2f-b430-b6cbb7ee9193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:57.567088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0fee364-fc68-4c2f-b430-b6cbb7ee9193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:57.567884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0fee364-fc68-4c2f-b430-b6cbb7ee9193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:57.568371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0fee364-fc68-4c2f-b430-b6cbb7ee9193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:57.568834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0fee364-fc68-4c2f-b430-b6cbb7ee9193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:57.764882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e0fee364-fc68-4c2f-b430-b6cbb7ee9193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:57.774684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e0fee364-fc68-4c2f-b430-b6cbb7ee9193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:57.776161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e0fee364-fc68-4c2f-b430-b6cbb7ee9193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:57.777378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e0fee364-fc68-4c2f-b430-b6cbb7ee9193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.223735 Sep 13 20:02:57.777962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 354/637] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:02:58.231556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-48781ac3-aed8-4acf-ad51-22d66abf915f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:58.232245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-48781ac3-aed8-4acf-ad51-22d66abf915f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:58.238687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48781ac3-aed8-4acf-ad51-22d66abf915f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:58.239166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48781ac3-aed8-4acf-ad51-22d66abf915f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:58.239576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48781ac3-aed8-4acf-ad51-22d66abf915f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:58.240251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48781ac3-aed8-4acf-ad51-22d66abf915f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:58.240693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48781ac3-aed8-4acf-ad51-22d66abf915f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:58.241098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48781ac3-aed8-4acf-ad51-22d66abf915f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:58.390715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-48781ac3-aed8-4acf-ad51-22d66abf915f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:58.399617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-48781ac3-aed8-4acf-ad51-22d66abf915f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.171920 Sep 13 20:02:58.400281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 355/638] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:58 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:58.808421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8c7c8c89-678a-4a2f-b2bc-2bb6aeeec766 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:58.809068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8c7c8c89-678a-4a2f-b2bc-2bb6aeeec766 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:58.815456 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c7c8c89-678a-4a2f-b2bc-2bb6aeeec766 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:58.815882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c7c8c89-678a-4a2f-b2bc-2bb6aeeec766 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:58.816312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c7c8c89-678a-4a2f-b2bc-2bb6aeeec766 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:58.817016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c7c8c89-678a-4a2f-b2bc-2bb6aeeec766 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:58.817471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c7c8c89-678a-4a2f-b2bc-2bb6aeeec766 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:58.817892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c7c8c89-678a-4a2f-b2bc-2bb6aeeec766 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:58.970793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8c7c8c89-678a-4a2f-b2bc-2bb6aeeec766 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:58.979906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8c7c8c89-678a-4a2f-b2bc-2bb6aeeec766 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:58.981313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8c7c8c89-678a-4a2f-b2bc-2bb6aeeec766 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:58.982490 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8c7c8c89-678a-4a2f-b2bc-2bb6aeeec766 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.178178 Sep 13 20:02:58.983046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 356/639] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:02:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:02:59.087600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:59.161053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=61 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:59.423246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5ad8841a-3d5f-4e3b-8324-feaae7f654c3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:59.424027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5ad8841a-3d5f-4e3b-8324-feaae7f654c3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:59.433913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ad8841a-3d5f-4e3b-8324-feaae7f654c3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:59.434639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ad8841a-3d5f-4e3b-8324-feaae7f654c3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:59.435087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ad8841a-3d5f-4e3b-8324-feaae7f654c3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:59.443947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ad8841a-3d5f-4e3b-8324-feaae7f654c3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:59.444479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ad8841a-3d5f-4e3b-8324-feaae7f654c3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:59.445094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ad8841a-3d5f-4e3b-8324-feaae7f654c3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:59.622524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5ad8841a-3d5f-4e3b-8324-feaae7f654c3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:59.631785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5ad8841a-3d5f-4e3b-8324-feaae7f654c3 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.212540 Sep 13 20:02:59.632615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 357/640] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:59 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:00.008436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ff51aef0-3b7b-4e08-ace3-abaeb3e719b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:00.009146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ff51aef0-3b7b-4e08-ace3-abaeb3e719b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:00.016943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff51aef0-3b7b-4e08-ace3-abaeb3e719b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:00.018352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff51aef0-3b7b-4e08-ace3-abaeb3e719b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:00.018352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff51aef0-3b7b-4e08-ace3-abaeb3e719b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:00.018615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff51aef0-3b7b-4e08-ace3-abaeb3e719b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:00.019000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff51aef0-3b7b-4e08-ace3-abaeb3e719b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:00.019712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff51aef0-3b7b-4e08-ace3-abaeb3e719b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:00.171392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ff51aef0-3b7b-4e08-ace3-abaeb3e719b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:00.182468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ff51aef0-3b7b-4e08-ace3-abaeb3e719b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:00.184346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ff51aef0-3b7b-4e08-ace3-abaeb3e719b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:00.185763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ff51aef0-3b7b-4e08-ace3-abaeb3e719b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.181380 Sep 13 20:03:00.186384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 358/641] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:00 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:00.660591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-469e43d5-373a-4921-828b-4c11cedcfcd5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:00.661300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-469e43d5-373a-4921-828b-4c11cedcfcd5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:00.668608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-469e43d5-373a-4921-828b-4c11cedcfcd5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:00.669324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-469e43d5-373a-4921-828b-4c11cedcfcd5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:00.669873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-469e43d5-373a-4921-828b-4c11cedcfcd5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:00.670633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-469e43d5-373a-4921-828b-4c11cedcfcd5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:00.671188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-469e43d5-373a-4921-828b-4c11cedcfcd5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:00.671690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-469e43d5-373a-4921-828b-4c11cedcfcd5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:00.827901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-469e43d5-373a-4921-828b-4c11cedcfcd5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:00.838251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-469e43d5-373a-4921-828b-4c11cedcfcd5 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.182165 Sep 13 20:03:00.839091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 359/642] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:00 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:01.213150 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1b05c030-6993-4c2d-939f-7c00cebdc697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:01.213908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1b05c030-6993-4c2d-939f-7c00cebdc697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:01.222117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b05c030-6993-4c2d-939f-7c00cebdc697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:01.222696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b05c030-6993-4c2d-939f-7c00cebdc697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:01.223200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b05c030-6993-4c2d-939f-7c00cebdc697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:01.224126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b05c030-6993-4c2d-939f-7c00cebdc697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:01.224686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b05c030-6993-4c2d-939f-7c00cebdc697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:01.225209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b05c030-6993-4c2d-939f-7c00cebdc697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:01.377857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1b05c030-6993-4c2d-939f-7c00cebdc697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:01.382668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:01.390144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1b05c030-6993-4c2d-939f-7c00cebdc697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:01.391612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1b05c030-6993-4c2d-939f-7c00cebdc697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:01.392788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1b05c030-6993-4c2d-939f-7c00cebdc697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.184782 Sep 13 20:03:01.393354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 360/643] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:03:01.872901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-08412216-af33-4eef-a552-325101f6749a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:01.873597 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-08412216-af33-4eef-a552-325101f6749a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:01.883309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08412216-af33-4eef-a552-325101f6749a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:01.883875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08412216-af33-4eef-a552-325101f6749a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:01.884328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08412216-af33-4eef-a552-325101f6749a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:01.885193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08412216-af33-4eef-a552-325101f6749a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:01.885842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08412216-af33-4eef-a552-325101f6749a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:01.886442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08412216-af33-4eef-a552-325101f6749a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:02.044872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-08412216-af33-4eef-a552-325101f6749a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:02.054808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-08412216-af33-4eef-a552-325101f6749a tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.188244 Sep 13 20:03:02.055594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 361/644] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:01 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:02.424300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6a65758d-ec2e-402c-8e23-2061843b9e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:02.425085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6a65758d-ec2e-402c-8e23-2061843b9e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:02.432105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6a65758d-ec2e-402c-8e23-2061843b9e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:02.432612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6a65758d-ec2e-402c-8e23-2061843b9e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:02.433047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6a65758d-ec2e-402c-8e23-2061843b9e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:02.433764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6a65758d-ec2e-402c-8e23-2061843b9e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:02.434208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6a65758d-ec2e-402c-8e23-2061843b9e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:02.434665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6a65758d-ec2e-402c-8e23-2061843b9e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:02.612610 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6a65758d-ec2e-402c-8e23-2061843b9e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:02.631716 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6a65758d-ec2e-402c-8e23-2061843b9e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:02.633365 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6a65758d-ec2e-402c-8e23-2061843b9e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:02.634799 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6a65758d-ec2e-402c-8e23-2061843b9e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.214948 Sep 13 20:03:02.635472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 362/645] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:03.079440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-49683a4f-85a4-42bb-bde4-de2fc4156586 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:03.080091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-49683a4f-85a4-42bb-bde4-de2fc4156586 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:03.086857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49683a4f-85a4-42bb-bde4-de2fc4156586 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:03.087356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49683a4f-85a4-42bb-bde4-de2fc4156586 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:03.087795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49683a4f-85a4-42bb-bde4-de2fc4156586 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:03.088505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49683a4f-85a4-42bb-bde4-de2fc4156586 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:03.088953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49683a4f-85a4-42bb-bde4-de2fc4156586 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:03.089373 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49683a4f-85a4-42bb-bde4-de2fc4156586 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:03.225758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-49683a4f-85a4-42bb-bde4-de2fc4156586 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:03.233995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-49683a4f-85a4-42bb-bde4-de2fc4156586 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.158786 Sep 13 20:03:03.234605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 363/646] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:03 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:03.664420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ecb9efd7-6976-4492-82b8-cafd43b4064e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:03.665036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ecb9efd7-6976-4492-82b8-cafd43b4064e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:03.671308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecb9efd7-6976-4492-82b8-cafd43b4064e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:03.671839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecb9efd7-6976-4492-82b8-cafd43b4064e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:03.672277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecb9efd7-6976-4492-82b8-cafd43b4064e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:03.673001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecb9efd7-6976-4492-82b8-cafd43b4064e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:03.673505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecb9efd7-6976-4492-82b8-cafd43b4064e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:03.673954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecb9efd7-6976-4492-82b8-cafd43b4064e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:03.840625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ecb9efd7-6976-4492-82b8-cafd43b4064e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:03.850948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ecb9efd7-6976-4492-82b8-cafd43b4064e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:03.852492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ecb9efd7-6976-4492-82b8-cafd43b4064e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:03.853714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ecb9efd7-6976-4492-82b8-cafd43b4064e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.193362 Sep 13 20:03:03.854326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 364/647] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:03:04.260674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ec8ce5f9-a5d8-4202-9325-ed81817b8adb tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:04.261609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ec8ce5f9-a5d8-4202-9325-ed81817b8adb tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:04.269434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ec8ce5f9-a5d8-4202-9325-ed81817b8adb tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:04.270119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ec8ce5f9-a5d8-4202-9325-ed81817b8adb tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:04.270757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ec8ce5f9-a5d8-4202-9325-ed81817b8adb tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:04.271760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ec8ce5f9-a5d8-4202-9325-ed81817b8adb tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:04.272351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ec8ce5f9-a5d8-4202-9325-ed81817b8adb tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:04.272956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ec8ce5f9-a5d8-4202-9325-ed81817b8adb tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:04.421463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ec8ce5f9-a5d8-4202-9325-ed81817b8adb tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:04.431914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ec8ce5f9-a5d8-4202-9325-ed81817b8adb tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.175024 Sep 13 20:03:04.432785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 365/648] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:04 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:04.881223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a5046b25-82ef-4974-a0e9-554bc4f41f35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:04.881901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a5046b25-82ef-4974-a0e9-554bc4f41f35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:04.889205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5046b25-82ef-4974-a0e9-554bc4f41f35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:04.889719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5046b25-82ef-4974-a0e9-554bc4f41f35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:04.890174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5046b25-82ef-4974-a0e9-554bc4f41f35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:04.890941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5046b25-82ef-4974-a0e9-554bc4f41f35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:04.891398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5046b25-82ef-4974-a0e9-554bc4f41f35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:04.891821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5046b25-82ef-4974-a0e9-554bc4f41f35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:05.057684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a5046b25-82ef-4974-a0e9-554bc4f41f35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:05.068480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a5046b25-82ef-4974-a0e9-554bc4f41f35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:05.070501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a5046b25-82ef-4974-a0e9-554bc4f41f35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:05.072128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a5046b25-82ef-4974-a0e9-554bc4f41f35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.196066 Sep 13 20:03:05.073075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 366/649] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:05.459620 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1c16d7f9-ff36-4714-9247-9f41b0ed337d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:05.460327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1c16d7f9-ff36-4714-9247-9f41b0ed337d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:05.474325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1c16d7f9-ff36-4714-9247-9f41b0ed337d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:05.474879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1c16d7f9-ff36-4714-9247-9f41b0ed337d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:05.475363 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1c16d7f9-ff36-4714-9247-9f41b0ed337d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:05.476117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1c16d7f9-ff36-4714-9247-9f41b0ed337d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:05.476590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1c16d7f9-ff36-4714-9247-9f41b0ed337d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:05.477008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1c16d7f9-ff36-4714-9247-9f41b0ed337d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:05.632448 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1c16d7f9-ff36-4714-9247-9f41b0ed337d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:05.642518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1c16d7f9-ff36-4714-9247-9f41b0ed337d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.186614 Sep 13 20:03:05.643150 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 367/650] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:05 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:06.103471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4fcc1d8a-7934-4560-8b68-5c04fbc46d17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:06.103973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4fcc1d8a-7934-4560-8b68-5c04fbc46d17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:06.110462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fcc1d8a-7934-4560-8b68-5c04fbc46d17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:06.110921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fcc1d8a-7934-4560-8b68-5c04fbc46d17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:06.111362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fcc1d8a-7934-4560-8b68-5c04fbc46d17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:06.112055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fcc1d8a-7934-4560-8b68-5c04fbc46d17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:06.112741 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fcc1d8a-7934-4560-8b68-5c04fbc46d17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:06.113158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4fcc1d8a-7934-4560-8b68-5c04fbc46d17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:06.252608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4fcc1d8a-7934-4560-8b68-5c04fbc46d17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:06.262309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4fcc1d8a-7934-4560-8b68-5c04fbc46d17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:06.263880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4fcc1d8a-7934-4560-8b68-5c04fbc46d17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:06.265067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4fcc1d8a-7934-4560-8b68-5c04fbc46d17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.165843 Sep 13 20:03:06.265664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 368/651] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:06 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:03:06.666036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7ef1e6b3-551c-4146-bdac-1d79201e049d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:06.666731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7ef1e6b3-551c-4146-bdac-1d79201e049d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:06.673481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7ef1e6b3-551c-4146-bdac-1d79201e049d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:06.673950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7ef1e6b3-551c-4146-bdac-1d79201e049d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:06.674412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7ef1e6b3-551c-4146-bdac-1d79201e049d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:06.675092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7ef1e6b3-551c-4146-bdac-1d79201e049d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:06.675536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7ef1e6b3-551c-4146-bdac-1d79201e049d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:06.675935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7ef1e6b3-551c-4146-bdac-1d79201e049d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:06.828468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7ef1e6b3-551c-4146-bdac-1d79201e049d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:06.837100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7ef1e6b3-551c-4146-bdac-1d79201e049d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.175100 Sep 13 20:03:06.837695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 369/652] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:06 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:07.291196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1b75abae-a8ea-44db-b447-bce910d3686c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:07.291929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1b75abae-a8ea-44db-b447-bce910d3686c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:07.299837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b75abae-a8ea-44db-b447-bce910d3686c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:07.300618 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b75abae-a8ea-44db-b447-bce910d3686c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:07.301278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b75abae-a8ea-44db-b447-bce910d3686c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:07.302437 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b75abae-a8ea-44db-b447-bce910d3686c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:07.303182 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b75abae-a8ea-44db-b447-bce910d3686c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:07.303731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b75abae-a8ea-44db-b447-bce910d3686c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:07.437830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1b75abae-a8ea-44db-b447-bce910d3686c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:07.447679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1b75abae-a8ea-44db-b447-bce910d3686c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:07.449620 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1b75abae-a8ea-44db-b447-bce910d3686c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:07.451046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1b75abae-a8ea-44db-b447-bce910d3686c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.164322 Sep 13 20:03:07.451711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 370/653] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:07.866615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2aeebad3-f7e2-4d22-917a-1964e358ca2e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:07.867346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2aeebad3-f7e2-4d22-917a-1964e358ca2e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:07.876027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2aeebad3-f7e2-4d22-917a-1964e358ca2e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:07.876514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2aeebad3-f7e2-4d22-917a-1964e358ca2e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:07.876942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2aeebad3-f7e2-4d22-917a-1964e358ca2e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:07.877681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2aeebad3-f7e2-4d22-917a-1964e358ca2e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:07.878203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2aeebad3-f7e2-4d22-917a-1964e358ca2e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:07.878651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2aeebad3-f7e2-4d22-917a-1964e358ca2e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:08.015477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2aeebad3-f7e2-4d22-917a-1964e358ca2e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:08.023461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2aeebad3-f7e2-4d22-917a-1964e358ca2e tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.160885 Sep 13 20:03:08.024053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 371/654] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:07 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:08.477444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1112c549-7084-4d67-a132-9552e9129b6d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:08.478169 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1112c549-7084-4d67-a132-9552e9129b6d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:08.484761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1112c549-7084-4d67-a132-9552e9129b6d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:08.485238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1112c549-7084-4d67-a132-9552e9129b6d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:08.485662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1112c549-7084-4d67-a132-9552e9129b6d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:08.486340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1112c549-7084-4d67-a132-9552e9129b6d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:08.486822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1112c549-7084-4d67-a132-9552e9129b6d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:08.487233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1112c549-7084-4d67-a132-9552e9129b6d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:08.632962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1112c549-7084-4d67-a132-9552e9129b6d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:08.643161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1112c549-7084-4d67-a132-9552e9129b6d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:08.644724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1112c549-7084-4d67-a132-9552e9129b6d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:08.645890 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1112c549-7084-4d67-a132-9552e9129b6d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.172505 Sep 13 20:03:08.646474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 372/655] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:09.046578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-59081f73-b04b-4120-baa7-3c36d6417d32 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:09.047209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-59081f73-b04b-4120-baa7-3c36d6417d32 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:09.053855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59081f73-b04b-4120-baa7-3c36d6417d32 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:09.054353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59081f73-b04b-4120-baa7-3c36d6417d32 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:09.054815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59081f73-b04b-4120-baa7-3c36d6417d32 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:09.055539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59081f73-b04b-4120-baa7-3c36d6417d32 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:09.055963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59081f73-b04b-4120-baa7-3c36d6417d32 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:09.056389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59081f73-b04b-4120-baa7-3c36d6417d32 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:09.199176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-59081f73-b04b-4120-baa7-3c36d6417d32 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:09.207884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-59081f73-b04b-4120-baa7-3c36d6417d32 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.165159 Sep 13 20:03:09.208489 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 373/656] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:09 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:09.625410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-69dfaa02-5b95-4d0f-ad1e-40a6c1e8b597 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:09.625896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-69dfaa02-5b95-4d0f-ad1e-40a6c1e8b597 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:09.632587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69dfaa02-5b95-4d0f-ad1e-40a6c1e8b597 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:09.633069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69dfaa02-5b95-4d0f-ad1e-40a6c1e8b597 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:09.633473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69dfaa02-5b95-4d0f-ad1e-40a6c1e8b597 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:09.634191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69dfaa02-5b95-4d0f-ad1e-40a6c1e8b597 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:09.634662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69dfaa02-5b95-4d0f-ad1e-40a6c1e8b597 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:09.635075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69dfaa02-5b95-4d0f-ad1e-40a6c1e8b597 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:09.720280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-69dfaa02-5b95-4d0f-ad1e-40a6c1e8b597 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lazy-loading 'services' on Instance uuid b6c34670-16a4-4b3b-9a8d-1d77974d355e {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:03:09.799037 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-69dfaa02-5b95-4d0f-ad1e-40a6c1e8b597 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments/a1729d40-4430-4f6d-bd52-1b779a1121b7" status: 202 len: 0 microversion: 2.1 time: 0.177468 Sep 13 20:03:09.799662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 374/657] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 13 20:03:09 2022] DELETE /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments/a1729d40-4430-4f6d-bd52-1b779a1121b7 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:03:09.804886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-77e69867-b61d-4fad-8686-ae9db683b073 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:09.805456 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-77e69867-b61d-4fad-8686-ae9db683b073 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:09.812168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77e69867-b61d-4fad-8686-ae9db683b073 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:09.812660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77e69867-b61d-4fad-8686-ae9db683b073 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:09.813116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77e69867-b61d-4fad-8686-ae9db683b073 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:09.813814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77e69867-b61d-4fad-8686-ae9db683b073 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:09.814265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77e69867-b61d-4fad-8686-ae9db683b073 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:09.814717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77e69867-b61d-4fad-8686-ae9db683b073 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:09.955310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-77e69867-b61d-4fad-8686-ae9db683b073 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:09.964293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-77e69867-b61d-4fad-8686-ae9db683b073 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:09.965801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-77e69867-b61d-4fad-8686-ae9db683b073 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:09.966988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-77e69867-b61d-4fad-8686-ae9db683b073 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.166255 Sep 13 20:03:09.967553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 375/658] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:10.231868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b01fc222-55c1-49bd-a4bc-4a9d1ec6c7ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:10.232556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b01fc222-55c1-49bd-a4bc-4a9d1ec6c7ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:10.239174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b01fc222-55c1-49bd-a4bc-4a9d1ec6c7ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:10.239644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b01fc222-55c1-49bd-a4bc-4a9d1ec6c7ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:10.240060 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b01fc222-55c1-49bd-a4bc-4a9d1ec6c7ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:10.240734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b01fc222-55c1-49bd-a4bc-4a9d1ec6c7ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:10.241170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b01fc222-55c1-49bd-a4bc-4a9d1ec6c7ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:10.241574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b01fc222-55c1-49bd-a4bc-4a9d1ec6c7ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:10.376021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b01fc222-55c1-49bd-a4bc-4a9d1ec6c7ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:10.381044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:10.388554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b01fc222-55c1-49bd-a4bc-4a9d1ec6c7ec tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.160899 Sep 13 20:03:10.389140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 376/659] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:10 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:10.991722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6b672f5a-d5ad-49bd-9206-3b7d1d9b1097 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:10.992449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6b672f5a-d5ad-49bd-9206-3b7d1d9b1097 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:10.999617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b672f5a-d5ad-49bd-9206-3b7d1d9b1097 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:11.000096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b672f5a-d5ad-49bd-9206-3b7d1d9b1097 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:11.000522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b672f5a-d5ad-49bd-9206-3b7d1d9b1097 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:11.001209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b672f5a-d5ad-49bd-9206-3b7d1d9b1097 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:11.001655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b672f5a-d5ad-49bd-9206-3b7d1d9b1097 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:11.002064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b672f5a-d5ad-49bd-9206-3b7d1d9b1097 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:11.142668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6b672f5a-d5ad-49bd-9206-3b7d1d9b1097 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:11.151687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6b672f5a-d5ad-49bd-9206-3b7d1d9b1097 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:11.153148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6b672f5a-d5ad-49bd-9206-3b7d1d9b1097 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:11.154307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6b672f5a-d5ad-49bd-9206-3b7d1d9b1097 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.166628 Sep 13 20:03:11.155084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 377/660] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:11.419354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-639cc13f-efd1-4234-8da1-f59642474c7f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:11.420290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-639cc13f-efd1-4234-8da1-f59642474c7f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:11.429519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-639cc13f-efd1-4234-8da1-f59642474c7f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:11.430391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-639cc13f-efd1-4234-8da1-f59642474c7f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:11.430946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-639cc13f-efd1-4234-8da1-f59642474c7f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:11.431954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-639cc13f-efd1-4234-8da1-f59642474c7f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:11.432592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-639cc13f-efd1-4234-8da1-f59642474c7f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:11.433248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-639cc13f-efd1-4234-8da1-f59642474c7f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:11.574788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-639cc13f-efd1-4234-8da1-f59642474c7f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:11.583302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-639cc13f-efd1-4234-8da1-f59642474c7f tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.170149 Sep 13 20:03:11.583898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 378/661] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:11 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:12.180534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-45c28017-51a1-4de5-b0d8-9f25d2731d8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:12.181287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-45c28017-51a1-4de5-b0d8-9f25d2731d8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:12.187820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45c28017-51a1-4de5-b0d8-9f25d2731d8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:12.188281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45c28017-51a1-4de5-b0d8-9f25d2731d8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:12.188726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45c28017-51a1-4de5-b0d8-9f25d2731d8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:12.189410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45c28017-51a1-4de5-b0d8-9f25d2731d8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:12.189857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45c28017-51a1-4de5-b0d8-9f25d2731d8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:12.190488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45c28017-51a1-4de5-b0d8-9f25d2731d8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:12.456916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-45c28017-51a1-4de5-b0d8-9f25d2731d8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:12.469337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-45c28017-51a1-4de5-b0d8-9f25d2731d8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:12.471205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-45c28017-51a1-4de5-b0d8-9f25d2731d8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:12.472802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-45c28017-51a1-4de5-b0d8-9f25d2731d8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.296130 Sep 13 20:03:12.473580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 379/662] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:12.607598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-646dc0c8-1e06-4032-8006-9a782ac2d522 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:12.608258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-646dc0c8-1e06-4032-8006-9a782ac2d522 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:12.614860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-646dc0c8-1e06-4032-8006-9a782ac2d522 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:12.615339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-646dc0c8-1e06-4032-8006-9a782ac2d522 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:12.615751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-646dc0c8-1e06-4032-8006-9a782ac2d522 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:12.616429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-646dc0c8-1e06-4032-8006-9a782ac2d522 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:12.616880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-646dc0c8-1e06-4032-8006-9a782ac2d522 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:12.617289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-646dc0c8-1e06-4032-8006-9a782ac2d522 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:12.762711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-646dc0c8-1e06-4032-8006-9a782ac2d522 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:12.773617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-646dc0c8-1e06-4032-8006-9a782ac2d522 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.170245 Sep 13 20:03:12.774408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 380/663] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:12 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:13.501213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-17d5ac6f-b650-47c5-a99d-d4833611b597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:13.501875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-17d5ac6f-b650-47c5-a99d-d4833611b597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:13.508147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d5ac6f-b650-47c5-a99d-d4833611b597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:13.508619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d5ac6f-b650-47c5-a99d-d4833611b597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:13.509057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d5ac6f-b650-47c5-a99d-d4833611b597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:13.509870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d5ac6f-b650-47c5-a99d-d4833611b597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:13.510199 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d5ac6f-b650-47c5-a99d-d4833611b597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:13.510649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d5ac6f-b650-47c5-a99d-d4833611b597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:13.650902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17d5ac6f-b650-47c5-a99d-d4833611b597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:13.661077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17d5ac6f-b650-47c5-a99d-d4833611b597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:13.662560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17d5ac6f-b650-47c5-a99d-d4833611b597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:13.663750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-17d5ac6f-b650-47c5-a99d-d4833611b597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.166800 Sep 13 20:03:13.664314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 381/664] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:03:13.797746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3a22da0e-0304-453f-a8d4-712b942a89a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:13.798262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3a22da0e-0304-453f-a8d4-712b942a89a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:13.804849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3a22da0e-0304-453f-a8d4-712b942a89a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:13.805335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3a22da0e-0304-453f-a8d4-712b942a89a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:13.805775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3a22da0e-0304-453f-a8d4-712b942a89a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:13.806483 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3a22da0e-0304-453f-a8d4-712b942a89a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:13.806924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3a22da0e-0304-453f-a8d4-712b942a89a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:13.807341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3a22da0e-0304-453f-a8d4-712b942a89a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:13.953016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3a22da0e-0304-453f-a8d4-712b942a89a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:13.961539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3a22da0e-0304-453f-a8d4-712b942a89a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.167708 Sep 13 20:03:13.962310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 382/665] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:13 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:14.689509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-318eb8c6-3c99-492e-b94c-842df06266ce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:14.690226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-318eb8c6-3c99-492e-b94c-842df06266ce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:14.697509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-318eb8c6-3c99-492e-b94c-842df06266ce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:14.697988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-318eb8c6-3c99-492e-b94c-842df06266ce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:14.698514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-318eb8c6-3c99-492e-b94c-842df06266ce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:14.699211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-318eb8c6-3c99-492e-b94c-842df06266ce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:14.699752 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-318eb8c6-3c99-492e-b94c-842df06266ce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:14.700168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-318eb8c6-3c99-492e-b94c-842df06266ce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:14.846063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-318eb8c6-3c99-492e-b94c-842df06266ce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:14.855371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-318eb8c6-3c99-492e-b94c-842df06266ce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:14.856983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-318eb8c6-3c99-492e-b94c-842df06266ce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:14.858207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-318eb8c6-3c99-492e-b94c-842df06266ce tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.172765 Sep 13 20:03:14.858801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 383/666] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:14.989582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-82a5d80b-52ed-4572-955b-127a3026b5d7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:14.990258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-82a5d80b-52ed-4572-955b-127a3026b5d7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:14.996801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82a5d80b-52ed-4572-955b-127a3026b5d7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:14.997289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82a5d80b-52ed-4572-955b-127a3026b5d7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:14.997720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82a5d80b-52ed-4572-955b-127a3026b5d7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:14.998772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82a5d80b-52ed-4572-955b-127a3026b5d7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:14.998894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82a5d80b-52ed-4572-955b-127a3026b5d7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:14.999284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82a5d80b-52ed-4572-955b-127a3026b5d7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:15.144228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-82a5d80b-52ed-4572-955b-127a3026b5d7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:15.153878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-82a5d80b-52ed-4572-955b-127a3026b5d7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.168361 Sep 13 20:03:15.154502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 384/667] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:14 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:15.887734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-22bdb616-f401-498b-ae29-9fb8e10d3117 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:15.888448 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-22bdb616-f401-498b-ae29-9fb8e10d3117 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:15.896200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-22bdb616-f401-498b-ae29-9fb8e10d3117 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:15.896684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-22bdb616-f401-498b-ae29-9fb8e10d3117 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:15.897113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-22bdb616-f401-498b-ae29-9fb8e10d3117 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:15.897841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-22bdb616-f401-498b-ae29-9fb8e10d3117 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:15.898289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-22bdb616-f401-498b-ae29-9fb8e10d3117 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:15.898744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-22bdb616-f401-498b-ae29-9fb8e10d3117 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:16.033773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-22bdb616-f401-498b-ae29-9fb8e10d3117 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:16.044022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-22bdb616-f401-498b-ae29-9fb8e10d3117 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:16.045405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-22bdb616-f401-498b-ae29-9fb8e10d3117 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:16.046615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-22bdb616-f401-498b-ae29-9fb8e10d3117 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.162931 Sep 13 20:03:16.047195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 385/668] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:03:16.177466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-29399979-a0e8-4760-830e-170473ed5d44 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:16.178002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-29399979-a0e8-4760-830e-170473ed5d44 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:16.184520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29399979-a0e8-4760-830e-170473ed5d44 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:16.185004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29399979-a0e8-4760-830e-170473ed5d44 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:16.185431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29399979-a0e8-4760-830e-170473ed5d44 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:16.186137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29399979-a0e8-4760-830e-170473ed5d44 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:16.186612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29399979-a0e8-4760-830e-170473ed5d44 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:16.187031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29399979-a0e8-4760-830e-170473ed5d44 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:16.352767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-29399979-a0e8-4760-830e-170473ed5d44 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:16.360901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-29399979-a0e8-4760-830e-170473ed5d44 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.187358 Sep 13 20:03:16.361482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 386/669] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:16 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:17.072881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ad56aa92-d31d-429d-82af-31f6d2c59c2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:17.073606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ad56aa92-d31d-429d-82af-31f6d2c59c2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:17.080952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad56aa92-d31d-429d-82af-31f6d2c59c2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.081412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad56aa92-d31d-429d-82af-31f6d2c59c2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.081845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad56aa92-d31d-429d-82af-31f6d2c59c2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.082575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad56aa92-d31d-429d-82af-31f6d2c59c2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.083018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad56aa92-d31d-429d-82af-31f6d2c59c2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.083422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad56aa92-d31d-429d-82af-31f6d2c59c2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.226269 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ad56aa92-d31d-429d-82af-31f6d2c59c2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:17.236133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ad56aa92-d31d-429d-82af-31f6d2c59c2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:17.237545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ad56aa92-d31d-429d-82af-31f6d2c59c2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:17.238780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ad56aa92-d31d-429d-82af-31f6d2c59c2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.169888 Sep 13 20:03:17.239351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 387/670] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:17 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:17.385577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-aa0edfbe-4220-4872-acdd-8ca3960254a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:17.386404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-aa0edfbe-4220-4872-acdd-8ca3960254a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:17.393446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa0edfbe-4220-4872-acdd-8ca3960254a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.393948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa0edfbe-4220-4872-acdd-8ca3960254a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.394396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa0edfbe-4220-4872-acdd-8ca3960254a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.395134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa0edfbe-4220-4872-acdd-8ca3960254a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.395587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa0edfbe-4220-4872-acdd-8ca3960254a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.396002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa0edfbe-4220-4872-acdd-8ca3960254a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.555443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-aa0edfbe-4220-4872-acdd-8ca3960254a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:17.563538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-aa0edfbe-4220-4872-acdd-8ca3960254a1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.182609 Sep 13 20:03:17.564431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 388/671] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:17 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:18.267548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fe198f68-14ad-45d9-aa7f-d222e8976621 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:18.268222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fe198f68-14ad-45d9-aa7f-d222e8976621 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:18.271355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:18.277834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe198f68-14ad-45d9-aa7f-d222e8976621 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:18.278320 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe198f68-14ad-45d9-aa7f-d222e8976621 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:18.278882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe198f68-14ad-45d9-aa7f-d222e8976621 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:18.281038 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe198f68-14ad-45d9-aa7f-d222e8976621 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:18.281038 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe198f68-14ad-45d9-aa7f-d222e8976621 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:18.281038 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe198f68-14ad-45d9-aa7f-d222e8976621 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:18.430999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fe198f68-14ad-45d9-aa7f-d222e8976621 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:18.440298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fe198f68-14ad-45d9-aa7f-d222e8976621 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:18.441777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fe198f68-14ad-45d9-aa7f-d222e8976621 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:18.442956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fe198f68-14ad-45d9-aa7f-d222e8976621 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.179943 Sep 13 20:03:18.443535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 389/672] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:03:18.587597 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-873c4f7e-242f-4c0d-9ebb-e2b416c42aff tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:18.588213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-873c4f7e-242f-4c0d-9ebb-e2b416c42aff tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:18.594983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-873c4f7e-242f-4c0d-9ebb-e2b416c42aff tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:18.595465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-873c4f7e-242f-4c0d-9ebb-e2b416c42aff tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:18.595890 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-873c4f7e-242f-4c0d-9ebb-e2b416c42aff tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:18.596587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-873c4f7e-242f-4c0d-9ebb-e2b416c42aff tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:18.597029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-873c4f7e-242f-4c0d-9ebb-e2b416c42aff tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:18.597447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-873c4f7e-242f-4c0d-9ebb-e2b416c42aff tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:18.732381 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-873c4f7e-242f-4c0d-9ebb-e2b416c42aff tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:18.744349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-873c4f7e-242f-4c0d-9ebb-e2b416c42aff tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.160387 Sep 13 20:03:18.745119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 390/673] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:18 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:19.471947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6f98778b-2459-4a67-8217-39f304572814 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:19.472606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6f98778b-2459-4a67-8217-39f304572814 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:19.482067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6f98778b-2459-4a67-8217-39f304572814 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:19.482671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6f98778b-2459-4a67-8217-39f304572814 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:19.483251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6f98778b-2459-4a67-8217-39f304572814 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:19.484175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6f98778b-2459-4a67-8217-39f304572814 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:19.484629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6f98778b-2459-4a67-8217-39f304572814 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:19.485051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6f98778b-2459-4a67-8217-39f304572814 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:19.621985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6f98778b-2459-4a67-8217-39f304572814 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:19.632106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6f98778b-2459-4a67-8217-39f304572814 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:19.633658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6f98778b-2459-4a67-8217-39f304572814 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:19.634922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6f98778b-2459-4a67-8217-39f304572814 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.169384 Sep 13 20:03:19.635470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 391/674] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:19.771965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0a8044a9-8439-4e41-8253-391367014c06 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:19.772774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0a8044a9-8439-4e41-8253-391367014c06 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:19.780574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a8044a9-8439-4e41-8253-391367014c06 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:19.781179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a8044a9-8439-4e41-8253-391367014c06 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:19.781715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a8044a9-8439-4e41-8253-391367014c06 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:19.782670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a8044a9-8439-4e41-8253-391367014c06 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:19.783225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a8044a9-8439-4e41-8253-391367014c06 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:19.783754 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a8044a9-8439-4e41-8253-391367014c06 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:19.926757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0a8044a9-8439-4e41-8253-391367014c06 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:19.935297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0a8044a9-8439-4e41-8253-391367014c06 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.168118 Sep 13 20:03:19.935885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 392/675] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:19 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:20.662434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d915dcc3-8e98-4c11-bbff-35deb4aa610f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:20.663128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d915dcc3-8e98-4c11-bbff-35deb4aa610f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:20.671903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d915dcc3-8e98-4c11-bbff-35deb4aa610f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:20.672377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d915dcc3-8e98-4c11-bbff-35deb4aa610f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:20.672811 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d915dcc3-8e98-4c11-bbff-35deb4aa610f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:20.673508 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d915dcc3-8e98-4c11-bbff-35deb4aa610f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:20.673961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d915dcc3-8e98-4c11-bbff-35deb4aa610f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:20.674356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d915dcc3-8e98-4c11-bbff-35deb4aa610f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:20.693426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:20.806737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d915dcc3-8e98-4c11-bbff-35deb4aa610f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:20.815867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d915dcc3-8e98-4c11-bbff-35deb4aa610f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:20.817283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d915dcc3-8e98-4c11-bbff-35deb4aa610f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:20.818494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d915dcc3-8e98-4c11-bbff-35deb4aa610f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.162506 Sep 13 20:03:20.819058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 393/676] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:03:20.962711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e02b4a07-da7f-4edb-b3ec-835d60625d99 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:20.963610 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e02b4a07-da7f-4edb-b3ec-835d60625d99 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:20.970293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e02b4a07-da7f-4edb-b3ec-835d60625d99 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:20.970806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e02b4a07-da7f-4edb-b3ec-835d60625d99 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:20.971229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e02b4a07-da7f-4edb-b3ec-835d60625d99 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:20.971905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e02b4a07-da7f-4edb-b3ec-835d60625d99 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:20.972339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e02b4a07-da7f-4edb-b3ec-835d60625d99 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:20.972748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e02b4a07-da7f-4edb-b3ec-835d60625d99 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:21.112721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e02b4a07-da7f-4edb-b3ec-835d60625d99 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:21.124322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e02b4a07-da7f-4edb-b3ec-835d60625d99 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.167118 Sep 13 20:03:21.124952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 394/677] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:20 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:21.847551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ed06245d-290b-4304-8a8a-5038b34feae5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:21.848641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ed06245d-290b-4304-8a8a-5038b34feae5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:21.857607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed06245d-290b-4304-8a8a-5038b34feae5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:21.858090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed06245d-290b-4304-8a8a-5038b34feae5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:21.858550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed06245d-290b-4304-8a8a-5038b34feae5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:21.859246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed06245d-290b-4304-8a8a-5038b34feae5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:21.859688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed06245d-290b-4304-8a8a-5038b34feae5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:21.860100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed06245d-290b-4304-8a8a-5038b34feae5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:22.024425 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ed06245d-290b-4304-8a8a-5038b34feae5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:22.035891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ed06245d-290b-4304-8a8a-5038b34feae5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:22.037350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ed06245d-290b-4304-8a8a-5038b34feae5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:22.039157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ed06245d-290b-4304-8a8a-5038b34feae5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.197786 Sep 13 20:03:22.040178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 395/678] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:22.148310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b778e559-a365-469a-a418-81b1743f5266 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:22.148821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b778e559-a365-469a-a418-81b1743f5266 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:22.155661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b778e559-a365-469a-a418-81b1743f5266 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:22.156149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b778e559-a365-469a-a418-81b1743f5266 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:22.156575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b778e559-a365-469a-a418-81b1743f5266 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:22.157262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b778e559-a365-469a-a418-81b1743f5266 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:22.157715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b778e559-a365-469a-a418-81b1743f5266 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:22.158111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b778e559-a365-469a-a418-81b1743f5266 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:22.300804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b778e559-a365-469a-a418-81b1743f5266 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:22.308922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b778e559-a365-469a-a418-81b1743f5266 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.164597 Sep 13 20:03:22.309529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 396/679] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:22 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:23.069988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ae5361da-5124-4881-80d8-ff20444e4afe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:23.070745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ae5361da-5124-4881-80d8-ff20444e4afe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:23.078787 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae5361da-5124-4881-80d8-ff20444e4afe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:23.079468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae5361da-5124-4881-80d8-ff20444e4afe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:23.080157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae5361da-5124-4881-80d8-ff20444e4afe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:23.080943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae5361da-5124-4881-80d8-ff20444e4afe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:23.081607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae5361da-5124-4881-80d8-ff20444e4afe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:23.082174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae5361da-5124-4881-80d8-ff20444e4afe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:23.154177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b1380fd0-0f9a-4805-8f33-081c00f61dba tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "POST /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 34.090876 Sep 13 20:03:23.154922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 284/680] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 13 20:02:49 2022] POST /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c/os-volume_attachments => generated 194 bytes in 34093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:03:23.226435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ae5361da-5124-4881-80d8-ff20444e4afe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:23.235302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ae5361da-5124-4881-80d8-ff20444e4afe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:23.236813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ae5361da-5124-4881-80d8-ff20444e4afe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:23.237965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ae5361da-5124-4881-80d8-ff20444e4afe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.172996 Sep 13 20:03:23.238539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 397/681] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:23 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:03:23.336946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b17fe073-9c92-49d9-b6b9-d7edc76c0512 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:23.337631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b17fe073-9c92-49d9-b6b9-d7edc76c0512 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:23.344934 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b17fe073-9c92-49d9-b6b9-d7edc76c0512 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:23.345420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b17fe073-9c92-49d9-b6b9-d7edc76c0512 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:23.345843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b17fe073-9c92-49d9-b6b9-d7edc76c0512 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:23.346584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b17fe073-9c92-49d9-b6b9-d7edc76c0512 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:23.347029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b17fe073-9c92-49d9-b6b9-d7edc76c0512 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:23.347447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b17fe073-9c92-49d9-b6b9-d7edc76c0512 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:23.497625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b17fe073-9c92-49d9-b6b9-d7edc76c0512 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:23.506283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b17fe073-9c92-49d9-b6b9-d7edc76c0512 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.176149 Sep 13 20:03:23.506892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 285/682] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:23 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:24.263857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ded8827e-f0d2-4dab-8569-fd63f191ae0b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:24.264491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ded8827e-f0d2-4dab-8569-fd63f191ae0b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:24.271328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ded8827e-f0d2-4dab-8569-fd63f191ae0b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:24.271813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ded8827e-f0d2-4dab-8569-fd63f191ae0b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:24.272242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ded8827e-f0d2-4dab-8569-fd63f191ae0b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:24.272935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ded8827e-f0d2-4dab-8569-fd63f191ae0b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:24.273673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ded8827e-f0d2-4dab-8569-fd63f191ae0b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:24.273780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ded8827e-f0d2-4dab-8569-fd63f191ae0b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:24.406761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ded8827e-f0d2-4dab-8569-fd63f191ae0b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:24.419094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ded8827e-f0d2-4dab-8569-fd63f191ae0b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:24.421241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ded8827e-f0d2-4dab-8569-fd63f191ae0b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:24.422445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ded8827e-f0d2-4dab-8569-fd63f191ae0b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.162734 Sep 13 20:03:24.423018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 398/683] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:24.532770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8cf7c676-0602-4cee-aa91-8c32b3d61bb0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:24.533407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8cf7c676-0602-4cee-aa91-8c32b3d61bb0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:24.543203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8cf7c676-0602-4cee-aa91-8c32b3d61bb0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:24.543896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8cf7c676-0602-4cee-aa91-8c32b3d61bb0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:24.544495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8cf7c676-0602-4cee-aa91-8c32b3d61bb0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:24.545469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8cf7c676-0602-4cee-aa91-8c32b3d61bb0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:24.546078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8cf7c676-0602-4cee-aa91-8c32b3d61bb0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:24.546540 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8cf7c676-0602-4cee-aa91-8c32b3d61bb0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:24.683488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8cf7c676-0602-4cee-aa91-8c32b3d61bb0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:24.691583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8cf7c676-0602-4cee-aa91-8c32b3d61bb0 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1358 microversion: 2.1 time: 0.164619 Sep 13 20:03:24.692146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 286/684] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:24 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:25.449752 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-281b799c-e3d7-4089-b02d-c8f39066a7b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:25.450496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-281b799c-e3d7-4089-b02d-c8f39066a7b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:25.457676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-281b799c-e3d7-4089-b02d-c8f39066a7b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:25.458167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-281b799c-e3d7-4089-b02d-c8f39066a7b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:25.458648 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-281b799c-e3d7-4089-b02d-c8f39066a7b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:25.459377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-281b799c-e3d7-4089-b02d-c8f39066a7b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:25.459829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-281b799c-e3d7-4089-b02d-c8f39066a7b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:25.460322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-281b799c-e3d7-4089-b02d-c8f39066a7b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:25.632220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-281b799c-e3d7-4089-b02d-c8f39066a7b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:25.645838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-281b799c-e3d7-4089-b02d-c8f39066a7b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:25.649008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-281b799c-e3d7-4089-b02d-c8f39066a7b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:25.651273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-281b799c-e3d7-4089-b02d-c8f39066a7b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.205220 Sep 13 20:03:25.652536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 399/685] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:25.717763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-3e2e2308-61d7-4dab-9094-686d78e411ab req-a59617a3-affe-445b-b68b-2de9f7aea647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0decb4-2f46-4f2f-860f-e8ca277f7080", "name": "network-vif-plugged", "status": "completed", "tag": "2f770f4f-2f9f-4723-a236-5204e36adea7"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:03:25.718049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7cc319b4-190f-4df8-a57e-611ae7ea0d1c tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:25.718839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7cc319b4-190f-4df8-a57e-611ae7ea0d1c tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:25.729320 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cc319b4-190f-4df8-a57e-611ae7ea0d1c tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:25.730195 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cc319b4-190f-4df8-a57e-611ae7ea0d1c tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:25.730935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cc319b4-190f-4df8-a57e-611ae7ea0d1c tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:25.731930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cc319b4-190f-4df8-a57e-611ae7ea0d1c tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:25.732239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-3e2e2308-61d7-4dab-9094-686d78e411ab req-a59617a3-affe-445b-b68b-2de9f7aea647 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:25.732729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-3e2e2308-61d7-4dab-9094-686d78e411ab req-a59617a3-affe-445b-b68b-2de9f7aea647 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:25.733221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cc319b4-190f-4df8-a57e-611ae7ea0d1c tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:25.733336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-3e2e2308-61d7-4dab-9094-686d78e411ab req-a59617a3-affe-445b-b68b-2de9f7aea647 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:25.734010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cc319b4-190f-4df8-a57e-611ae7ea0d1c tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:25.748920 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-3e2e2308-61d7-4dab-9094-686d78e411ab req-a59617a3-affe-445b-b68b-2de9f7aea647 service nova] Creating event network-vif-plugged:2f770f4f-2f9f-4723-a236-5204e36adea7 for instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 on hv-cinder-85427 Sep 13 20:03:25.755799 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-3e2e2308-61d7-4dab-9094-686d78e411ab req-a59617a3-affe-445b-b68b-2de9f7aea647 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042144 Sep 13 20:03:25.757484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 400/686] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:03:26.142919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7cc319b4-190f-4df8-a57e-611ae7ea0d1c tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:26.153870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7cc319b4-190f-4df8-a57e-611ae7ea0d1c tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1548 microversion: 2.1 time: 0.442046 Sep 13 20:03:26.154483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 287/687] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:25 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1548 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:26.179040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f82677e6-85ed-471f-aa36-bc309fab1491 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:26.179740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f82677e6-85ed-471f-aa36-bc309fab1491 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:26.186637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f82677e6-85ed-471f-aa36-bc309fab1491 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:26.187126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f82677e6-85ed-471f-aa36-bc309fab1491 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:26.187548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f82677e6-85ed-471f-aa36-bc309fab1491 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:26.188252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f82677e6-85ed-471f-aa36-bc309fab1491 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:26.188782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f82677e6-85ed-471f-aa36-bc309fab1491 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:26.189101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f82677e6-85ed-471f-aa36-bc309fab1491 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:26.340316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f82677e6-85ed-471f-aa36-bc309fab1491 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:26.348983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f82677e6-85ed-471f-aa36-bc309fab1491 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1548 microversion: 2.1 time: 0.174047 Sep 13 20:03:26.350279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 401/688] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:26 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1548 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:26.372096 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a9a456a9-5cb1-4ea5-90de-df506a076e0d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:26.377917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a9a456a9-5cb1-4ea5-90de-df506a076e0d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:26.378763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a9a456a9-5cb1-4ea5-90de-df506a076e0d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Searching by: {'deleted': False, 'project_id': 'c401b957669e43bdabf08fa232b461be'} {{(pid=120845) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 20:03:26.386107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9a456a9-5cb1-4ea5-90de-df506a076e0d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:26.386634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9a456a9-5cb1-4ea5-90de-df506a076e0d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:26.387107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9a456a9-5cb1-4ea5-90de-df506a076e0d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:26.387870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9a456a9-5cb1-4ea5-90de-df506a076e0d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:26.388322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9a456a9-5cb1-4ea5-90de-df506a076e0d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:26.388732 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9a456a9-5cb1-4ea5-90de-df506a076e0d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:26.486960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.multi_cell_list [None req-a9a456a9-5cb1-4ea5-90de-df506a076e0d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120845) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 20:03:26.587745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a9a456a9-5cb1-4ea5-90de-df506a076e0d tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.219681 Sep 13 20:03:26.588227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 288/689] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 13 20:03:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:03:26.600267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-aef56b13-ffa9-404d-a679-cecc82b0e4e7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:26.600909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-aef56b13-ffa9-404d-a679-cecc82b0e4e7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:26.607882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aef56b13-ffa9-404d-a679-cecc82b0e4e7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:26.608435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aef56b13-ffa9-404d-a679-cecc82b0e4e7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:26.608869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aef56b13-ffa9-404d-a679-cecc82b0e4e7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:26.609564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aef56b13-ffa9-404d-a679-cecc82b0e4e7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:26.610010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aef56b13-ffa9-404d-a679-cecc82b0e4e7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:26.610455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aef56b13-ffa9-404d-a679-cecc82b0e4e7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:26.685816 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9f403a8f-90d3-4a11-8249-d7993018391d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:26.686635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9f403a8f-90d3-4a11-8249-d7993018391d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:26.693920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f403a8f-90d3-4a11-8249-d7993018391d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:26.694444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f403a8f-90d3-4a11-8249-d7993018391d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:26.695331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f403a8f-90d3-4a11-8249-d7993018391d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:26.695587 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f403a8f-90d3-4a11-8249-d7993018391d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:26.696077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f403a8f-90d3-4a11-8249-d7993018391d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:26.696644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f403a8f-90d3-4a11-8249-d7993018391d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:26.761499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-aef56b13-ffa9-404d-a679-cecc82b0e4e7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:26.769919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-aef56b13-ffa9-404d-a679-cecc82b0e4e7 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1548 microversion: 2.1 time: 0.173512 Sep 13 20:03:26.770546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 402/690] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:26 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:26.959710 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9f403a8f-90d3-4a11-8249-d7993018391d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:26.973607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9f403a8f-90d3-4a11-8249-d7993018391d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:26.975110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9f403a8f-90d3-4a11-8249-d7993018391d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:26.976246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9f403a8f-90d3-4a11-8249-d7993018391d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.297501 Sep 13 20:03:26.976809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 289/691] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:28.011551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b45409e2-ca45-43bb-a109-e16657037c6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:28.012305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b45409e2-ca45-43bb-a109-e16657037c6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:28.020398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b45409e2-ca45-43bb-a109-e16657037c6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:28.020772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b45409e2-ca45-43bb-a109-e16657037c6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:28.021286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b45409e2-ca45-43bb-a109-e16657037c6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:28.021993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b45409e2-ca45-43bb-a109-e16657037c6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:28.022427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b45409e2-ca45-43bb-a109-e16657037c6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:28.022868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b45409e2-ca45-43bb-a109-e16657037c6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:28.168570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b45409e2-ca45-43bb-a109-e16657037c6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:28.179568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b45409e2-ca45-43bb-a109-e16657037c6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:28.180868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b45409e2-ca45-43bb-a109-e16657037c6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:28.185186 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b45409e2-ca45-43bb-a109-e16657037c6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1809 microversion: 2.20 time: 0.175290 Sep 13 20:03:28.185186 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 403/692] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:03:29.213474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5b7c4e23-e0a7-41d5-9899-f00e62d1c914 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:29.214246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5b7c4e23-e0a7-41d5-9899-f00e62d1c914 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:29.221455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5b7c4e23-e0a7-41d5-9899-f00e62d1c914 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:29.221969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5b7c4e23-e0a7-41d5-9899-f00e62d1c914 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:29.222392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5b7c4e23-e0a7-41d5-9899-f00e62d1c914 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:29.223111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5b7c4e23-e0a7-41d5-9899-f00e62d1c914 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:29.223548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5b7c4e23-e0a7-41d5-9899-f00e62d1c914 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:29.223971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5b7c4e23-e0a7-41d5-9899-f00e62d1c914 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:29.370474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5b7c4e23-e0a7-41d5-9899-f00e62d1c914 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:29.379411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5b7c4e23-e0a7-41d5-9899-f00e62d1c914 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:29.380849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5b7c4e23-e0a7-41d5-9899-f00e62d1c914 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:29.381999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5b7c4e23-e0a7-41d5-9899-f00e62d1c914 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1796 microversion: 2.20 time: 0.172684 Sep 13 20:03:29.382620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 290/693] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:03:29 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1796 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:04:06.002862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ed3fca28-8757-4832-8794-3183985f1032 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:06.003501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ed3fca28-8757-4832-8794-3183985f1032 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:06.006484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=29 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:06.007144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=58 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:06.025109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed3fca28-8757-4832-8794-3183985f1032 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:06.025497 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed3fca28-8757-4832-8794-3183985f1032 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:06.025921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed3fca28-8757-4832-8794-3183985f1032 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:06.026647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed3fca28-8757-4832-8794-3183985f1032 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:06.027082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed3fca28-8757-4832-8794-3183985f1032 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:06.027513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ed3fca28-8757-4832-8794-3183985f1032 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:06.058525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ed3fca28-8757-4832-8794-3183985f1032 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments/3e514984-a60e-407a-8233-0eb8249e5918" status: 200 len: 194 microversion: 2.20 time: 0.061410 Sep 13 20:04:06.059124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 404/694] 10.222.0.52 () {60 vars in 1454 bytes} [Tue Sep 13 20:04:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments/3e514984-a60e-407a-8233-0eb8249e5918 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:06.130362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-89f50e5f-8f8d-4f31-915b-5e3995045ea7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:06.130987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-89f50e5f-8f8d-4f31-915b-5e3995045ea7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:06.133657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:06.134534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=12 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:06.135159 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:06.142288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89f50e5f-8f8d-4f31-915b-5e3995045ea7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:06.142795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89f50e5f-8f8d-4f31-915b-5e3995045ea7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:06.143225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89f50e5f-8f8d-4f31-915b-5e3995045ea7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:06.143912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89f50e5f-8f8d-4f31-915b-5e3995045ea7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:06.144351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89f50e5f-8f8d-4f31-915b-5e3995045ea7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:06.144761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-89f50e5f-8f8d-4f31-915b-5e3995045ea7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:06.275098 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.objects.instance [None req-89f50e5f-8f8d-4f31-915b-5e3995045ea7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lazy-loading 'services' on Instance uuid 8d0decb4-2f46-4f2f-860f-e8ca277f7080 {{(pid=120845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:04:06.402127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-89f50e5f-8f8d-4f31-915b-5e3995045ea7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments/3e514984-a60e-407a-8233-0eb8249e5918" status: 202 len: 0 microversion: 2.20 time: 0.275489 Sep 13 20:04:06.403427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 291/695] 10.222.0.52 () {60 vars in 1457 bytes} [Tue Sep 13 20:04:06 2022] DELETE /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments/3e514984-a60e-407a-8233-0eb8249e5918 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:04:06.412271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d579bde5-08aa-47f5-a9c6-e0cea8bcf149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:06.414577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d579bde5-08aa-47f5-a9c6-e0cea8bcf149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:06.421184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d579bde5-08aa-47f5-a9c6-e0cea8bcf149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:06.421671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d579bde5-08aa-47f5-a9c6-e0cea8bcf149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:06.422213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d579bde5-08aa-47f5-a9c6-e0cea8bcf149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:06.423012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d579bde5-08aa-47f5-a9c6-e0cea8bcf149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:06.423613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d579bde5-08aa-47f5-a9c6-e0cea8bcf149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:06.424017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d579bde5-08aa-47f5-a9c6-e0cea8bcf149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:06.458131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d579bde5-08aa-47f5-a9c6-e0cea8bcf149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049992 Sep 13 20:04:06.458759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 405/696] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:06 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:07.472855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c66b86ef-c446-4053-90a6-7aecca42c57a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:07.475355 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c66b86ef-c446-4053-90a6-7aecca42c57a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:07.483312 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c66b86ef-c446-4053-90a6-7aecca42c57a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:07.483820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c66b86ef-c446-4053-90a6-7aecca42c57a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:07.484276 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c66b86ef-c446-4053-90a6-7aecca42c57a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:07.484998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c66b86ef-c446-4053-90a6-7aecca42c57a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:07.485467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c66b86ef-c446-4053-90a6-7aecca42c57a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:07.485905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c66b86ef-c446-4053-90a6-7aecca42c57a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:07.516047 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c66b86ef-c446-4053-90a6-7aecca42c57a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047860 Sep 13 20:04:07.516590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 292/697] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:08.532477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9577d2d6-6ed7-404a-a778-d18f6181a742 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:08.535365 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9577d2d6-6ed7-404a-a778-d18f6181a742 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:08.542493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9577d2d6-6ed7-404a-a778-d18f6181a742 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:08.542949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9577d2d6-6ed7-404a-a778-d18f6181a742 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:08.543412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9577d2d6-6ed7-404a-a778-d18f6181a742 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:08.544116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9577d2d6-6ed7-404a-a778-d18f6181a742 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:08.544585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9577d2d6-6ed7-404a-a778-d18f6181a742 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:08.545004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9577d2d6-6ed7-404a-a778-d18f6181a742 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:08.576119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9577d2d6-6ed7-404a-a778-d18f6181a742 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049775 Sep 13 20:04:08.576692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 406/698] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:09.589852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-860a4d91-94fc-4b08-9ba4-5e97c324d2ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:09.592085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-860a4d91-94fc-4b08-9ba4-5e97c324d2ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:09.598949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-860a4d91-94fc-4b08-9ba4-5e97c324d2ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:09.599425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-860a4d91-94fc-4b08-9ba4-5e97c324d2ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:09.599848 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-860a4d91-94fc-4b08-9ba4-5e97c324d2ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:09.600530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-860a4d91-94fc-4b08-9ba4-5e97c324d2ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:09.600963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-860a4d91-94fc-4b08-9ba4-5e97c324d2ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:09.601373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-860a4d91-94fc-4b08-9ba4-5e97c324d2ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:09.631272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-860a4d91-94fc-4b08-9ba4-5e97c324d2ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045349 Sep 13 20:04:09.631837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 293/699] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:10.644371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1932307e-11a1-4b0f-bc10-3355336a1915 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:10.646641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1932307e-11a1-4b0f-bc10-3355336a1915 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:10.653797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1932307e-11a1-4b0f-bc10-3355336a1915 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:10.654344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1932307e-11a1-4b0f-bc10-3355336a1915 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:10.654971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1932307e-11a1-4b0f-bc10-3355336a1915 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:10.655808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1932307e-11a1-4b0f-bc10-3355336a1915 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:10.656260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1932307e-11a1-4b0f-bc10-3355336a1915 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:10.656688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1932307e-11a1-4b0f-bc10-3355336a1915 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:10.688178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1932307e-11a1-4b0f-bc10-3355336a1915 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047884 Sep 13 20:04:10.688759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 407/700] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:11.702774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5eaaafd4-d0ee-4b89-8a69-0258d386db12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:11.706168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5eaaafd4-d0ee-4b89-8a69-0258d386db12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:11.716347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5eaaafd4-d0ee-4b89-8a69-0258d386db12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:11.717130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5eaaafd4-d0ee-4b89-8a69-0258d386db12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:11.717859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5eaaafd4-d0ee-4b89-8a69-0258d386db12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:11.718782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5eaaafd4-d0ee-4b89-8a69-0258d386db12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:11.719486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5eaaafd4-d0ee-4b89-8a69-0258d386db12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:11.720172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5eaaafd4-d0ee-4b89-8a69-0258d386db12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:11.752359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5eaaafd4-d0ee-4b89-8a69-0258d386db12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054915 Sep 13 20:04:11.752944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 294/701] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:11 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:12.766093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8bc96d44-00f3-40cf-b39a-0f3aaa582784 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:12.768354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8bc96d44-00f3-40cf-b39a-0f3aaa582784 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:12.775597 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bc96d44-00f3-40cf-b39a-0f3aaa582784 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:12.776087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bc96d44-00f3-40cf-b39a-0f3aaa582784 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:12.776519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bc96d44-00f3-40cf-b39a-0f3aaa582784 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:12.777227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bc96d44-00f3-40cf-b39a-0f3aaa582784 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:12.777673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bc96d44-00f3-40cf-b39a-0f3aaa582784 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:12.778101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bc96d44-00f3-40cf-b39a-0f3aaa582784 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:12.810345 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8bc96d44-00f3-40cf-b39a-0f3aaa582784 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048473 Sep 13 20:04:12.810958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 408/702] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:13.822699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6904b7a5-fab0-4183-9f51-0892510802a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:13.825285 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6904b7a5-fab0-4183-9f51-0892510802a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:13.832108 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6904b7a5-fab0-4183-9f51-0892510802a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:13.832612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6904b7a5-fab0-4183-9f51-0892510802a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:13.833049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6904b7a5-fab0-4183-9f51-0892510802a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:13.833799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6904b7a5-fab0-4183-9f51-0892510802a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:13.834255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6904b7a5-fab0-4183-9f51-0892510802a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:13.834674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6904b7a5-fab0-4183-9f51-0892510802a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:13.883177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6904b7a5-fab0-4183-9f51-0892510802a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064481 Sep 13 20:04:13.883791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 295/703] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:14.897743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3c8182fe-d494-4b9f-ae73-2e1b661df11e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:14.899979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3c8182fe-d494-4b9f-ae73-2e1b661df11e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:14.906985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c8182fe-d494-4b9f-ae73-2e1b661df11e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:14.907463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c8182fe-d494-4b9f-ae73-2e1b661df11e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:14.907883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c8182fe-d494-4b9f-ae73-2e1b661df11e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:14.908572 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c8182fe-d494-4b9f-ae73-2e1b661df11e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:14.909011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c8182fe-d494-4b9f-ae73-2e1b661df11e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:14.909425 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c8182fe-d494-4b9f-ae73-2e1b661df11e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:14.939987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3c8182fe-d494-4b9f-ae73-2e1b661df11e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046477 Sep 13 20:04:14.940567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 409/704] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:15.956065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cb4ca458-ef7a-40fd-ae34-2b77d10e222a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:15.958770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cb4ca458-ef7a-40fd-ae34-2b77d10e222a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:15.965457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cb4ca458-ef7a-40fd-ae34-2b77d10e222a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:15.965941 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cb4ca458-ef7a-40fd-ae34-2b77d10e222a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:15.966393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cb4ca458-ef7a-40fd-ae34-2b77d10e222a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:15.967105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cb4ca458-ef7a-40fd-ae34-2b77d10e222a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:15.967547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cb4ca458-ef7a-40fd-ae34-2b77d10e222a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:15.967969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cb4ca458-ef7a-40fd-ae34-2b77d10e222a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:16.001633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cb4ca458-ef7a-40fd-ae34-2b77d10e222a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052401 Sep 13 20:04:16.002189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 296/705] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:17.015242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3739977a-c370-4d0a-94b8-9c846866f796 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:17.017512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3739977a-c370-4d0a-94b8-9c846866f796 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:17.024885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3739977a-c370-4d0a-94b8-9c846866f796 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:17.025363 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3739977a-c370-4d0a-94b8-9c846866f796 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:17.025784 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3739977a-c370-4d0a-94b8-9c846866f796 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:17.026494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3739977a-c370-4d0a-94b8-9c846866f796 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:17.026932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3739977a-c370-4d0a-94b8-9c846866f796 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:17.027341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3739977a-c370-4d0a-94b8-9c846866f796 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:17.060238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3739977a-c370-4d0a-94b8-9c846866f796 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049081 Sep 13 20:04:17.060823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 410/706] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:17 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:18.076837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-93787e7a-ef61-4154-8d8d-3d4b7ed52d2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:18.080145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-93787e7a-ef61-4154-8d8d-3d4b7ed52d2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:18.088229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-93787e7a-ef61-4154-8d8d-3d4b7ed52d2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:18.088714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-93787e7a-ef61-4154-8d8d-3d4b7ed52d2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:18.089151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-93787e7a-ef61-4154-8d8d-3d4b7ed52d2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:18.089851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-93787e7a-ef61-4154-8d8d-3d4b7ed52d2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:18.090303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-93787e7a-ef61-4154-8d8d-3d4b7ed52d2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:18.090759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-93787e7a-ef61-4154-8d8d-3d4b7ed52d2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:18.122893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-93787e7a-ef61-4154-8d8d-3d4b7ed52d2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051911 Sep 13 20:04:18.123468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 297/707] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:19.136029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c3d184e9-1986-45fa-8a3e-27184a83037c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:19.138204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c3d184e9-1986-45fa-8a3e-27184a83037c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:19.145327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3d184e9-1986-45fa-8a3e-27184a83037c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:19.145926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3d184e9-1986-45fa-8a3e-27184a83037c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:19.146328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3d184e9-1986-45fa-8a3e-27184a83037c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:19.147117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3d184e9-1986-45fa-8a3e-27184a83037c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:19.147533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3d184e9-1986-45fa-8a3e-27184a83037c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:19.147984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3d184e9-1986-45fa-8a3e-27184a83037c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:19.178565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c3d184e9-1986-45fa-8a3e-27184a83037c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046521 Sep 13 20:04:19.179152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 411/708] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:20.191840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-de4807d9-ae03-42f2-8caf-304cf89e1382 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:20.194045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-de4807d9-ae03-42f2-8caf-304cf89e1382 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:20.201415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de4807d9-ae03-42f2-8caf-304cf89e1382 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:20.201921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de4807d9-ae03-42f2-8caf-304cf89e1382 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:20.202353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de4807d9-ae03-42f2-8caf-304cf89e1382 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:20.203136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de4807d9-ae03-42f2-8caf-304cf89e1382 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:20.203609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de4807d9-ae03-42f2-8caf-304cf89e1382 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:20.204000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de4807d9-ae03-42f2-8caf-304cf89e1382 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:20.235431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-de4807d9-ae03-42f2-8caf-304cf89e1382 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047604 Sep 13 20:04:20.236036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 298/709] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:21.249210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4683748a-f184-4051-ae02-b55d035d2e9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:21.251416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4683748a-f184-4051-ae02-b55d035d2e9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:21.258447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4683748a-f184-4051-ae02-b55d035d2e9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:21.258945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4683748a-f184-4051-ae02-b55d035d2e9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:21.259368 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4683748a-f184-4051-ae02-b55d035d2e9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:21.260072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4683748a-f184-4051-ae02-b55d035d2e9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:21.260520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4683748a-f184-4051-ae02-b55d035d2e9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:21.260939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4683748a-f184-4051-ae02-b55d035d2e9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:21.295601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4683748a-f184-4051-ae02-b55d035d2e9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050304 Sep 13 20:04:21.296117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 412/710] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:22.309379 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cab539f1-abdb-40e3-af7b-003169512c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:22.311604 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cab539f1-abdb-40e3-af7b-003169512c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:22.318654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cab539f1-abdb-40e3-af7b-003169512c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:22.319143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cab539f1-abdb-40e3-af7b-003169512c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:22.319572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cab539f1-abdb-40e3-af7b-003169512c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:22.320252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cab539f1-abdb-40e3-af7b-003169512c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:22.320725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cab539f1-abdb-40e3-af7b-003169512c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:22.321136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cab539f1-abdb-40e3-af7b-003169512c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:22.351863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cab539f1-abdb-40e3-af7b-003169512c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046829 Sep 13 20:04:22.352427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 299/711] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:22 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:23.365198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9b097423-f5e5-45bd-9876-fe3ea260edf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:23.370743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9b097423-f5e5-45bd-9876-fe3ea260edf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:23.377575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b097423-f5e5-45bd-9876-fe3ea260edf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:23.378053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b097423-f5e5-45bd-9876-fe3ea260edf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:23.378504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b097423-f5e5-45bd-9876-fe3ea260edf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:23.379661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b097423-f5e5-45bd-9876-fe3ea260edf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:23.380414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b097423-f5e5-45bd-9876-fe3ea260edf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:23.380840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b097423-f5e5-45bd-9876-fe3ea260edf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:23.417194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9b097423-f5e5-45bd-9876-fe3ea260edf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056098 Sep 13 20:04:23.417780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 413/712] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:23 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:24.431395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4a5cbcd9-5301-42c7-8667-5a1efa5fed64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:24.434587 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4a5cbcd9-5301-42c7-8667-5a1efa5fed64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:24.444042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a5cbcd9-5301-42c7-8667-5a1efa5fed64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:24.444523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a5cbcd9-5301-42c7-8667-5a1efa5fed64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:24.444950 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a5cbcd9-5301-42c7-8667-5a1efa5fed64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:24.445646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a5cbcd9-5301-42c7-8667-5a1efa5fed64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:24.446087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a5cbcd9-5301-42c7-8667-5a1efa5fed64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:24.446534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a5cbcd9-5301-42c7-8667-5a1efa5fed64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:24.480484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4a5cbcd9-5301-42c7-8667-5a1efa5fed64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054345 Sep 13 20:04:24.481045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 300/713] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:25.493691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b099bb3a-e067-4192-a705-18760fcd784b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:25.495909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b099bb3a-e067-4192-a705-18760fcd784b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:25.503499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b099bb3a-e067-4192-a705-18760fcd784b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:25.503993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b099bb3a-e067-4192-a705-18760fcd784b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:25.504424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b099bb3a-e067-4192-a705-18760fcd784b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:25.505138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b099bb3a-e067-4192-a705-18760fcd784b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:25.505590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b099bb3a-e067-4192-a705-18760fcd784b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:25.506041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b099bb3a-e067-4192-a705-18760fcd784b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:25.538065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b099bb3a-e067-4192-a705-18760fcd784b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048445 Sep 13 20:04:25.538904 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 414/714] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:26.550223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-483a9768-e9d6-4d82-b91f-81c34fc93a15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:26.552709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-483a9768-e9d6-4d82-b91f-81c34fc93a15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:26.561526 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-483a9768-e9d6-4d82-b91f-81c34fc93a15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:26.562277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-483a9768-e9d6-4d82-b91f-81c34fc93a15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:26.562833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-483a9768-e9d6-4d82-b91f-81c34fc93a15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:26.563637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-483a9768-e9d6-4d82-b91f-81c34fc93a15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:26.564273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-483a9768-e9d6-4d82-b91f-81c34fc93a15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:26.564698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-483a9768-e9d6-4d82-b91f-81c34fc93a15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:26.599840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-483a9768-e9d6-4d82-b91f-81c34fc93a15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053735 Sep 13 20:04:26.600437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 301/715] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:27.613029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7f4f3e74-477e-4797-816c-2873f1896217 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:27.615260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7f4f3e74-477e-4797-816c-2873f1896217 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:27.622402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f4f3e74-477e-4797-816c-2873f1896217 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:27.622902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f4f3e74-477e-4797-816c-2873f1896217 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:27.623334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f4f3e74-477e-4797-816c-2873f1896217 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:27.624034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f4f3e74-477e-4797-816c-2873f1896217 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:27.624482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f4f3e74-477e-4797-816c-2873f1896217 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:27.624912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f4f3e74-477e-4797-816c-2873f1896217 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:27.656358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7f4f3e74-477e-4797-816c-2873f1896217 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047467 Sep 13 20:04:27.656936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 415/716] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:27 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:28.669008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3421278d-083f-4cbb-8df5-97eb94ceabd6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:28.671240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3421278d-083f-4cbb-8df5-97eb94ceabd6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:28.678834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3421278d-083f-4cbb-8df5-97eb94ceabd6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:28.679328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3421278d-083f-4cbb-8df5-97eb94ceabd6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:28.679758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3421278d-083f-4cbb-8df5-97eb94ceabd6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:28.680593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3421278d-083f-4cbb-8df5-97eb94ceabd6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:28.681042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3421278d-083f-4cbb-8df5-97eb94ceabd6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:28.681463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3421278d-083f-4cbb-8df5-97eb94ceabd6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:28.715658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3421278d-083f-4cbb-8df5-97eb94ceabd6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050622 Sep 13 20:04:28.716251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 302/717] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:29.729089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-987fffaa-cc7a-4abf-a290-7975ca81929f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:29.731289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-987fffaa-cc7a-4abf-a290-7975ca81929f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:29.739626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-987fffaa-cc7a-4abf-a290-7975ca81929f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:29.740106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-987fffaa-cc7a-4abf-a290-7975ca81929f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:29.740541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-987fffaa-cc7a-4abf-a290-7975ca81929f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:29.741242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-987fffaa-cc7a-4abf-a290-7975ca81929f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:29.741693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-987fffaa-cc7a-4abf-a290-7975ca81929f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:29.742115 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-987fffaa-cc7a-4abf-a290-7975ca81929f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:29.773219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-987fffaa-cc7a-4abf-a290-7975ca81929f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048345 Sep 13 20:04:29.773804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 416/718] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:29 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:30.786149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-811a8852-bdc5-4fb3-91e3-1d8d8cc55835 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:30.788320 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-811a8852-bdc5-4fb3-91e3-1d8d8cc55835 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:30.795180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-811a8852-bdc5-4fb3-91e3-1d8d8cc55835 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:30.795868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-811a8852-bdc5-4fb3-91e3-1d8d8cc55835 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:30.796087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-811a8852-bdc5-4fb3-91e3-1d8d8cc55835 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:30.796815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-811a8852-bdc5-4fb3-91e3-1d8d8cc55835 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:30.797265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-811a8852-bdc5-4fb3-91e3-1d8d8cc55835 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:30.797690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-811a8852-bdc5-4fb3-91e3-1d8d8cc55835 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:30.831476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-811a8852-bdc5-4fb3-91e3-1d8d8cc55835 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049774 Sep 13 20:04:30.832054 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 303/719] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:30 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:31.850100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-19c4b861-69d3-4db7-a204-90eaf43b6475 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:31.854679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-19c4b861-69d3-4db7-a204-90eaf43b6475 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:31.863109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19c4b861-69d3-4db7-a204-90eaf43b6475 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:31.863747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19c4b861-69d3-4db7-a204-90eaf43b6475 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:31.864422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19c4b861-69d3-4db7-a204-90eaf43b6475 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:31.865141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19c4b861-69d3-4db7-a204-90eaf43b6475 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:31.865592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19c4b861-69d3-4db7-a204-90eaf43b6475 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:31.866016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19c4b861-69d3-4db7-a204-90eaf43b6475 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:31.898505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-19c4b861-69d3-4db7-a204-90eaf43b6475 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055836 Sep 13 20:04:31.899097 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 417/720] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:32.911187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5fbd67c5-d823-40dd-b708-2feeb98734aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:32.913539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5fbd67c5-d823-40dd-b708-2feeb98734aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:32.921411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5fbd67c5-d823-40dd-b708-2feeb98734aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:32.921902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5fbd67c5-d823-40dd-b708-2feeb98734aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:32.922339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5fbd67c5-d823-40dd-b708-2feeb98734aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:32.923129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5fbd67c5-d823-40dd-b708-2feeb98734aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:32.923894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5fbd67c5-d823-40dd-b708-2feeb98734aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:32.925016 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5fbd67c5-d823-40dd-b708-2feeb98734aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:32.968100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5fbd67c5-d823-40dd-b708-2feeb98734aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061299 Sep 13 20:04:32.968673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 304/721] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:33.983781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fa3d17e2-fa8f-4658-bd9c-5dcfd799c288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:33.986832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fa3d17e2-fa8f-4658-bd9c-5dcfd799c288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:33.995126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa3d17e2-fa8f-4658-bd9c-5dcfd799c288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:33.995571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa3d17e2-fa8f-4658-bd9c-5dcfd799c288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:33.996064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa3d17e2-fa8f-4658-bd9c-5dcfd799c288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:33.997126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa3d17e2-fa8f-4658-bd9c-5dcfd799c288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:33.997694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa3d17e2-fa8f-4658-bd9c-5dcfd799c288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:33.998154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa3d17e2-fa8f-4658-bd9c-5dcfd799c288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:34.031116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fa3d17e2-fa8f-4658-bd9c-5dcfd799c288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052284 Sep 13 20:04:34.031661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 418/722] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:35.044687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-908fa81d-0c5b-4291-b976-ec7a59e5baea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:35.047244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-908fa81d-0c5b-4291-b976-ec7a59e5baea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:35.054130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-908fa81d-0c5b-4291-b976-ec7a59e5baea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:35.054663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-908fa81d-0c5b-4291-b976-ec7a59e5baea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:35.055101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-908fa81d-0c5b-4291-b976-ec7a59e5baea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:35.055786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-908fa81d-0c5b-4291-b976-ec7a59e5baea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:35.056244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-908fa81d-0c5b-4291-b976-ec7a59e5baea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:35.056660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-908fa81d-0c5b-4291-b976-ec7a59e5baea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:35.087591 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-908fa81d-0c5b-4291-b976-ec7a59e5baea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046956 Sep 13 20:04:35.088144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 305/723] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:35 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:36.100425 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3283036c-0932-4393-bf89-149a18794831 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:36.102609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3283036c-0932-4393-bf89-149a18794831 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:36.104934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=31 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:36.110710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3283036c-0932-4393-bf89-149a18794831 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:36.111187 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3283036c-0932-4393-bf89-149a18794831 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:36.111619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3283036c-0932-4393-bf89-149a18794831 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:36.112312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3283036c-0932-4393-bf89-149a18794831 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:36.112747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3283036c-0932-4393-bf89-149a18794831 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:36.113175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3283036c-0932-4393-bf89-149a18794831 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:36.115790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=91 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:36.144308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3283036c-0932-4393-bf89-149a18794831 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047876 Sep 13 20:04:36.144866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 419/724] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:37.158255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0c2acedf-ff37-4865-a1a8-9b3b2b498bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:37.160353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0c2acedf-ff37-4865-a1a8-9b3b2b498bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:37.162843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=31 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:37.168919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c2acedf-ff37-4865-a1a8-9b3b2b498bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:37.169398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c2acedf-ff37-4865-a1a8-9b3b2b498bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:37.169818 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c2acedf-ff37-4865-a1a8-9b3b2b498bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:37.170553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c2acedf-ff37-4865-a1a8-9b3b2b498bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:37.170999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c2acedf-ff37-4865-a1a8-9b3b2b498bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:37.171416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c2acedf-ff37-4865-a1a8-9b3b2b498bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:37.173831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:37.202897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0c2acedf-ff37-4865-a1a8-9b3b2b498bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048730 Sep 13 20:04:37.203497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 306/725] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:38.216843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cd085298-de21-4c41-8084-fa1c867746d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:38.219066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cd085298-de21-4c41-8084-fa1c867746d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:38.226176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd085298-de21-4c41-8084-fa1c867746d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:38.226689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd085298-de21-4c41-8084-fa1c867746d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:38.227120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd085298-de21-4c41-8084-fa1c867746d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:38.227819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd085298-de21-4c41-8084-fa1c867746d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:38.228264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd085298-de21-4c41-8084-fa1c867746d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:38.228683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd085298-de21-4c41-8084-fa1c867746d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:38.260273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cd085298-de21-4c41-8084-fa1c867746d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047508 Sep 13 20:04:38.260832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 420/726] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:39.274930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2b572677-1654-4524-ab70-7ade307b2db1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:39.277094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2b572677-1654-4524-ab70-7ade307b2db1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:39.284441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b572677-1654-4524-ab70-7ade307b2db1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:39.284931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b572677-1654-4524-ab70-7ade307b2db1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:39.285371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b572677-1654-4524-ab70-7ade307b2db1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:39.286157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b572677-1654-4524-ab70-7ade307b2db1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:39.286562 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b572677-1654-4524-ab70-7ade307b2db1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:39.286986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b572677-1654-4524-ab70-7ade307b2db1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:39.318759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2b572677-1654-4524-ab70-7ade307b2db1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048594 Sep 13 20:04:39.319310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 307/727] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:40.336342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-88918642-3870-4ea8-9fd0-72d90e788c04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:40.339841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-88918642-3870-4ea8-9fd0-72d90e788c04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:40.350743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88918642-3870-4ea8-9fd0-72d90e788c04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:40.351459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88918642-3870-4ea8-9fd0-72d90e788c04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:40.351888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88918642-3870-4ea8-9fd0-72d90e788c04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:40.352582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88918642-3870-4ea8-9fd0-72d90e788c04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:40.353034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88918642-3870-4ea8-9fd0-72d90e788c04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:40.353452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88918642-3870-4ea8-9fd0-72d90e788c04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:40.383813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-88918642-3870-4ea8-9fd0-72d90e788c04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054142 Sep 13 20:04:40.384373 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 421/728] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:41.399635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-35e43ce2-9f30-41eb-a498-891119660fd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:41.401771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-35e43ce2-9f30-41eb-a498-891119660fd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:41.408642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35e43ce2-9f30-41eb-a498-891119660fd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:41.409122 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35e43ce2-9f30-41eb-a498-891119660fd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:41.409557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35e43ce2-9f30-41eb-a498-891119660fd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:41.410245 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35e43ce2-9f30-41eb-a498-891119660fd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:41.410731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35e43ce2-9f30-41eb-a498-891119660fd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:41.411151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35e43ce2-9f30-41eb-a498-891119660fd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:41.441980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-35e43ce2-9f30-41eb-a498-891119660fd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046513 Sep 13 20:04:41.442570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 308/729] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:41 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:42.459167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a3f6f081-0a69-49eb-a801-b708b28d70a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:42.461691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a3f6f081-0a69-49eb-a801-b708b28d70a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:42.470054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3f6f081-0a69-49eb-a801-b708b28d70a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:42.470666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3f6f081-0a69-49eb-a801-b708b28d70a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:42.471176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3f6f081-0a69-49eb-a801-b708b28d70a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:42.471993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3f6f081-0a69-49eb-a801-b708b28d70a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:42.472529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3f6f081-0a69-49eb-a801-b708b28d70a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:42.473013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3f6f081-0a69-49eb-a801-b708b28d70a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:42.504865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a3f6f081-0a69-49eb-a801-b708b28d70a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050597 Sep 13 20:04:42.505417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 422/730] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:43.522248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0f673f3c-7a55-461a-9e9f-55cb95b6dd41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:43.524882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0f673f3c-7a55-461a-9e9f-55cb95b6dd41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:43.531817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f673f3c-7a55-461a-9e9f-55cb95b6dd41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:43.532296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f673f3c-7a55-461a-9e9f-55cb95b6dd41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:43.532731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f673f3c-7a55-461a-9e9f-55cb95b6dd41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:43.533460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f673f3c-7a55-461a-9e9f-55cb95b6dd41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:43.533914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f673f3c-7a55-461a-9e9f-55cb95b6dd41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:43.534333 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f673f3c-7a55-461a-9e9f-55cb95b6dd41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:43.565558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0f673f3c-7a55-461a-9e9f-55cb95b6dd41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050043 Sep 13 20:04:43.566103 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 309/731] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:44.580243 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4f40c0f2-aab0-4497-9ef4-8306ced35e34 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:44.582531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4f40c0f2-aab0-4497-9ef4-8306ced35e34 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:44.588921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f40c0f2-aab0-4497-9ef4-8306ced35e34 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:44.589421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f40c0f2-aab0-4497-9ef4-8306ced35e34 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:44.589847 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f40c0f2-aab0-4497-9ef4-8306ced35e34 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:44.590651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f40c0f2-aab0-4497-9ef4-8306ced35e34 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:44.591102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f40c0f2-aab0-4497-9ef4-8306ced35e34 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:44.591517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f40c0f2-aab0-4497-9ef4-8306ced35e34 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:44.621603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4f40c0f2-aab0-4497-9ef4-8306ced35e34 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045639 Sep 13 20:04:44.622159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 423/732] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:45.634206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ed7958c2-95ac-48e5-a8e1-5e33e7796ec8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:45.636359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ed7958c2-95ac-48e5-a8e1-5e33e7796ec8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:45.643070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ed7958c2-95ac-48e5-a8e1-5e33e7796ec8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:45.643553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ed7958c2-95ac-48e5-a8e1-5e33e7796ec8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:45.643988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ed7958c2-95ac-48e5-a8e1-5e33e7796ec8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:45.644685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ed7958c2-95ac-48e5-a8e1-5e33e7796ec8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:45.645133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ed7958c2-95ac-48e5-a8e1-5e33e7796ec8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:45.645553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ed7958c2-95ac-48e5-a8e1-5e33e7796ec8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:45.676011 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ed7958c2-95ac-48e5-a8e1-5e33e7796ec8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045931 Sep 13 20:04:45.676561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 310/733] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:46.690979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d509b8e0-467f-4a6a-827c-a38f74283e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:46.693419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d509b8e0-467f-4a6a-827c-a38f74283e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:46.701608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d509b8e0-467f-4a6a-827c-a38f74283e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:46.702188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d509b8e0-467f-4a6a-827c-a38f74283e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:46.702723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d509b8e0-467f-4a6a-827c-a38f74283e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:46.703557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d509b8e0-467f-4a6a-827c-a38f74283e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:46.704096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d509b8e0-467f-4a6a-827c-a38f74283e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:46.704618 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d509b8e0-467f-4a6a-827c-a38f74283e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:46.737529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d509b8e0-467f-4a6a-827c-a38f74283e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051593 Sep 13 20:04:46.738096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 424/734] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:47.754798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-61277b96-4254-45fe-8526-d97f1944f96c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:47.757206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-61277b96-4254-45fe-8526-d97f1944f96c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:47.764467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61277b96-4254-45fe-8526-d97f1944f96c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:47.764948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61277b96-4254-45fe-8526-d97f1944f96c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:47.765387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61277b96-4254-45fe-8526-d97f1944f96c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:47.766082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61277b96-4254-45fe-8526-d97f1944f96c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:47.766577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61277b96-4254-45fe-8526-d97f1944f96c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:47.767004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-61277b96-4254-45fe-8526-d97f1944f96c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:47.798025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-61277b96-4254-45fe-8526-d97f1944f96c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050079 Sep 13 20:04:47.798626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 311/735] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:47 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:48.811470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-aee85bf6-295d-49de-9fb3-a5ca94c1b256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:48.813650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-aee85bf6-295d-49de-9fb3-a5ca94c1b256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:48.820729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aee85bf6-295d-49de-9fb3-a5ca94c1b256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:48.821205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aee85bf6-295d-49de-9fb3-a5ca94c1b256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:48.821628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aee85bf6-295d-49de-9fb3-a5ca94c1b256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:48.822307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aee85bf6-295d-49de-9fb3-a5ca94c1b256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:48.823134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aee85bf6-295d-49de-9fb3-a5ca94c1b256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:48.823548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aee85bf6-295d-49de-9fb3-a5ca94c1b256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:48.854047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-aee85bf6-295d-49de-9fb3-a5ca94c1b256 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046860 Sep 13 20:04:48.854644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 425/736] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:48 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:49.868836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b4de31af-fafa-47c8-bd64-3966e656f149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:49.871419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b4de31af-fafa-47c8-bd64-3966e656f149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:49.879560 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4de31af-fafa-47c8-bd64-3966e656f149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:49.880268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4de31af-fafa-47c8-bd64-3966e656f149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:49.880806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4de31af-fafa-47c8-bd64-3966e656f149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:49.881936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4de31af-fafa-47c8-bd64-3966e656f149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:49.882837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4de31af-fafa-47c8-bd64-3966e656f149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:49.883266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4de31af-fafa-47c8-bd64-3966e656f149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:49.913235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b4de31af-fafa-47c8-bd64-3966e656f149 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048930 Sep 13 20:04:49.913838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 312/737] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:50.925995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3617c63a-e32e-4dde-816c-278167d17e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:50.928577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3617c63a-e32e-4dde-816c-278167d17e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:50.935663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3617c63a-e32e-4dde-816c-278167d17e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:50.936138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3617c63a-e32e-4dde-816c-278167d17e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:50.936563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3617c63a-e32e-4dde-816c-278167d17e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:50.937254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3617c63a-e32e-4dde-816c-278167d17e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:50.937673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3617c63a-e32e-4dde-816c-278167d17e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:50.938114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3617c63a-e32e-4dde-816c-278167d17e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:50.968631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3617c63a-e32e-4dde-816c-278167d17e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046757 Sep 13 20:04:50.969176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 426/738] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:51.986891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8bcfd448-164a-405c-8ffe-d4c3b6d2af56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:51.989892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8bcfd448-164a-405c-8ffe-d4c3b6d2af56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:51.999778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8bcfd448-164a-405c-8ffe-d4c3b6d2af56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:52.000600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8bcfd448-164a-405c-8ffe-d4c3b6d2af56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:52.001326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8bcfd448-164a-405c-8ffe-d4c3b6d2af56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:52.002222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8bcfd448-164a-405c-8ffe-d4c3b6d2af56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:52.002697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8bcfd448-164a-405c-8ffe-d4c3b6d2af56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:52.003117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8bcfd448-164a-405c-8ffe-d4c3b6d2af56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:52.035496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8bcfd448-164a-405c-8ffe-d4c3b6d2af56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056187 Sep 13 20:04:52.036057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 313/739] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:53.049007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-06a89828-dbd4-48f9-8852-0e19bc65fa01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:53.051312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-06a89828-dbd4-48f9-8852-0e19bc65fa01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:53.058255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06a89828-dbd4-48f9-8852-0e19bc65fa01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:53.058791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06a89828-dbd4-48f9-8852-0e19bc65fa01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:53.059222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06a89828-dbd4-48f9-8852-0e19bc65fa01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:53.059923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06a89828-dbd4-48f9-8852-0e19bc65fa01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:53.060375 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06a89828-dbd4-48f9-8852-0e19bc65fa01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:53.060795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06a89828-dbd4-48f9-8852-0e19bc65fa01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:53.094765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-06a89828-dbd4-48f9-8852-0e19bc65fa01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049723 Sep 13 20:04:53.095323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 427/740] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:53 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:54.109289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8b686404-f384-44f4-bfef-91d345e74141 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:54.111551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8b686404-f384-44f4-bfef-91d345e74141 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:54.118998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8b686404-f384-44f4-bfef-91d345e74141 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:54.119472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8b686404-f384-44f4-bfef-91d345e74141 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:54.119901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8b686404-f384-44f4-bfef-91d345e74141 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:54.120580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8b686404-f384-44f4-bfef-91d345e74141 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:54.121021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8b686404-f384-44f4-bfef-91d345e74141 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:54.121437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8b686404-f384-44f4-bfef-91d345e74141 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:54.152929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8b686404-f384-44f4-bfef-91d345e74141 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047958 Sep 13 20:04:54.153477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 314/741] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:54 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:55.166677 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-80bed6c2-88b1-424f-b857-ab10f1784413 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:55.168778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-80bed6c2-88b1-424f-b857-ab10f1784413 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:55.175630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80bed6c2-88b1-424f-b857-ab10f1784413 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:55.176111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80bed6c2-88b1-424f-b857-ab10f1784413 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:55.176546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80bed6c2-88b1-424f-b857-ab10f1784413 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:55.177239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80bed6c2-88b1-424f-b857-ab10f1784413 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:55.177687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80bed6c2-88b1-424f-b857-ab10f1784413 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:55.178113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80bed6c2-88b1-424f-b857-ab10f1784413 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:55.209036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-80bed6c2-88b1-424f-b857-ab10f1784413 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047019 Sep 13 20:04:55.209595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 428/742] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:56.223587 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-66911c4c-06a4-4d18-9161-c87202de169c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:56.225744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-66911c4c-06a4-4d18-9161-c87202de169c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:56.232815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-66911c4c-06a4-4d18-9161-c87202de169c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:56.233292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-66911c4c-06a4-4d18-9161-c87202de169c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:56.233721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-66911c4c-06a4-4d18-9161-c87202de169c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:56.234421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-66911c4c-06a4-4d18-9161-c87202de169c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:56.234882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-66911c4c-06a4-4d18-9161-c87202de169c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:56.235298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-66911c4c-06a4-4d18-9161-c87202de169c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:56.264792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-66911c4c-06a4-4d18-9161-c87202de169c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045281 Sep 13 20:04:56.265338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 315/743] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:57.282071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9c56ea56-36e0-40a4-8de3-315199c36ba1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:57.285548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9c56ea56-36e0-40a4-8de3-315199c36ba1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:57.294030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c56ea56-36e0-40a4-8de3-315199c36ba1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:57.294535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c56ea56-36e0-40a4-8de3-315199c36ba1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:57.294962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c56ea56-36e0-40a4-8de3-315199c36ba1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:57.295643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c56ea56-36e0-40a4-8de3-315199c36ba1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:57.296078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c56ea56-36e0-40a4-8de3-315199c36ba1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:57.296492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c56ea56-36e0-40a4-8de3-315199c36ba1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:57.327955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9c56ea56-36e0-40a4-8de3-315199c36ba1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052793 Sep 13 20:04:57.328505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 429/744] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:58.344298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-da840040-097e-4f34-aaa9-c983067da8d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:58.346547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-da840040-097e-4f34-aaa9-c983067da8d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:58.353292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da840040-097e-4f34-aaa9-c983067da8d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:58.353793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da840040-097e-4f34-aaa9-c983067da8d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:58.354251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da840040-097e-4f34-aaa9-c983067da8d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:58.354942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da840040-097e-4f34-aaa9-c983067da8d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:58.355384 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da840040-097e-4f34-aaa9-c983067da8d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:58.355830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da840040-097e-4f34-aaa9-c983067da8d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:58.385760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-da840040-097e-4f34-aaa9-c983067da8d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045519 Sep 13 20:04:58.386296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 316/745] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:04:59.400336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-99ffdc02-ca8a-435a-a6d1-39020fc80d01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:59.402613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-99ffdc02-ca8a-435a-a6d1-39020fc80d01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:59.409551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99ffdc02-ca8a-435a-a6d1-39020fc80d01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:59.410036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99ffdc02-ca8a-435a-a6d1-39020fc80d01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:59.410502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99ffdc02-ca8a-435a-a6d1-39020fc80d01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:59.411325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99ffdc02-ca8a-435a-a6d1-39020fc80d01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:59.411779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99ffdc02-ca8a-435a-a6d1-39020fc80d01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:59.412229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99ffdc02-ca8a-435a-a6d1-39020fc80d01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:59.442395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-99ffdc02-ca8a-435a-a6d1-39020fc80d01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047228 Sep 13 20:04:59.442965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 430/746] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:04:59 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:00.459729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cd374d7d-1ad3-4c1e-938b-f69a508b0219 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:00.462192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cd374d7d-1ad3-4c1e-938b-f69a508b0219 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:00.476534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cd374d7d-1ad3-4c1e-938b-f69a508b0219 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:00.477133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cd374d7d-1ad3-4c1e-938b-f69a508b0219 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:00.477672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cd374d7d-1ad3-4c1e-938b-f69a508b0219 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:00.478660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cd374d7d-1ad3-4c1e-938b-f69a508b0219 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:00.479108 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cd374d7d-1ad3-4c1e-938b-f69a508b0219 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:00.479517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cd374d7d-1ad3-4c1e-938b-f69a508b0219 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:00.514810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cd374d7d-1ad3-4c1e-938b-f69a508b0219 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060381 Sep 13 20:05:00.515391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 317/747] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:00 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:01.529335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3202f57b-e929-4240-ac2b-decd7b36c03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:01.531559 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3202f57b-e929-4240-ac2b-decd7b36c03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:01.538426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3202f57b-e929-4240-ac2b-decd7b36c03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:01.538909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3202f57b-e929-4240-ac2b-decd7b36c03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:01.539417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3202f57b-e929-4240-ac2b-decd7b36c03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:01.540104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3202f57b-e929-4240-ac2b-decd7b36c03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:01.540544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3202f57b-e929-4240-ac2b-decd7b36c03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:01.540959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3202f57b-e929-4240-ac2b-decd7b36c03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:01.571642 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3202f57b-e929-4240-ac2b-decd7b36c03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046649 Sep 13 20:05:01.572548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 431/748] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:02.586576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f7c1d118-a849-43ce-87a9-1482d7556029 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:02.588859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f7c1d118-a849-43ce-87a9-1482d7556029 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:02.597187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7c1d118-a849-43ce-87a9-1482d7556029 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:02.597823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7c1d118-a849-43ce-87a9-1482d7556029 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:02.598415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7c1d118-a849-43ce-87a9-1482d7556029 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:02.599401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7c1d118-a849-43ce-87a9-1482d7556029 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:02.599966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7c1d118-a849-43ce-87a9-1482d7556029 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:02.600534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7c1d118-a849-43ce-87a9-1482d7556029 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:02.631682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f7c1d118-a849-43ce-87a9-1482d7556029 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048878 Sep 13 20:05:02.631967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 318/749] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:03.648226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6eec24bb-d262-4e35-8a4f-16d4bd51f172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:03.651079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6eec24bb-d262-4e35-8a4f-16d4bd51f172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:03.657885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6eec24bb-d262-4e35-8a4f-16d4bd51f172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:03.658403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6eec24bb-d262-4e35-8a4f-16d4bd51f172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:03.658825 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6eec24bb-d262-4e35-8a4f-16d4bd51f172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:03.659516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6eec24bb-d262-4e35-8a4f-16d4bd51f172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:03.659962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6eec24bb-d262-4e35-8a4f-16d4bd51f172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:03.660382 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6eec24bb-d262-4e35-8a4f-16d4bd51f172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:03.690473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6eec24bb-d262-4e35-8a4f-16d4bd51f172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048803 Sep 13 20:05:03.691003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 432/750] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:04.704857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2a7b6a42-b47d-45ba-8582-70f4fe912a18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:04.707122 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2a7b6a42-b47d-45ba-8582-70f4fe912a18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:04.714533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a7b6a42-b47d-45ba-8582-70f4fe912a18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:04.715015 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a7b6a42-b47d-45ba-8582-70f4fe912a18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:04.715456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a7b6a42-b47d-45ba-8582-70f4fe912a18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:04.716159 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a7b6a42-b47d-45ba-8582-70f4fe912a18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:04.716614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a7b6a42-b47d-45ba-8582-70f4fe912a18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:04.717039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a7b6a42-b47d-45ba-8582-70f4fe912a18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:04.748105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2a7b6a42-b47d-45ba-8582-70f4fe912a18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047838 Sep 13 20:05:04.748652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 319/751] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:05.761479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-83e12336-dd5c-4069-aad4-e9849994cfad tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:05.763703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-83e12336-dd5c-4069-aad4-e9849994cfad tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:05.770848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83e12336-dd5c-4069-aad4-e9849994cfad tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:05.771327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83e12336-dd5c-4069-aad4-e9849994cfad tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:05.771755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83e12336-dd5c-4069-aad4-e9849994cfad tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:05.772440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83e12336-dd5c-4069-aad4-e9849994cfad tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:05.772883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83e12336-dd5c-4069-aad4-e9849994cfad tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:05.773299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83e12336-dd5c-4069-aad4-e9849994cfad tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:05.803364 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-83e12336-dd5c-4069-aad4-e9849994cfad tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046011 Sep 13 20:05:05.803924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 433/752] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:06.823150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ede05714-239a-43d8-a46c-262f63460089 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:06.826603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ede05714-239a-43d8-a46c-262f63460089 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:06.838239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ede05714-239a-43d8-a46c-262f63460089 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:06.838783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ede05714-239a-43d8-a46c-262f63460089 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:06.839222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ede05714-239a-43d8-a46c-262f63460089 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:06.839923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ede05714-239a-43d8-a46c-262f63460089 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:06.840380 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ede05714-239a-43d8-a46c-262f63460089 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:06.840804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ede05714-239a-43d8-a46c-262f63460089 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:06.872109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ede05714-239a-43d8-a46c-262f63460089 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056154 Sep 13 20:05:06.877222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 320/753] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:06 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:07.887309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-665119ba-717b-425f-afaf-94d04dbd59ac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:07.889424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-665119ba-717b-425f-afaf-94d04dbd59ac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:07.891802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=30 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:07.897342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-665119ba-717b-425f-afaf-94d04dbd59ac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:07.897855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-665119ba-717b-425f-afaf-94d04dbd59ac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:07.898288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-665119ba-717b-425f-afaf-94d04dbd59ac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:07.898988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-665119ba-717b-425f-afaf-94d04dbd59ac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:07.899434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-665119ba-717b-425f-afaf-94d04dbd59ac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:07.899848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-665119ba-717b-425f-afaf-94d04dbd59ac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:07.902564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=90 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:07.931083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-665119ba-717b-425f-afaf-94d04dbd59ac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048739 Sep 13 20:05:07.931631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 434/754] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:08.950075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-764cdf4d-0d35-46ea-92f9-b88d6d21558f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:08.953267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-764cdf4d-0d35-46ea-92f9-b88d6d21558f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:08.956887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=30 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:08.962715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-764cdf4d-0d35-46ea-92f9-b88d6d21558f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:08.963242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-764cdf4d-0d35-46ea-92f9-b88d6d21558f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:08.963679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-764cdf4d-0d35-46ea-92f9-b88d6d21558f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:08.964367 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-764cdf4d-0d35-46ea-92f9-b88d6d21558f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:08.964831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-764cdf4d-0d35-46ea-92f9-b88d6d21558f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:08.965304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-764cdf4d-0d35-46ea-92f9-b88d6d21558f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:08.967909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=90 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:09.001853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-764cdf4d-0d35-46ea-92f9-b88d6d21558f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058150 Sep 13 20:05:09.002345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 321/755] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:10.016357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a38e421e-8c8e-4d0a-be9d-b7f14932a216 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:10.018628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a38e421e-8c8e-4d0a-be9d-b7f14932a216 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:10.025878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a38e421e-8c8e-4d0a-be9d-b7f14932a216 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:10.026358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a38e421e-8c8e-4d0a-be9d-b7f14932a216 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:10.026897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a38e421e-8c8e-4d0a-be9d-b7f14932a216 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:10.027582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a38e421e-8c8e-4d0a-be9d-b7f14932a216 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:10.028033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a38e421e-8c8e-4d0a-be9d-b7f14932a216 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:10.028455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a38e421e-8c8e-4d0a-be9d-b7f14932a216 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:10.058728 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a38e421e-8c8e-4d0a-be9d-b7f14932a216 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046310 Sep 13 20:05:10.059205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 435/756] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:11.077224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3636a225-9c93-42b2-a107-692b94d9c645 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:11.080242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3636a225-9c93-42b2-a107-692b94d9c645 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:11.090758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3636a225-9c93-42b2-a107-692b94d9c645 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:11.091242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3636a225-9c93-42b2-a107-692b94d9c645 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:11.091689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3636a225-9c93-42b2-a107-692b94d9c645 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:11.092400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3636a225-9c93-42b2-a107-692b94d9c645 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:11.092854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3636a225-9c93-42b2-a107-692b94d9c645 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:11.093274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3636a225-9c93-42b2-a107-692b94d9c645 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:11.124998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3636a225-9c93-42b2-a107-692b94d9c645 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054227 Sep 13 20:05:11.125558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 322/757] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:11 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:12.142751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bbb30121-20e6-4ddd-9f87-0ea6d259f3b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:12.146034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bbb30121-20e6-4ddd-9f87-0ea6d259f3b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:12.155475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bbb30121-20e6-4ddd-9f87-0ea6d259f3b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:12.155936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bbb30121-20e6-4ddd-9f87-0ea6d259f3b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:12.156367 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bbb30121-20e6-4ddd-9f87-0ea6d259f3b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:12.157063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bbb30121-20e6-4ddd-9f87-0ea6d259f3b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:12.157510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bbb30121-20e6-4ddd-9f87-0ea6d259f3b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:12.157926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bbb30121-20e6-4ddd-9f87-0ea6d259f3b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:12.189177 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bbb30121-20e6-4ddd-9f87-0ea6d259f3b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053579 Sep 13 20:05:12.189746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 436/758] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:13.207417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4e77649a-7030-4941-b1a8-b42ccc7dfd18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:13.209469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4e77649a-7030-4941-b1a8-b42ccc7dfd18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:13.216570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4e77649a-7030-4941-b1a8-b42ccc7dfd18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:13.217049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4e77649a-7030-4941-b1a8-b42ccc7dfd18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:13.217471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4e77649a-7030-4941-b1a8-b42ccc7dfd18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:13.218161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4e77649a-7030-4941-b1a8-b42ccc7dfd18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:13.218651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4e77649a-7030-4941-b1a8-b42ccc7dfd18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:13.219056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4e77649a-7030-4941-b1a8-b42ccc7dfd18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:13.249148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4e77649a-7030-4941-b1a8-b42ccc7dfd18 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045898 Sep 13 20:05:13.249702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 323/759] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:14.262399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-40731ad5-995b-4ff8-be1e-b8e80ff47fb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:14.264614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-40731ad5-995b-4ff8-be1e-b8e80ff47fb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:14.271241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-40731ad5-995b-4ff8-be1e-b8e80ff47fb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:14.271718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-40731ad5-995b-4ff8-be1e-b8e80ff47fb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:14.272150 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-40731ad5-995b-4ff8-be1e-b8e80ff47fb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:14.272834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-40731ad5-995b-4ff8-be1e-b8e80ff47fb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:14.273283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-40731ad5-995b-4ff8-be1e-b8e80ff47fb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:14.273701 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-40731ad5-995b-4ff8-be1e-b8e80ff47fb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:14.458767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-40731ad5-995b-4ff8-be1e-b8e80ff47fb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.200426 Sep 13 20:05:14.459232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 437/760] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:15.477043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dccd6b23-4ba4-46be-b15a-af7d823ac03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:15.479949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dccd6b23-4ba4-46be-b15a-af7d823ac03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:15.487143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dccd6b23-4ba4-46be-b15a-af7d823ac03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:15.487627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dccd6b23-4ba4-46be-b15a-af7d823ac03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:15.488065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dccd6b23-4ba4-46be-b15a-af7d823ac03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:15.488887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dccd6b23-4ba4-46be-b15a-af7d823ac03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:15.489339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dccd6b23-4ba4-46be-b15a-af7d823ac03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:15.489767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dccd6b23-4ba4-46be-b15a-af7d823ac03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:15.519862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dccd6b23-4ba4-46be-b15a-af7d823ac03b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048137 Sep 13 20:05:15.520416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 324/761] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:16.532625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f956d763-1a4e-400f-94eb-cd67eb3c4996 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:16.534753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f956d763-1a4e-400f-94eb-cd67eb3c4996 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:16.541735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f956d763-1a4e-400f-94eb-cd67eb3c4996 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:16.542217 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f956d763-1a4e-400f-94eb-cd67eb3c4996 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:16.542710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f956d763-1a4e-400f-94eb-cd67eb3c4996 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:16.543408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f956d763-1a4e-400f-94eb-cd67eb3c4996 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:16.543857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f956d763-1a4e-400f-94eb-cd67eb3c4996 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:16.544274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f956d763-1a4e-400f-94eb-cd67eb3c4996 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:16.579848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f956d763-1a4e-400f-94eb-cd67eb3c4996 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050925 Sep 13 20:05:16.580615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 438/762] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:16 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:17.593398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c9a05475-a78a-49b7-9d0c-165bf7c3924b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:17.596110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c9a05475-a78a-49b7-9d0c-165bf7c3924b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:17.602573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9a05475-a78a-49b7-9d0c-165bf7c3924b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:17.603045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9a05475-a78a-49b7-9d0c-165bf7c3924b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:17.603467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9a05475-a78a-49b7-9d0c-165bf7c3924b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:17.604146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9a05475-a78a-49b7-9d0c-165bf7c3924b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:17.604593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9a05475-a78a-49b7-9d0c-165bf7c3924b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:17.605003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9a05475-a78a-49b7-9d0c-165bf7c3924b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:17.635495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c9a05475-a78a-49b7-9d0c-165bf7c3924b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046113 Sep 13 20:05:17.636069 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 325/763] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:17 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:18.656210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-403c8cbd-e003-452d-930f-8b546c5e6860 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:18.658337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-403c8cbd-e003-452d-930f-8b546c5e6860 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:18.665326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-403c8cbd-e003-452d-930f-8b546c5e6860 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:18.665812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-403c8cbd-e003-452d-930f-8b546c5e6860 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:18.666246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-403c8cbd-e003-452d-930f-8b546c5e6860 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:18.666979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-403c8cbd-e003-452d-930f-8b546c5e6860 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:18.667435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-403c8cbd-e003-452d-930f-8b546c5e6860 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:18.667853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-403c8cbd-e003-452d-930f-8b546c5e6860 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:18.703816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-403c8cbd-e003-452d-930f-8b546c5e6860 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058564 Sep 13 20:05:18.704376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 439/764] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:19.717200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3f2a2f2d-99da-48b8-8694-d785587773be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:19.719400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3f2a2f2d-99da-48b8-8694-d785587773be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:19.726244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f2a2f2d-99da-48b8-8694-d785587773be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:19.726761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f2a2f2d-99da-48b8-8694-d785587773be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:19.727194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f2a2f2d-99da-48b8-8694-d785587773be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:19.727885 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f2a2f2d-99da-48b8-8694-d785587773be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:19.728334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f2a2f2d-99da-48b8-8694-d785587773be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:19.728754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f2a2f2d-99da-48b8-8694-d785587773be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:19.760572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3f2a2f2d-99da-48b8-8694-d785587773be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047408 Sep 13 20:05:19.761136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 326/765] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:20.775023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7f2124b3-dc42-4606-984e-593e9b27eef6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:20.777644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7f2124b3-dc42-4606-984e-593e9b27eef6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:20.784880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f2124b3-dc42-4606-984e-593e9b27eef6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:20.785345 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f2124b3-dc42-4606-984e-593e9b27eef6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:20.785801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f2124b3-dc42-4606-984e-593e9b27eef6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:20.786556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f2124b3-dc42-4606-984e-593e9b27eef6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:20.786986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f2124b3-dc42-4606-984e-593e9b27eef6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:20.787410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f2124b3-dc42-4606-984e-593e9b27eef6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:20.818777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7f2124b3-dc42-4606-984e-593e9b27eef6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048625 Sep 13 20:05:20.819369 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 440/766] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:21.832084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-95a765f1-4d69-4a8c-bfd0-06b9759f451e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:21.834236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-95a765f1-4d69-4a8c-bfd0-06b9759f451e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:21.841125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-95a765f1-4d69-4a8c-bfd0-06b9759f451e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:21.841592 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-95a765f1-4d69-4a8c-bfd0-06b9759f451e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:21.842030 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-95a765f1-4d69-4a8c-bfd0-06b9759f451e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:21.842761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-95a765f1-4d69-4a8c-bfd0-06b9759f451e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:21.843211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-95a765f1-4d69-4a8c-bfd0-06b9759f451e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:21.843631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-95a765f1-4d69-4a8c-bfd0-06b9759f451e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:21.875654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-95a765f1-4d69-4a8c-bfd0-06b9759f451e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047602 Sep 13 20:05:21.876234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 327/767] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:22.889471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-11986024-1933-4bf0-86a7-52ab3d23abca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:22.892409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-11986024-1933-4bf0-86a7-52ab3d23abca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:22.899728 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11986024-1933-4bf0-86a7-52ab3d23abca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:22.900208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11986024-1933-4bf0-86a7-52ab3d23abca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:22.900629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11986024-1933-4bf0-86a7-52ab3d23abca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:22.901325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11986024-1933-4bf0-86a7-52ab3d23abca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:22.901762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11986024-1933-4bf0-86a7-52ab3d23abca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:22.902177 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11986024-1933-4bf0-86a7-52ab3d23abca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:22.933580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-11986024-1933-4bf0-86a7-52ab3d23abca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048290 Sep 13 20:05:22.934153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 441/768] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:22 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:23.947767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-249bbfb5-8c58-4350-a6cc-dbbe9391a2ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:23.949940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-249bbfb5-8c58-4350-a6cc-dbbe9391a2ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:23.957080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-249bbfb5-8c58-4350-a6cc-dbbe9391a2ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:23.957560 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-249bbfb5-8c58-4350-a6cc-dbbe9391a2ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:23.957996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-249bbfb5-8c58-4350-a6cc-dbbe9391a2ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:23.958766 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-249bbfb5-8c58-4350-a6cc-dbbe9391a2ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:23.959223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-249bbfb5-8c58-4350-a6cc-dbbe9391a2ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:23.959649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-249bbfb5-8c58-4350-a6cc-dbbe9391a2ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:23.990383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-249bbfb5-8c58-4350-a6cc-dbbe9391a2ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047029 Sep 13 20:05:23.990968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 328/769] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:23 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:25.004697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a56a0786-77b5-4c00-ad1d-7697182736e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:25.006853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a56a0786-77b5-4c00-ad1d-7697182736e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:25.013733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a56a0786-77b5-4c00-ad1d-7697182736e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:25.014359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a56a0786-77b5-4c00-ad1d-7697182736e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:25.014810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a56a0786-77b5-4c00-ad1d-7697182736e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:25.015536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a56a0786-77b5-4c00-ad1d-7697182736e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:25.015959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a56a0786-77b5-4c00-ad1d-7697182736e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:25.016372 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a56a0786-77b5-4c00-ad1d-7697182736e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:25.059995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a56a0786-77b5-4c00-ad1d-7697182736e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058938 Sep 13 20:05:25.060593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 442/770] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:26.076396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ebb8618e-8145-464c-8f33-be691e6c84ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:26.078571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ebb8618e-8145-464c-8f33-be691e6c84ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:26.085046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebb8618e-8145-464c-8f33-be691e6c84ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:26.085548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebb8618e-8145-464c-8f33-be691e6c84ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:26.085984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebb8618e-8145-464c-8f33-be691e6c84ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:26.086725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebb8618e-8145-464c-8f33-be691e6c84ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:26.087177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebb8618e-8145-464c-8f33-be691e6c84ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:26.087604 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ebb8618e-8145-464c-8f33-be691e6c84ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:26.118631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ebb8618e-8145-464c-8f33-be691e6c84ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046889 Sep 13 20:05:26.119191 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 329/771] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:27.132532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-98f1560e-8df2-4987-b606-2f5b48c00729 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:27.134690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-98f1560e-8df2-4987-b606-2f5b48c00729 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:27.141761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-98f1560e-8df2-4987-b606-2f5b48c00729 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:27.142239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-98f1560e-8df2-4987-b606-2f5b48c00729 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:27.142698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-98f1560e-8df2-4987-b606-2f5b48c00729 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:27.143377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-98f1560e-8df2-4987-b606-2f5b48c00729 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:27.143819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-98f1560e-8df2-4987-b606-2f5b48c00729 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:27.144230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-98f1560e-8df2-4987-b606-2f5b48c00729 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:27.176376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-98f1560e-8df2-4987-b606-2f5b48c00729 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047828 Sep 13 20:05:27.176907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 443/772] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:27 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:28.190471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8ff1c45d-27af-41fe-bf9c-b0bd703f7716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:28.192531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8ff1c45d-27af-41fe-bf9c-b0bd703f7716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:28.199848 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8ff1c45d-27af-41fe-bf9c-b0bd703f7716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:28.200328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8ff1c45d-27af-41fe-bf9c-b0bd703f7716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:28.200756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8ff1c45d-27af-41fe-bf9c-b0bd703f7716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:28.201437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8ff1c45d-27af-41fe-bf9c-b0bd703f7716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:28.201880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8ff1c45d-27af-41fe-bf9c-b0bd703f7716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:28.202300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8ff1c45d-27af-41fe-bf9c-b0bd703f7716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:28.231668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8ff1c45d-27af-41fe-bf9c-b0bd703f7716 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045446 Sep 13 20:05:28.232215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 330/773] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:29.245506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-52d36ac2-6354-48aa-a417-eb7e41a40fea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:29.247746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-52d36ac2-6354-48aa-a417-eb7e41a40fea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:29.254652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52d36ac2-6354-48aa-a417-eb7e41a40fea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:29.255126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52d36ac2-6354-48aa-a417-eb7e41a40fea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:29.255545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52d36ac2-6354-48aa-a417-eb7e41a40fea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:29.256218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52d36ac2-6354-48aa-a417-eb7e41a40fea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:29.256664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52d36ac2-6354-48aa-a417-eb7e41a40fea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:29.257068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52d36ac2-6354-48aa-a417-eb7e41a40fea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:29.292819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-52d36ac2-6354-48aa-a417-eb7e41a40fea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051365 Sep 13 20:05:29.293379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 444/774] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:29 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:30.309108 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e7ef57a2-f7d4-4c70-ac4c-82380e5425e2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:30.312024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e7ef57a2-f7d4-4c70-ac4c-82380e5425e2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:30.321702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7ef57a2-f7d4-4c70-ac4c-82380e5425e2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:30.322405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7ef57a2-f7d4-4c70-ac4c-82380e5425e2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:30.323049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7ef57a2-f7d4-4c70-ac4c-82380e5425e2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:30.324045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7ef57a2-f7d4-4c70-ac4c-82380e5425e2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:30.324705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7ef57a2-f7d4-4c70-ac4c-82380e5425e2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:30.325280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7ef57a2-f7d4-4c70-ac4c-82380e5425e2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:30.355441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e7ef57a2-f7d4-4c70-ac4c-82380e5425e2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052231 Sep 13 20:05:30.356012 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 331/775] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:30 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:31.368609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f4770b08-9430-4afd-ac2a-3eedaddda5c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:31.370702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f4770b08-9430-4afd-ac2a-3eedaddda5c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:31.377569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f4770b08-9430-4afd-ac2a-3eedaddda5c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:31.378048 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f4770b08-9430-4afd-ac2a-3eedaddda5c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:31.378516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f4770b08-9430-4afd-ac2a-3eedaddda5c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:31.379203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f4770b08-9430-4afd-ac2a-3eedaddda5c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:31.379648 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f4770b08-9430-4afd-ac2a-3eedaddda5c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:31.380069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f4770b08-9430-4afd-ac2a-3eedaddda5c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:31.410888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f4770b08-9430-4afd-ac2a-3eedaddda5c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046715 Sep 13 20:05:31.411432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 445/776] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:32.428476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3157d63a-1323-4cbc-ad41-2b702a893046 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:32.430609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3157d63a-1323-4cbc-ad41-2b702a893046 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:32.437515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3157d63a-1323-4cbc-ad41-2b702a893046 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:32.437993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3157d63a-1323-4cbc-ad41-2b702a893046 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:32.438437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3157d63a-1323-4cbc-ad41-2b702a893046 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:32.439119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3157d63a-1323-4cbc-ad41-2b702a893046 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:32.439565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3157d63a-1323-4cbc-ad41-2b702a893046 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:32.439982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3157d63a-1323-4cbc-ad41-2b702a893046 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:32.470942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3157d63a-1323-4cbc-ad41-2b702a893046 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046607 Sep 13 20:05:32.471492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 332/777] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:33.486859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c1169c30-2e52-490e-9ea9-c3be602d4ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:33.489656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c1169c30-2e52-490e-9ea9-c3be602d4ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:33.497907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1169c30-2e52-490e-9ea9-c3be602d4ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:33.498634 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1169c30-2e52-490e-9ea9-c3be602d4ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:33.499239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1169c30-2e52-490e-9ea9-c3be602d4ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:33.500318 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1169c30-2e52-490e-9ea9-c3be602d4ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:33.500938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1169c30-2e52-490e-9ea9-c3be602d4ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:33.501360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1169c30-2e52-490e-9ea9-c3be602d4ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:33.534769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c1169c30-2e52-490e-9ea9-c3be602d4ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054413 Sep 13 20:05:33.535336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 446/778] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:34.548229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9d7e077a-9007-4ccc-99ce-7e71a0183ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:34.550298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9d7e077a-9007-4ccc-99ce-7e71a0183ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:34.557300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d7e077a-9007-4ccc-99ce-7e71a0183ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:34.557784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d7e077a-9007-4ccc-99ce-7e71a0183ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:34.558219 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d7e077a-9007-4ccc-99ce-7e71a0183ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:34.558959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d7e077a-9007-4ccc-99ce-7e71a0183ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:34.559406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d7e077a-9007-4ccc-99ce-7e71a0183ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:34.559833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d7e077a-9007-4ccc-99ce-7e71a0183ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:34.591020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9d7e077a-9007-4ccc-99ce-7e71a0183ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046994 Sep 13 20:05:34.591944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 333/779] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:34 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:35.603299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e1b11dd7-6897-457f-95bd-17e52e2ec568 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:35.605488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e1b11dd7-6897-457f-95bd-17e52e2ec568 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:35.612553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1b11dd7-6897-457f-95bd-17e52e2ec568 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:35.613067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1b11dd7-6897-457f-95bd-17e52e2ec568 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:35.613512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1b11dd7-6897-457f-95bd-17e52e2ec568 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:35.614320 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1b11dd7-6897-457f-95bd-17e52e2ec568 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:35.614955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1b11dd7-6897-457f-95bd-17e52e2ec568 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:35.615455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1b11dd7-6897-457f-95bd-17e52e2ec568 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:35.647209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e1b11dd7-6897-457f-95bd-17e52e2ec568 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047915 Sep 13 20:05:35.647772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 447/780] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:35 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:36.659754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-082072af-cbcf-4cfd-a2e9-a68049afa049 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:36.661804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-082072af-cbcf-4cfd-a2e9-a68049afa049 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:36.668757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-082072af-cbcf-4cfd-a2e9-a68049afa049 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:36.669382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-082072af-cbcf-4cfd-a2e9-a68049afa049 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:36.669694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-082072af-cbcf-4cfd-a2e9-a68049afa049 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:36.670412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-082072af-cbcf-4cfd-a2e9-a68049afa049 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:36.670854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-082072af-cbcf-4cfd-a2e9-a68049afa049 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:36.671274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-082072af-cbcf-4cfd-a2e9-a68049afa049 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:36.703207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-082072af-cbcf-4cfd-a2e9-a68049afa049 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047608 Sep 13 20:05:36.703770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 334/781] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:37.717138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bb673163-3bb2-4724-9b59-1092cdd3627d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:37.719493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bb673163-3bb2-4724-9b59-1092cdd3627d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:37.726893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bb673163-3bb2-4724-9b59-1092cdd3627d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:37.727969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bb673163-3bb2-4724-9b59-1092cdd3627d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:37.727969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bb673163-3bb2-4724-9b59-1092cdd3627d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:37.728585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bb673163-3bb2-4724-9b59-1092cdd3627d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:37.729082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bb673163-3bb2-4724-9b59-1092cdd3627d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:37.729545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bb673163-3bb2-4724-9b59-1092cdd3627d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:37.760100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bb673163-3bb2-4724-9b59-1092cdd3627d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047642 Sep 13 20:05:37.760570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 448/782] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:38.775996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6a534326-40db-4cc7-8eea-a6a0cf9196ea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:38.779041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6a534326-40db-4cc7-8eea-a6a0cf9196ea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:38.786755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a534326-40db-4cc7-8eea-a6a0cf9196ea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:38.787234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a534326-40db-4cc7-8eea-a6a0cf9196ea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:38.787670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a534326-40db-4cc7-8eea-a6a0cf9196ea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:38.788358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a534326-40db-4cc7-8eea-a6a0cf9196ea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:38.788809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a534326-40db-4cc7-8eea-a6a0cf9196ea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:38.789233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a534326-40db-4cc7-8eea-a6a0cf9196ea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:38.819153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6a534326-40db-4cc7-8eea-a6a0cf9196ea tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049582 Sep 13 20:05:38.820099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 335/783] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:39.835399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1e69f168-b48e-4bdc-b19b-5c5572a505fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:39.838316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1e69f168-b48e-4bdc-b19b-5c5572a505fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:39.841711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=30 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:39.849258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e69f168-b48e-4bdc-b19b-5c5572a505fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:39.849880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e69f168-b48e-4bdc-b19b-5c5572a505fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:39.850463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e69f168-b48e-4bdc-b19b-5c5572a505fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:39.851514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e69f168-b48e-4bdc-b19b-5c5572a505fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:39.852161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e69f168-b48e-4bdc-b19b-5c5572a505fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:39.852715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e69f168-b48e-4bdc-b19b-5c5572a505fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:39.856622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=90 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:39.885387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1e69f168-b48e-4bdc-b19b-5c5572a505fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055823 Sep 13 20:05:39.886051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 449/784] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:40.898265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c708a95b-0c51-4045-a131-c942bd703c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:40.900462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c708a95b-0c51-4045-a131-c942bd703c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:40.902892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=30 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:40.908203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c708a95b-0c51-4045-a131-c942bd703c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:40.908677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c708a95b-0c51-4045-a131-c942bd703c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:40.909111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c708a95b-0c51-4045-a131-c942bd703c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:40.909808 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c708a95b-0c51-4045-a131-c942bd703c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:40.910258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c708a95b-0c51-4045-a131-c942bd703c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:40.910713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c708a95b-0c51-4045-a131-c942bd703c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:40.913527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=90 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:40.942147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c708a95b-0c51-4045-a131-c942bd703c77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047901 Sep 13 20:05:40.942781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 336/785] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:41.955674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3b0e6c10-e59f-4042-8397-d16dfd5dff82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:41.957959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3b0e6c10-e59f-4042-8397-d16dfd5dff82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:41.965412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b0e6c10-e59f-4042-8397-d16dfd5dff82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:41.965894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b0e6c10-e59f-4042-8397-d16dfd5dff82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:41.966324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b0e6c10-e59f-4042-8397-d16dfd5dff82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:41.967051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b0e6c10-e59f-4042-8397-d16dfd5dff82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:41.967503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b0e6c10-e59f-4042-8397-d16dfd5dff82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:41.967918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b0e6c10-e59f-4042-8397-d16dfd5dff82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:41.997640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3b0e6c10-e59f-4042-8397-d16dfd5dff82 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045948 Sep 13 20:05:41.998102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 450/786] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:41 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:43.011810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5f9d4fb7-e04f-4cdb-918d-9f6dad4423f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:43.013962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5f9d4fb7-e04f-4cdb-918d-9f6dad4423f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:43.021137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f9d4fb7-e04f-4cdb-918d-9f6dad4423f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:43.021614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f9d4fb7-e04f-4cdb-918d-9f6dad4423f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:43.022040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f9d4fb7-e04f-4cdb-918d-9f6dad4423f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:43.022757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f9d4fb7-e04f-4cdb-918d-9f6dad4423f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:43.023231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f9d4fb7-e04f-4cdb-918d-9f6dad4423f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:43.023607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f9d4fb7-e04f-4cdb-918d-9f6dad4423f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:43.053365 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5f9d4fb7-e04f-4cdb-918d-9f6dad4423f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045525 Sep 13 20:05:43.053828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 337/787] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:44.068116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fc0f0c09-3920-408d-8b4f-14852299484e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:44.070622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fc0f0c09-3920-408d-8b4f-14852299484e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:44.076974 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc0f0c09-3920-408d-8b4f-14852299484e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:44.077459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc0f0c09-3920-408d-8b4f-14852299484e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:44.077879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc0f0c09-3920-408d-8b4f-14852299484e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:44.078607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc0f0c09-3920-408d-8b4f-14852299484e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:44.079053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc0f0c09-3920-408d-8b4f-14852299484e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:44.079465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc0f0c09-3920-408d-8b4f-14852299484e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:44.109732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fc0f0c09-3920-408d-8b4f-14852299484e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046614 Sep 13 20:05:44.110258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 451/788] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:45.126099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7e1b403f-7c9f-4061-b92b-d51c56659d61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:45.128313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7e1b403f-7c9f-4061-b92b-d51c56659d61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:45.135748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e1b403f-7c9f-4061-b92b-d51c56659d61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:45.136182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e1b403f-7c9f-4061-b92b-d51c56659d61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:45.136603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e1b403f-7c9f-4061-b92b-d51c56659d61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:45.137313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e1b403f-7c9f-4061-b92b-d51c56659d61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:45.137800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e1b403f-7c9f-4061-b92b-d51c56659d61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:45.138188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e1b403f-7c9f-4061-b92b-d51c56659d61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:45.169108 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7e1b403f-7c9f-4061-b92b-d51c56659d61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047067 Sep 13 20:05:45.169670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 338/789] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:46.182152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0b621c35-8c79-41b5-9f85-0166ec2871fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:46.184309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0b621c35-8c79-41b5-9f85-0166ec2871fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:46.187106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:05:46.187270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:05:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments (ip 10.222.0.52) !!! Sep 13 20:05:46.196678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b621c35-8c79-41b5-9f85-0166ec2871fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:46.197157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b621c35-8c79-41b5-9f85-0166ec2871fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:46.197590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b621c35-8c79-41b5-9f85-0166ec2871fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:46.198308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b621c35-8c79-41b5-9f85-0166ec2871fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:46.198831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b621c35-8c79-41b5-9f85-0166ec2871fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:46.199252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b621c35-8c79-41b5-9f85-0166ec2871fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:46.229965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0b621c35-8c79-41b5-9f85-0166ec2871fd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051832 Sep 13 20:05:46.230610 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 452/790] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:47.250652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d2251498-1d68-4e0c-961a-b306052beffd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:47.253891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d2251498-1d68-4e0c-961a-b306052beffd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:47.257814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:05:47.258038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:05:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments (ip 10.222.0.52) !!! Sep 13 20:05:47.259504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:05:47.259654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:05:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments (ip 10.222.0.52) !!! Sep 13 20:05:47.270712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2251498-1d68-4e0c-961a-b306052beffd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:47.270981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2251498-1d68-4e0c-961a-b306052beffd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:47.271446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2251498-1d68-4e0c-961a-b306052beffd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:47.272127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2251498-1d68-4e0c-961a-b306052beffd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:47.272584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2251498-1d68-4e0c-961a-b306052beffd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:47.272994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2251498-1d68-4e0c-961a-b306052beffd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:47.304482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d2251498-1d68-4e0c-961a-b306052beffd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063714 Sep 13 20:05:47.305033 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 339/791] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:47 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:48.317768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9a3f60e7-a623-4fdc-858c-7ed9e79a1753 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:48.320403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9a3f60e7-a623-4fdc-858c-7ed9e79a1753 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:48.327484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a3f60e7-a623-4fdc-858c-7ed9e79a1753 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:48.327966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a3f60e7-a623-4fdc-858c-7ed9e79a1753 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:48.328394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a3f60e7-a623-4fdc-858c-7ed9e79a1753 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:48.329083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a3f60e7-a623-4fdc-858c-7ed9e79a1753 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:48.329537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a3f60e7-a623-4fdc-858c-7ed9e79a1753 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:48.329955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a3f60e7-a623-4fdc-858c-7ed9e79a1753 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:48.360948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9a3f60e7-a623-4fdc-858c-7ed9e79a1753 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047311 Sep 13 20:05:48.361496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 453/792] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:48 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:49.380073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3dd51fcb-c4c8-4601-9b88-09065f9a1f69 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:49.382156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3dd51fcb-c4c8-4601-9b88-09065f9a1f69 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:49.389095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3dd51fcb-c4c8-4601-9b88-09065f9a1f69 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:49.389636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3dd51fcb-c4c8-4601-9b88-09065f9a1f69 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:49.390009 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3dd51fcb-c4c8-4601-9b88-09065f9a1f69 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:49.390747 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3dd51fcb-c4c8-4601-9b88-09065f9a1f69 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:49.391194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3dd51fcb-c4c8-4601-9b88-09065f9a1f69 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:49.391624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3dd51fcb-c4c8-4601-9b88-09065f9a1f69 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:49.427071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3dd51fcb-c4c8-4601-9b88-09065f9a1f69 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052222 Sep 13 20:05:49.427817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 340/793] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:50.441608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-94f9105a-3e1b-4d78-a671-3a9a780f3eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:50.445469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-94f9105a-3e1b-4d78-a671-3a9a780f3eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:50.452593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-94f9105a-3e1b-4d78-a671-3a9a780f3eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:50.453069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-94f9105a-3e1b-4d78-a671-3a9a780f3eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:50.453495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-94f9105a-3e1b-4d78-a671-3a9a780f3eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:50.454176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-94f9105a-3e1b-4d78-a671-3a9a780f3eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:50.454625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-94f9105a-3e1b-4d78-a671-3a9a780f3eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:50.455038 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-94f9105a-3e1b-4d78-a671-3a9a780f3eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:50.492585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-94f9105a-3e1b-4d78-a671-3a9a780f3eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055121 Sep 13 20:05:50.493153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 454/794] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:51.508227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-eb401000-7639-4e5d-99dc-1ab55137a8f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:51.510395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-eb401000-7639-4e5d-99dc-1ab55137a8f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:51.517382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb401000-7639-4e5d-99dc-1ab55137a8f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:51.517857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb401000-7639-4e5d-99dc-1ab55137a8f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:51.518284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb401000-7639-4e5d-99dc-1ab55137a8f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:51.518985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb401000-7639-4e5d-99dc-1ab55137a8f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:51.519445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb401000-7639-4e5d-99dc-1ab55137a8f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:51.519861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb401000-7639-4e5d-99dc-1ab55137a8f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:51.552196 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-eb401000-7639-4e5d-99dc-1ab55137a8f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047987 Sep 13 20:05:51.552752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 341/795] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:52.565797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3d5b673b-557b-4279-8bc2-372f381618b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:52.568010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3d5b673b-557b-4279-8bc2-372f381618b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:52.575694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d5b673b-557b-4279-8bc2-372f381618b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:52.576181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d5b673b-557b-4279-8bc2-372f381618b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:52.576649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d5b673b-557b-4279-8bc2-372f381618b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:52.577322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d5b673b-557b-4279-8bc2-372f381618b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:52.577776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d5b673b-557b-4279-8bc2-372f381618b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:52.578196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d5b673b-557b-4279-8bc2-372f381618b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:52.608847 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3d5b673b-557b-4279-8bc2-372f381618b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047125 Sep 13 20:05:52.609405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 455/796] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:53.623427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-750e202c-3c18-4478-9679-f7c8faf98b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:53.626212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-750e202c-3c18-4478-9679-f7c8faf98b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:53.634874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-750e202c-3c18-4478-9679-f7c8faf98b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:53.635364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-750e202c-3c18-4478-9679-f7c8faf98b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:53.635807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-750e202c-3c18-4478-9679-f7c8faf98b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:53.636530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-750e202c-3c18-4478-9679-f7c8faf98b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:53.637054 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-750e202c-3c18-4478-9679-f7c8faf98b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:53.637480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-750e202c-3c18-4478-9679-f7c8faf98b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:53.668577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-750e202c-3c18-4478-9679-f7c8faf98b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050753 Sep 13 20:05:53.669132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 342/797] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:53 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:54.681811 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-71b739a3-8279-44e8-9384-5c376a9d5e3c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:54.684059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-71b739a3-8279-44e8-9384-5c376a9d5e3c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:54.691194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-71b739a3-8279-44e8-9384-5c376a9d5e3c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:54.691679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-71b739a3-8279-44e8-9384-5c376a9d5e3c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:54.692088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-71b739a3-8279-44e8-9384-5c376a9d5e3c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:54.692782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-71b739a3-8279-44e8-9384-5c376a9d5e3c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:54.693221 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-71b739a3-8279-44e8-9384-5c376a9d5e3c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:54.694004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-71b739a3-8279-44e8-9384-5c376a9d5e3c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:54.724292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-71b739a3-8279-44e8-9384-5c376a9d5e3c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046647 Sep 13 20:05:54.724879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 456/798] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:54 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:55.740205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7b8aa667-d8c2-4b4c-a06a-10b491e30cf8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:55.743351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7b8aa667-d8c2-4b4c-a06a-10b491e30cf8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:55.752729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b8aa667-d8c2-4b4c-a06a-10b491e30cf8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:55.753402 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b8aa667-d8c2-4b4c-a06a-10b491e30cf8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:55.754035 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b8aa667-d8c2-4b4c-a06a-10b491e30cf8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:55.755063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b8aa667-d8c2-4b4c-a06a-10b491e30cf8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:55.755713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b8aa667-d8c2-4b4c-a06a-10b491e30cf8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:55.756313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b8aa667-d8c2-4b4c-a06a-10b491e30cf8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:55.788029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7b8aa667-d8c2-4b4c-a06a-10b491e30cf8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053587 Sep 13 20:05:55.788590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 343/799] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:56.804987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-690be288-f942-4316-b70b-0c66fe6cdcb4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:56.807412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-690be288-f942-4316-b70b-0c66fe6cdcb4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:56.814183 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-690be288-f942-4316-b70b-0c66fe6cdcb4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:56.814731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-690be288-f942-4316-b70b-0c66fe6cdcb4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:56.815160 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-690be288-f942-4316-b70b-0c66fe6cdcb4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:56.815828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-690be288-f942-4316-b70b-0c66fe6cdcb4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:56.816276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-690be288-f942-4316-b70b-0c66fe6cdcb4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:56.816722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-690be288-f942-4316-b70b-0c66fe6cdcb4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:56.848923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-690be288-f942-4316-b70b-0c66fe6cdcb4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050424 Sep 13 20:05:56.849471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 457/800] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:57.866488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dd8d7d2a-18b1-4142-8876-362cb19d9600 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:57.868789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dd8d7d2a-18b1-4142-8876-362cb19d9600 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:57.875581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd8d7d2a-18b1-4142-8876-362cb19d9600 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:57.876063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd8d7d2a-18b1-4142-8876-362cb19d9600 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:57.876499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd8d7d2a-18b1-4142-8876-362cb19d9600 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:57.877188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd8d7d2a-18b1-4142-8876-362cb19d9600 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:57.877640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd8d7d2a-18b1-4142-8876-362cb19d9600 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:57.878059 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd8d7d2a-18b1-4142-8876-362cb19d9600 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:57.908643 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dd8d7d2a-18b1-4142-8876-362cb19d9600 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047705 Sep 13 20:05:57.909199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 344/801] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:58.921502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-afa8f10e-7828-4587-bb48-e9f5313a9040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:58.923712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-afa8f10e-7828-4587-bb48-e9f5313a9040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:58.932361 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-afa8f10e-7828-4587-bb48-e9f5313a9040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:58.933010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-afa8f10e-7828-4587-bb48-e9f5313a9040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:58.933582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-afa8f10e-7828-4587-bb48-e9f5313a9040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:58.934661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-afa8f10e-7828-4587-bb48-e9f5313a9040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:58.935331 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-afa8f10e-7828-4587-bb48-e9f5313a9040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:58.935908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-afa8f10e-7828-4587-bb48-e9f5313a9040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:58.968319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-afa8f10e-7828-4587-bb48-e9f5313a9040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051040 Sep 13 20:05:58.968863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 458/802] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:05:59.982628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a03d73b3-55c8-4641-922f-d38c41bd5b1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:59.985020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a03d73b3-55c8-4641-922f-d38c41bd5b1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:59.992109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a03d73b3-55c8-4641-922f-d38c41bd5b1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:59.992653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a03d73b3-55c8-4641-922f-d38c41bd5b1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:59.993191 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a03d73b3-55c8-4641-922f-d38c41bd5b1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:59.993856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a03d73b3-55c8-4641-922f-d38c41bd5b1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:59.994336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a03d73b3-55c8-4641-922f-d38c41bd5b1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:59.994792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a03d73b3-55c8-4641-922f-d38c41bd5b1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:00.024900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a03d73b3-55c8-4641-922f-d38c41bd5b1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047163 Sep 13 20:06:00.025461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 345/803] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:05:59 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:01.037923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-03936bd1-5c85-4b98-a9da-f54ed4ef6dae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:01.040260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-03936bd1-5c85-4b98-a9da-f54ed4ef6dae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:01.047110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03936bd1-5c85-4b98-a9da-f54ed4ef6dae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:01.047524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03936bd1-5c85-4b98-a9da-f54ed4ef6dae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:01.047952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03936bd1-5c85-4b98-a9da-f54ed4ef6dae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:01.048625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03936bd1-5c85-4b98-a9da-f54ed4ef6dae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:01.049098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03936bd1-5c85-4b98-a9da-f54ed4ef6dae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:01.049519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03936bd1-5c85-4b98-a9da-f54ed4ef6dae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:01.079547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-03936bd1-5c85-4b98-a9da-f54ed4ef6dae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045545 Sep 13 20:06:01.080083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 459/804] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:02.093223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4cca94a2-78c7-42ad-98d6-6e31bbeb3764 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:02.095536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4cca94a2-78c7-42ad-98d6-6e31bbeb3764 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:02.102758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cca94a2-78c7-42ad-98d6-6e31bbeb3764 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:02.103270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cca94a2-78c7-42ad-98d6-6e31bbeb3764 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:02.103726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cca94a2-78c7-42ad-98d6-6e31bbeb3764 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:02.104458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cca94a2-78c7-42ad-98d6-6e31bbeb3764 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:02.104943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cca94a2-78c7-42ad-98d6-6e31bbeb3764 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:02.105383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cca94a2-78c7-42ad-98d6-6e31bbeb3764 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:02.136603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4cca94a2-78c7-42ad-98d6-6e31bbeb3764 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047671 Sep 13 20:06:02.137169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 346/805] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:03.150648 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-84854428-52df-4188-a0e0-53bd5a5b09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:03.152835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-84854428-52df-4188-a0e0-53bd5a5b09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:03.159841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-84854428-52df-4188-a0e0-53bd5a5b09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:03.160317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-84854428-52df-4188-a0e0-53bd5a5b09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:03.160737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-84854428-52df-4188-a0e0-53bd5a5b09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:03.161421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-84854428-52df-4188-a0e0-53bd5a5b09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:03.161858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-84854428-52df-4188-a0e0-53bd5a5b09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:03.162268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-84854428-52df-4188-a0e0-53bd5a5b09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:03.192407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-84854428-52df-4188-a0e0-53bd5a5b09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045893 Sep 13 20:06:03.193265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 460/806] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:04.205908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d0a15c96-2b95-4a3c-9dd9-e730b08304cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:04.208080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d0a15c96-2b95-4a3c-9dd9-e730b08304cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:04.215011 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0a15c96-2b95-4a3c-9dd9-e730b08304cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:04.215492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0a15c96-2b95-4a3c-9dd9-e730b08304cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:04.215922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0a15c96-2b95-4a3c-9dd9-e730b08304cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:04.216610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0a15c96-2b95-4a3c-9dd9-e730b08304cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:04.217057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0a15c96-2b95-4a3c-9dd9-e730b08304cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:04.217475 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0a15c96-2b95-4a3c-9dd9-e730b08304cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:04.248273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d0a15c96-2b95-4a3c-9dd9-e730b08304cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046482 Sep 13 20:06:04.248821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 347/807] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:05.263932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9bc49aff-68b3-47b3-bbfb-08ad43670515 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:05.266970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9bc49aff-68b3-47b3-bbfb-08ad43670515 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:05.275962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9bc49aff-68b3-47b3-bbfb-08ad43670515 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:05.276432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9bc49aff-68b3-47b3-bbfb-08ad43670515 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:05.276854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9bc49aff-68b3-47b3-bbfb-08ad43670515 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:05.277535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9bc49aff-68b3-47b3-bbfb-08ad43670515 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:05.278066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9bc49aff-68b3-47b3-bbfb-08ad43670515 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:05.278509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9bc49aff-68b3-47b3-bbfb-08ad43670515 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:05.311770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9bc49aff-68b3-47b3-bbfb-08ad43670515 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053791 Sep 13 20:06:05.312629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 461/808] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:06.326942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5cf9d2de-0889-4dce-a198-909023704e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:06.329491 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5cf9d2de-0889-4dce-a198-909023704e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:06.337578 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cf9d2de-0889-4dce-a198-909023704e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:06.338078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cf9d2de-0889-4dce-a198-909023704e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:06.338642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cf9d2de-0889-4dce-a198-909023704e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:06.339458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cf9d2de-0889-4dce-a198-909023704e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:06.339987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cf9d2de-0889-4dce-a198-909023704e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:06.340482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cf9d2de-0889-4dce-a198-909023704e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:06.372242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5cf9d2de-0889-4dce-a198-909023704e4e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050132 Sep 13 20:06:06.372790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 348/809] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:06 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:07.388586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-aefb85d0-7551-4424-8b21-04fce1589abb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:07.391927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-aefb85d0-7551-4424-8b21-04fce1589abb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:07.401128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aefb85d0-7551-4424-8b21-04fce1589abb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:07.401605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aefb85d0-7551-4424-8b21-04fce1589abb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:07.402037 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aefb85d0-7551-4424-8b21-04fce1589abb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:07.402789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aefb85d0-7551-4424-8b21-04fce1589abb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:07.403287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aefb85d0-7551-4424-8b21-04fce1589abb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:07.403817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aefb85d0-7551-4424-8b21-04fce1589abb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:07.435707 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-aefb85d0-7551-4424-8b21-04fce1589abb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053403 Sep 13 20:06:07.436257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 462/810] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:08.450404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-69c39511-1dbd-456c-a0d5-d0cde105c761 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:08.452596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-69c39511-1dbd-456c-a0d5-d0cde105c761 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:08.459743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-69c39511-1dbd-456c-a0d5-d0cde105c761 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:08.460235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-69c39511-1dbd-456c-a0d5-d0cde105c761 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:08.460670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-69c39511-1dbd-456c-a0d5-d0cde105c761 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:08.461363 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-69c39511-1dbd-456c-a0d5-d0cde105c761 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:08.461810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-69c39511-1dbd-456c-a0d5-d0cde105c761 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:08.462235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-69c39511-1dbd-456c-a0d5-d0cde105c761 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:08.493684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-69c39511-1dbd-456c-a0d5-d0cde105c761 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048437 Sep 13 20:06:08.494247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 349/811] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:09.508531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-376c820c-f2d4-4849-babf-5858023f17de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:09.511840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-376c820c-f2d4-4849-babf-5858023f17de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:09.521715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-376c820c-f2d4-4849-babf-5858023f17de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:09.522508 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-376c820c-f2d4-4849-babf-5858023f17de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:09.523096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-376c820c-f2d4-4849-babf-5858023f17de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:09.524223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-376c820c-f2d4-4849-babf-5858023f17de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:09.524927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-376c820c-f2d4-4849-babf-5858023f17de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:09.525569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-376c820c-f2d4-4849-babf-5858023f17de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:09.556417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-376c820c-f2d4-4849-babf-5858023f17de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053222 Sep 13 20:06:09.556979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 463/812] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:10.572509 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2eabc796-f1c0-42b3-a343-b60841b2c252 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:10.574540 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2eabc796-f1c0-42b3-a343-b60841b2c252 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:10.581386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eabc796-f1c0-42b3-a343-b60841b2c252 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:10.581863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eabc796-f1c0-42b3-a343-b60841b2c252 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:10.582290 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eabc796-f1c0-42b3-a343-b60841b2c252 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:10.583008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eabc796-f1c0-42b3-a343-b60841b2c252 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:10.583449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eabc796-f1c0-42b3-a343-b60841b2c252 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:10.583862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eabc796-f1c0-42b3-a343-b60841b2c252 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:10.613787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2eabc796-f1c0-42b3-a343-b60841b2c252 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045823 Sep 13 20:06:10.614345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 350/813] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:11.629422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dff54199-93f4-42f0-94ff-8baf7f3b425c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:11.632245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dff54199-93f4-42f0-94ff-8baf7f3b425c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:11.635710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=30 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:11.641401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dff54199-93f4-42f0-94ff-8baf7f3b425c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:11.641924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dff54199-93f4-42f0-94ff-8baf7f3b425c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:11.642440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dff54199-93f4-42f0-94ff-8baf7f3b425c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:11.643475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dff54199-93f4-42f0-94ff-8baf7f3b425c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:11.644082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dff54199-93f4-42f0-94ff-8baf7f3b425c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:11.644606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dff54199-93f4-42f0-94ff-8baf7f3b425c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:11.647410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=90 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:11.681910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dff54199-93f4-42f0-94ff-8baf7f3b425c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058709 Sep 13 20:06:11.682517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 464/814] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:11 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:12.699129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1008352f-aab7-4086-ad25-411afbfa7cb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:12.702408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1008352f-aab7-4086-ad25-411afbfa7cb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:12.706030 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=30 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:12.714263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1008352f-aab7-4086-ad25-411afbfa7cb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:12.715079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1008352f-aab7-4086-ad25-411afbfa7cb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:12.715784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1008352f-aab7-4086-ad25-411afbfa7cb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:12.716475 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1008352f-aab7-4086-ad25-411afbfa7cb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:12.716923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1008352f-aab7-4086-ad25-411afbfa7cb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:12.717340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1008352f-aab7-4086-ad25-411afbfa7cb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:12.719972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=90 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:12.757068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1008352f-aab7-4086-ad25-411afbfa7cb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064796 Sep 13 20:06:12.757626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 351/815] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:13.773846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1939f037-8cf7-42a6-8240-88104600750a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:13.776813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1939f037-8cf7-42a6-8240-88104600750a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:13.785702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1939f037-8cf7-42a6-8240-88104600750a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:13.786340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1939f037-8cf7-42a6-8240-88104600750a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:13.786971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1939f037-8cf7-42a6-8240-88104600750a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:13.788007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1939f037-8cf7-42a6-8240-88104600750a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:13.788650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1939f037-8cf7-42a6-8240-88104600750a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:13.789250 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1939f037-8cf7-42a6-8240-88104600750a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:13.822129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1939f037-8cf7-42a6-8240-88104600750a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054713 Sep 13 20:06:13.822722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 465/816] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:14.837488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5825a3d0-51a6-4416-972b-3304cb9223b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:14.840554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5825a3d0-51a6-4416-972b-3304cb9223b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:14.848072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5825a3d0-51a6-4416-972b-3304cb9223b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:14.848556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5825a3d0-51a6-4416-972b-3304cb9223b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:14.848977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5825a3d0-51a6-4416-972b-3304cb9223b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:14.849661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5825a3d0-51a6-4416-972b-3304cb9223b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:14.850101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5825a3d0-51a6-4416-972b-3304cb9223b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:14.850552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5825a3d0-51a6-4416-972b-3304cb9223b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:14.879945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5825a3d0-51a6-4416-972b-3304cb9223b8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048430 Sep 13 20:06:14.880503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 352/817] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:15.893625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-032eb90a-dd87-4afe-b555-814678b8deac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:15.895817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-032eb90a-dd87-4afe-b555-814678b8deac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:15.902421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-032eb90a-dd87-4afe-b555-814678b8deac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:15.902905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-032eb90a-dd87-4afe-b555-814678b8deac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:15.903401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-032eb90a-dd87-4afe-b555-814678b8deac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:15.904091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-032eb90a-dd87-4afe-b555-814678b8deac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:15.904567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-032eb90a-dd87-4afe-b555-814678b8deac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:15.904986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-032eb90a-dd87-4afe-b555-814678b8deac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:15.936466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-032eb90a-dd87-4afe-b555-814678b8deac tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047298 Sep 13 20:06:15.937029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 466/818] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:16.949967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-910b4861-0d7b-400c-bdf8-27829313931c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:16.952225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-910b4861-0d7b-400c-bdf8-27829313931c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:16.958386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-910b4861-0d7b-400c-bdf8-27829313931c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:16.958881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-910b4861-0d7b-400c-bdf8-27829313931c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:16.959314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-910b4861-0d7b-400c-bdf8-27829313931c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:16.959998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-910b4861-0d7b-400c-bdf8-27829313931c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:16.960442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-910b4861-0d7b-400c-bdf8-27829313931c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:16.960864 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-910b4861-0d7b-400c-bdf8-27829313931c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:16.990400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-910b4861-0d7b-400c-bdf8-27829313931c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045040 Sep 13 20:06:16.990983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 353/819] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:16 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 20:06:18.004009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-44c71ce9-bc6c-455d-8f84-f1e6c4860fd2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:18.006280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-44c71ce9-bc6c-455d-8f84-f1e6c4860fd2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:18.013861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44c71ce9-bc6c-455d-8f84-f1e6c4860fd2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:18.014259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44c71ce9-bc6c-455d-8f84-f1e6c4860fd2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:18.014789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44c71ce9-bc6c-455d-8f84-f1e6c4860fd2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:18.015557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44c71ce9-bc6c-455d-8f84-f1e6c4860fd2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:18.016007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44c71ce9-bc6c-455d-8f84-f1e6c4860fd2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:18.016429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44c71ce9-bc6c-455d-8f84-f1e6c4860fd2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:18.048668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-44c71ce9-bc6c-455d-8f84-f1e6c4860fd2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049011 Sep 13 20:06:18.049123 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 467/820] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:17 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 20:06:19.061484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-afd1e6f5-462e-4405-a597-c6650d8ec623 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:19.063711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-afd1e6f5-462e-4405-a597-c6650d8ec623 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:19.071797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-afd1e6f5-462e-4405-a597-c6650d8ec623 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:19.072440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-afd1e6f5-462e-4405-a597-c6650d8ec623 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:19.073043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-afd1e6f5-462e-4405-a597-c6650d8ec623 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:19.074081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-afd1e6f5-462e-4405-a597-c6650d8ec623 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:19.074795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-afd1e6f5-462e-4405-a597-c6650d8ec623 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:19.075401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-afd1e6f5-462e-4405-a597-c6650d8ec623 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:19.106778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-afd1e6f5-462e-4405-a597-c6650d8ec623 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049516 Sep 13 20:06:19.107344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 354/821] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:20.119634 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2c3fb9fa-f3d7-413b-9ae5-3ebb0e4242c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:20.122329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2c3fb9fa-f3d7-413b-9ae5-3ebb0e4242c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:20.129746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c3fb9fa-f3d7-413b-9ae5-3ebb0e4242c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:20.130225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c3fb9fa-f3d7-413b-9ae5-3ebb0e4242c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:20.130653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c3fb9fa-f3d7-413b-9ae5-3ebb0e4242c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:20.131362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c3fb9fa-f3d7-413b-9ae5-3ebb0e4242c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:20.131815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c3fb9fa-f3d7-413b-9ae5-3ebb0e4242c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:20.132228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c3fb9fa-f3d7-413b-9ae5-3ebb0e4242c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:20.162999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2c3fb9fa-f3d7-413b-9ae5-3ebb0e4242c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047229 Sep 13 20:06:20.163713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 468/822] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:21.176166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c3037eb3-361a-43e4-8d08-15798692df14 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:21.178292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c3037eb3-361a-43e4-8d08-15798692df14 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:21.185401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3037eb3-361a-43e4-8d08-15798692df14 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:21.185878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3037eb3-361a-43e4-8d08-15798692df14 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:21.186310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3037eb3-361a-43e4-8d08-15798692df14 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:21.187053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3037eb3-361a-43e4-8d08-15798692df14 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:21.187501 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3037eb3-361a-43e4-8d08-15798692df14 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:21.187924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3037eb3-361a-43e4-8d08-15798692df14 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:21.220058 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c3037eb3-361a-43e4-8d08-15798692df14 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047924 Sep 13 20:06:21.220609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 355/823] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:22.233234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-50871b0a-8a98-4559-8278-9b8faaf0de24 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:22.235584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-50871b0a-8a98-4559-8278-9b8faaf0de24 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:22.243019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50871b0a-8a98-4559-8278-9b8faaf0de24 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:22.243689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50871b0a-8a98-4559-8278-9b8faaf0de24 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:22.244378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50871b0a-8a98-4559-8278-9b8faaf0de24 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:22.245476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50871b0a-8a98-4559-8278-9b8faaf0de24 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:22.246221 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50871b0a-8a98-4559-8278-9b8faaf0de24 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:22.246863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50871b0a-8a98-4559-8278-9b8faaf0de24 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:22.278034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-50871b0a-8a98-4559-8278-9b8faaf0de24 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048985 Sep 13 20:06:22.278628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 469/824] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:22 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:23.299823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-54a59edb-98e5-4a68-94a8-f7d62a8d9b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:23.301952 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-54a59edb-98e5-4a68-94a8-f7d62a8d9b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:23.308953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-54a59edb-98e5-4a68-94a8-f7d62a8d9b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:23.309436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-54a59edb-98e5-4a68-94a8-f7d62a8d9b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:23.309869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-54a59edb-98e5-4a68-94a8-f7d62a8d9b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:23.310602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-54a59edb-98e5-4a68-94a8-f7d62a8d9b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:23.311053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-54a59edb-98e5-4a68-94a8-f7d62a8d9b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:23.311479 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-54a59edb-98e5-4a68-94a8-f7d62a8d9b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:23.342568 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-54a59edb-98e5-4a68-94a8-f7d62a8d9b30 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047135 Sep 13 20:06:23.343139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 356/825] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:23 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:24.368367 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8db05077-38da-4a13-87fd-4d75fd3051a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:24.370661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8db05077-38da-4a13-87fd-4d75fd3051a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:24.377420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8db05077-38da-4a13-87fd-4d75fd3051a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:24.377902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8db05077-38da-4a13-87fd-4d75fd3051a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:24.378344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8db05077-38da-4a13-87fd-4d75fd3051a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:24.379055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8db05077-38da-4a13-87fd-4d75fd3051a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:24.379501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8db05077-38da-4a13-87fd-4d75fd3051a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:24.379918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8db05077-38da-4a13-87fd-4d75fd3051a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:24.409157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8db05077-38da-4a13-87fd-4d75fd3051a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045268 Sep 13 20:06:24.409719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 470/826] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:25.421858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a8aaa79c-138b-497c-95f5-9abd7c96fb7c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:25.424040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a8aaa79c-138b-497c-95f5-9abd7c96fb7c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:25.430898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8aaa79c-138b-497c-95f5-9abd7c96fb7c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:25.431386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8aaa79c-138b-497c-95f5-9abd7c96fb7c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:25.431945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8aaa79c-138b-497c-95f5-9abd7c96fb7c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:25.432893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8aaa79c-138b-497c-95f5-9abd7c96fb7c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:25.433375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8aaa79c-138b-497c-95f5-9abd7c96fb7c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:25.433753 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8aaa79c-138b-497c-95f5-9abd7c96fb7c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:25.466296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a8aaa79c-138b-497c-95f5-9abd7c96fb7c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048401 Sep 13 20:06:25.466893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 357/827] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:26.484793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2a017876-8d98-4d44-ac69-0702e0070c6f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:26.487005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2a017876-8d98-4d44-ac69-0702e0070c6f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:26.493736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a017876-8d98-4d44-ac69-0702e0070c6f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:26.494222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a017876-8d98-4d44-ac69-0702e0070c6f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:26.494680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a017876-8d98-4d44-ac69-0702e0070c6f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:26.495349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a017876-8d98-4d44-ac69-0702e0070c6f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:26.495808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a017876-8d98-4d44-ac69-0702e0070c6f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:26.496236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a017876-8d98-4d44-ac69-0702e0070c6f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:26.531990 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2a017876-8d98-4d44-ac69-0702e0070c6f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052838 Sep 13 20:06:26.532560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 471/828] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:27.545181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e0a539f4-5140-47b4-8716-741c4a0fddda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:27.547843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e0a539f4-5140-47b4-8716-741c4a0fddda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:27.555061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a539f4-5140-47b4-8716-741c4a0fddda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:27.555559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a539f4-5140-47b4-8716-741c4a0fddda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:27.555994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a539f4-5140-47b4-8716-741c4a0fddda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:27.556854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a539f4-5140-47b4-8716-741c4a0fddda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:27.557312 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a539f4-5140-47b4-8716-741c4a0fddda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:27.557760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a539f4-5140-47b4-8716-741c4a0fddda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:27.593889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e0a539f4-5140-47b4-8716-741c4a0fddda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052727 Sep 13 20:06:27.594515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 358/829] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:27 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:28.606201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-74aff153-554d-4175-9752-8bd8dec32e3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:28.608392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-74aff153-554d-4175-9752-8bd8dec32e3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:28.615305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74aff153-554d-4175-9752-8bd8dec32e3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:28.615787 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74aff153-554d-4175-9752-8bd8dec32e3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:28.616214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74aff153-554d-4175-9752-8bd8dec32e3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:28.616905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74aff153-554d-4175-9752-8bd8dec32e3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:28.617349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74aff153-554d-4175-9752-8bd8dec32e3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:28.617764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74aff153-554d-4175-9752-8bd8dec32e3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:28.659661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-74aff153-554d-4175-9752-8bd8dec32e3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057584 Sep 13 20:06:28.660219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 472/830] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:29.672923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8d398db2-aa5b-46f4-90eb-1e2337dd2ab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:29.675128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8d398db2-aa5b-46f4-90eb-1e2337dd2ab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:29.681346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d398db2-aa5b-46f4-90eb-1e2337dd2ab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:29.681830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d398db2-aa5b-46f4-90eb-1e2337dd2ab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:29.682265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d398db2-aa5b-46f4-90eb-1e2337dd2ab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:29.682988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d398db2-aa5b-46f4-90eb-1e2337dd2ab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:29.683441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d398db2-aa5b-46f4-90eb-1e2337dd2ab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:29.683859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d398db2-aa5b-46f4-90eb-1e2337dd2ab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:29.715846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8d398db2-aa5b-46f4-90eb-1e2337dd2ab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046883 Sep 13 20:06:29.716404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 359/831] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:29 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:30.728747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-86cd3c74-58e8-4789-9ec3-778c210ee2cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:30.730975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-86cd3c74-58e8-4789-9ec3-778c210ee2cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:30.737854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-86cd3c74-58e8-4789-9ec3-778c210ee2cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:30.738338 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-86cd3c74-58e8-4789-9ec3-778c210ee2cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:30.738781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-86cd3c74-58e8-4789-9ec3-778c210ee2cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:30.739501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-86cd3c74-58e8-4789-9ec3-778c210ee2cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:30.739973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-86cd3c74-58e8-4789-9ec3-778c210ee2cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:30.740388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-86cd3c74-58e8-4789-9ec3-778c210ee2cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:30.771117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-86cd3c74-58e8-4789-9ec3-778c210ee2cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046291 Sep 13 20:06:30.771674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 473/832] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:30 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:31.784862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-067fbc07-f022-4740-873a-33eddd98f567 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:31.787579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-067fbc07-f022-4740-873a-33eddd98f567 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:31.794415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-067fbc07-f022-4740-873a-33eddd98f567 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:31.794876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-067fbc07-f022-4740-873a-33eddd98f567 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:31.795314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-067fbc07-f022-4740-873a-33eddd98f567 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:31.796014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-067fbc07-f022-4740-873a-33eddd98f567 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:31.796471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-067fbc07-f022-4740-873a-33eddd98f567 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:31.796879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-067fbc07-f022-4740-873a-33eddd98f567 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:31.827619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-067fbc07-f022-4740-873a-33eddd98f567 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047299 Sep 13 20:06:31.828483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 360/833] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:32.842399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0d42e483-ed87-4899-972d-0581ba4342e4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:32.844605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0d42e483-ed87-4899-972d-0581ba4342e4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:32.851385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d42e483-ed87-4899-972d-0581ba4342e4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:32.851873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d42e483-ed87-4899-972d-0581ba4342e4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:32.852313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d42e483-ed87-4899-972d-0581ba4342e4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:32.853031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d42e483-ed87-4899-972d-0581ba4342e4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:32.853515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d42e483-ed87-4899-972d-0581ba4342e4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:32.853923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d42e483-ed87-4899-972d-0581ba4342e4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:32.884457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0d42e483-ed87-4899-972d-0581ba4342e4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047053 Sep 13 20:06:32.885026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 474/834] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:33.899336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b9e16499-e044-4211-83b9-d563119b56c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:33.901835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b9e16499-e044-4211-83b9-d563119b56c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:33.910651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9e16499-e044-4211-83b9-d563119b56c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:33.911134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9e16499-e044-4211-83b9-d563119b56c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:33.911564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9e16499-e044-4211-83b9-d563119b56c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:33.912262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9e16499-e044-4211-83b9-d563119b56c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:33.912703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9e16499-e044-4211-83b9-d563119b56c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:33.913301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9e16499-e044-4211-83b9-d563119b56c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:33.945147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b9e16499-e044-4211-83b9-d563119b56c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051288 Sep 13 20:06:33.945739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 361/835] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:34.958895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7106473d-e7ad-4512-b7d9-605357a2581c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:34.960985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7106473d-e7ad-4512-b7d9-605357a2581c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:34.968009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7106473d-e7ad-4512-b7d9-605357a2581c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:34.968493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7106473d-e7ad-4512-b7d9-605357a2581c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:34.968995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7106473d-e7ad-4512-b7d9-605357a2581c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:34.969602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7106473d-e7ad-4512-b7d9-605357a2581c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:34.970019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7106473d-e7ad-4512-b7d9-605357a2581c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:34.970479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7106473d-e7ad-4512-b7d9-605357a2581c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:35.001982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7106473d-e7ad-4512-b7d9-605357a2581c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047466 Sep 13 20:06:35.002636 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 475/836] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:34 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:36.018625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-84d65d2a-5e49-490c-9f91-99779ea513c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:36.021824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-84d65d2a-5e49-490c-9f91-99779ea513c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:36.032832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84d65d2a-5e49-490c-9f91-99779ea513c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:36.033700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84d65d2a-5e49-490c-9f91-99779ea513c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:36.034177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84d65d2a-5e49-490c-9f91-99779ea513c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:36.034915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84d65d2a-5e49-490c-9f91-99779ea513c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:36.035366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84d65d2a-5e49-490c-9f91-99779ea513c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:36.035969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84d65d2a-5e49-490c-9f91-99779ea513c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:36.066990 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-84d65d2a-5e49-490c-9f91-99779ea513c4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054462 Sep 13 20:06:36.067673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 362/837] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:37.084346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-80063869-4b3e-4f7c-8f8c-2b00bfa65b52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:37.087427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-80063869-4b3e-4f7c-8f8c-2b00bfa65b52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:37.095404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80063869-4b3e-4f7c-8f8c-2b00bfa65b52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:37.095974 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80063869-4b3e-4f7c-8f8c-2b00bfa65b52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:37.096416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80063869-4b3e-4f7c-8f8c-2b00bfa65b52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:37.097133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80063869-4b3e-4f7c-8f8c-2b00bfa65b52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:37.097586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80063869-4b3e-4f7c-8f8c-2b00bfa65b52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:37.098011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80063869-4b3e-4f7c-8f8c-2b00bfa65b52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:37.130612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-80063869-4b3e-4f7c-8f8c-2b00bfa65b52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053169 Sep 13 20:06:37.131508 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 476/838] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:38.149024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-eaf73868-2fcd-40ce-8676-25b67253d3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:38.149024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-eaf73868-2fcd-40ce-8676-25b67253d3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:38.152735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eaf73868-2fcd-40ce-8676-25b67253d3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:38.153298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eaf73868-2fcd-40ce-8676-25b67253d3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:38.153731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eaf73868-2fcd-40ce-8676-25b67253d3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:38.154458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eaf73868-2fcd-40ce-8676-25b67253d3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:38.154919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eaf73868-2fcd-40ce-8676-25b67253d3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:38.155362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eaf73868-2fcd-40ce-8676-25b67253d3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:38.187787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-eaf73868-2fcd-40ce-8676-25b67253d3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049225 Sep 13 20:06:38.188631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 363/839] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:39.205575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-93bf8778-96bc-4172-bb74-964c68f4f2b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:39.209024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-93bf8778-96bc-4172-bb74-964c68f4f2b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:39.218763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93bf8778-96bc-4172-bb74-964c68f4f2b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:39.219538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93bf8778-96bc-4172-bb74-964c68f4f2b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:39.220274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93bf8778-96bc-4172-bb74-964c68f4f2b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:39.221447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93bf8778-96bc-4172-bb74-964c68f4f2b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:39.222180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93bf8778-96bc-4172-bb74-964c68f4f2b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:39.222900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93bf8778-96bc-4172-bb74-964c68f4f2b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:39.265490 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-93bf8778-96bc-4172-bb74-964c68f4f2b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067273 Sep 13 20:06:39.270336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 477/840] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:40.277851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c5a8f871-59ab-4024-ac5e-b19500ea9d97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:40.280009 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c5a8f871-59ab-4024-ac5e-b19500ea9d97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:40.286945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5a8f871-59ab-4024-ac5e-b19500ea9d97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:40.287425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5a8f871-59ab-4024-ac5e-b19500ea9d97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:40.287851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5a8f871-59ab-4024-ac5e-b19500ea9d97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:40.288539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5a8f871-59ab-4024-ac5e-b19500ea9d97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:40.288986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5a8f871-59ab-4024-ac5e-b19500ea9d97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:40.289397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5a8f871-59ab-4024-ac5e-b19500ea9d97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:40.320260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c5a8f871-59ab-4024-ac5e-b19500ea9d97 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046777 Sep 13 20:06:40.321467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 364/841] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:41.333880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cfcdccfb-393b-4166-8b0b-fcb5100313ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:41.336365 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cfcdccfb-393b-4166-8b0b-fcb5100313ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:41.343992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cfcdccfb-393b-4166-8b0b-fcb5100313ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:41.344463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cfcdccfb-393b-4166-8b0b-fcb5100313ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:41.344964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cfcdccfb-393b-4166-8b0b-fcb5100313ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:41.345721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cfcdccfb-393b-4166-8b0b-fcb5100313ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:41.346187 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cfcdccfb-393b-4166-8b0b-fcb5100313ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:41.346632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cfcdccfb-393b-4166-8b0b-fcb5100313ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:41.377947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cfcdccfb-393b-4166-8b0b-fcb5100313ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048482 Sep 13 20:06:41.378721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 478/842] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:41 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:42.390178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4b95a27a-1c27-4f89-acd0-c40839527287 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:42.392373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4b95a27a-1c27-4f89-acd0-c40839527287 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:42.399275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b95a27a-1c27-4f89-acd0-c40839527287 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:42.399764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b95a27a-1c27-4f89-acd0-c40839527287 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:42.400197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b95a27a-1c27-4f89-acd0-c40839527287 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:42.400902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b95a27a-1c27-4f89-acd0-c40839527287 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:42.401354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b95a27a-1c27-4f89-acd0-c40839527287 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:42.401779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b95a27a-1c27-4f89-acd0-c40839527287 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:42.433177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4b95a27a-1c27-4f89-acd0-c40839527287 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047065 Sep 13 20:06:42.433718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 365/843] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:43.446970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e3ddc193-e37f-41b4-8023-8cfbece88919 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:43.449813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e3ddc193-e37f-41b4-8023-8cfbece88919 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:43.452044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=30 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:43.457792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e3ddc193-e37f-41b4-8023-8cfbece88919 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:43.458280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e3ddc193-e37f-41b4-8023-8cfbece88919 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:43.458770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e3ddc193-e37f-41b4-8023-8cfbece88919 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:43.459476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e3ddc193-e37f-41b4-8023-8cfbece88919 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:43.459926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e3ddc193-e37f-41b4-8023-8cfbece88919 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:43.460352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e3ddc193-e37f-41b4-8023-8cfbece88919 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:43.463300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=90 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:43.492278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e3ddc193-e37f-41b4-8023-8cfbece88919 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049638 Sep 13 20:06:43.492914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 479/844] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:44.505183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c89014f2-b894-4ba3-83b3-321f287e6e7b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:44.509286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c89014f2-b894-4ba3-83b3-321f287e6e7b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:44.511662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=30 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:44.517434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c89014f2-b894-4ba3-83b3-321f287e6e7b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:44.517845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c89014f2-b894-4ba3-83b3-321f287e6e7b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:44.518272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c89014f2-b894-4ba3-83b3-321f287e6e7b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:44.518985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c89014f2-b894-4ba3-83b3-321f287e6e7b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:44.519430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c89014f2-b894-4ba3-83b3-321f287e6e7b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:44.519860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c89014f2-b894-4ba3-83b3-321f287e6e7b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:44.522295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=90 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:44.552076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c89014f2-b894-4ba3-83b3-321f287e6e7b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050857 Sep 13 20:06:44.552614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 366/845] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:45.575951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6376f6f6-fb7a-4650-8e28-bb541b3f5f38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:45.578121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6376f6f6-fb7a-4650-8e28-bb541b3f5f38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:45.585401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6376f6f6-fb7a-4650-8e28-bb541b3f5f38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:45.585978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6376f6f6-fb7a-4650-8e28-bb541b3f5f38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:45.586305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6376f6f6-fb7a-4650-8e28-bb541b3f5f38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:45.587062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6376f6f6-fb7a-4650-8e28-bb541b3f5f38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:45.587500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6376f6f6-fb7a-4650-8e28-bb541b3f5f38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:45.587916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6376f6f6-fb7a-4650-8e28-bb541b3f5f38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:45.618443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6376f6f6-fb7a-4650-8e28-bb541b3f5f38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046387 Sep 13 20:06:45.618922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 480/846] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:46.633119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f8ae64de-dead-4496-bc93-8c83977cd4d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:46.635378 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f8ae64de-dead-4496-bc93-8c83977cd4d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:46.642008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8ae64de-dead-4496-bc93-8c83977cd4d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:46.642514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8ae64de-dead-4496-bc93-8c83977cd4d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:46.642977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8ae64de-dead-4496-bc93-8c83977cd4d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:46.643664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8ae64de-dead-4496-bc93-8c83977cd4d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:46.644447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8ae64de-dead-4496-bc93-8c83977cd4d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:46.644594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8ae64de-dead-4496-bc93-8c83977cd4d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:46.675729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f8ae64de-dead-4496-bc93-8c83977cd4d9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048451 Sep 13 20:06:46.676311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 367/847] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:47.688178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ff9c5c7c-28d0-4fb6-b7de-4c5446f58a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:47.690812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ff9c5c7c-28d0-4fb6-b7de-4c5446f58a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:47.697386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff9c5c7c-28d0-4fb6-b7de-4c5446f58a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:47.697860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff9c5c7c-28d0-4fb6-b7de-4c5446f58a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:47.698283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff9c5c7c-28d0-4fb6-b7de-4c5446f58a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:47.699006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff9c5c7c-28d0-4fb6-b7de-4c5446f58a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:47.699446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff9c5c7c-28d0-4fb6-b7de-4c5446f58a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:47.699856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ff9c5c7c-28d0-4fb6-b7de-4c5446f58a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:47.730402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ff9c5c7c-28d0-4fb6-b7de-4c5446f58a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046627 Sep 13 20:06:47.730953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 481/848] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:47 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:48.743085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f0b39fb0-f813-462c-9efb-09a46b9f5f86 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:48.745332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f0b39fb0-f813-462c-9efb-09a46b9f5f86 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:48.751994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f0b39fb0-f813-462c-9efb-09a46b9f5f86 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:48.752561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f0b39fb0-f813-462c-9efb-09a46b9f5f86 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:48.752995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f0b39fb0-f813-462c-9efb-09a46b9f5f86 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:48.753689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f0b39fb0-f813-462c-9efb-09a46b9f5f86 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:48.754137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f0b39fb0-f813-462c-9efb-09a46b9f5f86 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:48.754583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f0b39fb0-f813-462c-9efb-09a46b9f5f86 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:48.785431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f0b39fb0-f813-462c-9efb-09a46b9f5f86 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046338 Sep 13 20:06:48.785924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 368/849] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:48 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:49.797355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-60db9dc0-f234-44be-813e-880fc38c651e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:49.799626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-60db9dc0-f234-44be-813e-880fc38c651e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:49.806797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60db9dc0-f234-44be-813e-880fc38c651e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:49.807284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60db9dc0-f234-44be-813e-880fc38c651e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:49.807719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60db9dc0-f234-44be-813e-880fc38c651e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:49.808415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60db9dc0-f234-44be-813e-880fc38c651e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:49.808852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60db9dc0-f234-44be-813e-880fc38c651e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:49.809265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60db9dc0-f234-44be-813e-880fc38c651e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:49.840743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-60db9dc0-f234-44be-813e-880fc38c651e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047343 Sep 13 20:06:49.841416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 482/850] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:50.853374 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-188ba631-ed99-4b06-aae9-759171f7e760 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:50.855982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-188ba631-ed99-4b06-aae9-759171f7e760 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:50.876521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-188ba631-ed99-4b06-aae9-759171f7e760 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:50.876521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-188ba631-ed99-4b06-aae9-759171f7e760 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:50.876521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-188ba631-ed99-4b06-aae9-759171f7e760 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:50.876521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-188ba631-ed99-4b06-aae9-759171f7e760 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:50.877116 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-188ba631-ed99-4b06-aae9-759171f7e760 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:50.877116 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-188ba631-ed99-4b06-aae9-759171f7e760 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:50.897846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-188ba631-ed99-4b06-aae9-759171f7e760 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048457 Sep 13 20:06:50.898529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 369/851] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:51.907778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:06:51.908379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:06:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments (ip 10.222.0.52) !!! Sep 13 20:06:51.919767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ac7d3889-58d3-465a-b081-22e9ec897865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:51.921957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ac7d3889-58d3-465a-b081-22e9ec897865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:51.928653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ac7d3889-58d3-465a-b081-22e9ec897865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:51.929155 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ac7d3889-58d3-465a-b081-22e9ec897865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:51.929586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ac7d3889-58d3-465a-b081-22e9ec897865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:51.930316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ac7d3889-58d3-465a-b081-22e9ec897865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:51.930795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ac7d3889-58d3-465a-b081-22e9ec897865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:51.931215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ac7d3889-58d3-465a-b081-22e9ec897865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:51.973147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ac7d3889-58d3-465a-b081-22e9ec897865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066219 Sep 13 20:06:51.974085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 483/852] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:52.988530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-15727f02-2e1e-4f06-8f48-06acc4f1dc26 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:52.990807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-15727f02-2e1e-4f06-8f48-06acc4f1dc26 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:53.010979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15727f02-2e1e-4f06-8f48-06acc4f1dc26 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:53.010979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15727f02-2e1e-4f06-8f48-06acc4f1dc26 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:53.010979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15727f02-2e1e-4f06-8f48-06acc4f1dc26 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:53.010979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15727f02-2e1e-4f06-8f48-06acc4f1dc26 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:53.011357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15727f02-2e1e-4f06-8f48-06acc4f1dc26 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:53.011357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15727f02-2e1e-4f06-8f48-06acc4f1dc26 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:53.036326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-15727f02-2e1e-4f06-8f48-06acc4f1dc26 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053509 Sep 13 20:06:53.037332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 370/853] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:54.051985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f9906681-d1b1-435d-9fcb-63690294aabb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:54.054244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f9906681-d1b1-435d-9fcb-63690294aabb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:54.062290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9906681-d1b1-435d-9fcb-63690294aabb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:54.062818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9906681-d1b1-435d-9fcb-63690294aabb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:54.063252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9906681-d1b1-435d-9fcb-63690294aabb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:54.063957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9906681-d1b1-435d-9fcb-63690294aabb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:54.064451 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9906681-d1b1-435d-9fcb-63690294aabb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:54.065179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9906681-d1b1-435d-9fcb-63690294aabb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:54.095458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f9906681-d1b1-435d-9fcb-63690294aabb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049992 Sep 13 20:06:54.096027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 484/854] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:54 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:55.108436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ec1c0c40-e7a9-447d-8942-37fb5f383f74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:55.110614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ec1c0c40-e7a9-447d-8942-37fb5f383f74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:55.117257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c40-e7a9-447d-8942-37fb5f383f74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:55.117749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c40-e7a9-447d-8942-37fb5f383f74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:55.118184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c40-e7a9-447d-8942-37fb5f383f74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:55.119000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c40-e7a9-447d-8942-37fb5f383f74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:55.119452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c40-e7a9-447d-8942-37fb5f383f74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:55.119874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c40-e7a9-447d-8942-37fb5f383f74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:55.150802 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ec1c0c40-e7a9-447d-8942-37fb5f383f74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046259 Sep 13 20:06:55.151398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 371/855] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:56.163947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-42398a7e-0582-457e-8bf1-eef85432d37b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:56.166181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-42398a7e-0582-457e-8bf1-eef85432d37b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:56.173506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42398a7e-0582-457e-8bf1-eef85432d37b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:56.173992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42398a7e-0582-457e-8bf1-eef85432d37b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:56.174449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42398a7e-0582-457e-8bf1-eef85432d37b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:56.175158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42398a7e-0582-457e-8bf1-eef85432d37b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:56.175603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42398a7e-0582-457e-8bf1-eef85432d37b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:56.176086 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42398a7e-0582-457e-8bf1-eef85432d37b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:56.208838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-42398a7e-0582-457e-8bf1-eef85432d37b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048958 Sep 13 20:06:56.209417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 485/856] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:57.221421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a67a63aa-563c-4771-b2db-7bf809edb19f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:57.223719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a67a63aa-563c-4771-b2db-7bf809edb19f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:57.230950 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a67a63aa-563c-4771-b2db-7bf809edb19f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:57.231734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a67a63aa-563c-4771-b2db-7bf809edb19f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:57.231838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a67a63aa-563c-4771-b2db-7bf809edb19f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:57.232567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a67a63aa-563c-4771-b2db-7bf809edb19f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:57.233020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a67a63aa-563c-4771-b2db-7bf809edb19f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:57.233446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a67a63aa-563c-4771-b2db-7bf809edb19f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:57.264797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a67a63aa-563c-4771-b2db-7bf809edb19f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047309 Sep 13 20:06:57.265579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 372/857] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:58.277453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-44eaf9d5-5609-417e-94c6-977eba511f64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:58.279690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-44eaf9d5-5609-417e-94c6-977eba511f64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:58.286248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44eaf9d5-5609-417e-94c6-977eba511f64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:58.286853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44eaf9d5-5609-417e-94c6-977eba511f64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:58.287194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44eaf9d5-5609-417e-94c6-977eba511f64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:58.287889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44eaf9d5-5609-417e-94c6-977eba511f64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:58.288337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44eaf9d5-5609-417e-94c6-977eba511f64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:58.288757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44eaf9d5-5609-417e-94c6-977eba511f64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:58.318937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-44eaf9d5-5609-417e-94c6-977eba511f64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045450 Sep 13 20:06:58.319498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 486/858] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:06:59.335873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-204582e5-4b70-481b-92f3-dc628b5387c0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:59.339391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-204582e5-4b70-481b-92f3-dc628b5387c0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:59.349658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-204582e5-4b70-481b-92f3-dc628b5387c0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:59.350144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-204582e5-4b70-481b-92f3-dc628b5387c0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:59.350615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-204582e5-4b70-481b-92f3-dc628b5387c0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:59.351318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-204582e5-4b70-481b-92f3-dc628b5387c0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:59.351765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-204582e5-4b70-481b-92f3-dc628b5387c0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:59.352192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-204582e5-4b70-481b-92f3-dc628b5387c0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:59.383023 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-204582e5-4b70-481b-92f3-dc628b5387c0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054193 Sep 13 20:06:59.383790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 373/859] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:06:59 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:00.398023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-eba656f3-2b11-4201-a914-028346eb2bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:00.400134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-eba656f3-2b11-4201-a914-028346eb2bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:00.406959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eba656f3-2b11-4201-a914-028346eb2bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:00.407440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eba656f3-2b11-4201-a914-028346eb2bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:00.407868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eba656f3-2b11-4201-a914-028346eb2bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:00.408569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eba656f3-2b11-4201-a914-028346eb2bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:00.409017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eba656f3-2b11-4201-a914-028346eb2bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:00.409440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eba656f3-2b11-4201-a914-028346eb2bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:00.441066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-eba656f3-2b11-4201-a914-028346eb2bc1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048484 Sep 13 20:07:00.445271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 487/860] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:00 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:01.455093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-be5d917c-3398-414a-b662-df483d0e40b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:01.457720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-be5d917c-3398-414a-b662-df483d0e40b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:01.465308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be5d917c-3398-414a-b662-df483d0e40b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:01.465960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be5d917c-3398-414a-b662-df483d0e40b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:01.466523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be5d917c-3398-414a-b662-df483d0e40b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:01.467341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be5d917c-3398-414a-b662-df483d0e40b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:01.467870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be5d917c-3398-414a-b662-df483d0e40b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:01.468370 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be5d917c-3398-414a-b662-df483d0e40b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:01.499518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-be5d917c-3398-414a-b662-df483d0e40b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049180 Sep 13 20:07:01.500130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 374/861] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:02.512573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-67ac7c0a-1a85-4467-82d9-a6c7a64eed9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:02.514727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-67ac7c0a-1a85-4467-82d9-a6c7a64eed9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:02.521396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67ac7c0a-1a85-4467-82d9-a6c7a64eed9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:02.521882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67ac7c0a-1a85-4467-82d9-a6c7a64eed9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:02.522315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67ac7c0a-1a85-4467-82d9-a6c7a64eed9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:02.523054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67ac7c0a-1a85-4467-82d9-a6c7a64eed9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:02.523500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67ac7c0a-1a85-4467-82d9-a6c7a64eed9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:02.523921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67ac7c0a-1a85-4467-82d9-a6c7a64eed9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:02.555766 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-67ac7c0a-1a85-4467-82d9-a6c7a64eed9c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047305 Sep 13 20:07:02.556806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 488/862] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:03.573770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b6de4cf5-cb35-4a54-8163-8881998db078 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:03.576040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b6de4cf5-cb35-4a54-8163-8881998db078 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:03.582859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6de4cf5-cb35-4a54-8163-8881998db078 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:03.583407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6de4cf5-cb35-4a54-8163-8881998db078 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:03.583878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6de4cf5-cb35-4a54-8163-8881998db078 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:03.584559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6de4cf5-cb35-4a54-8163-8881998db078 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:03.585000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6de4cf5-cb35-4a54-8163-8881998db078 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:03.585415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6de4cf5-cb35-4a54-8163-8881998db078 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:03.620711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b6de4cf5-cb35-4a54-8163-8881998db078 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054512 Sep 13 20:07:03.625468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 375/863] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:04.633123 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f68ed510-f24b-44b7-9648-e9968eb0235c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:04.635406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f68ed510-f24b-44b7-9648-e9968eb0235c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:04.642009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f68ed510-f24b-44b7-9648-e9968eb0235c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:04.642533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f68ed510-f24b-44b7-9648-e9968eb0235c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:04.642967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f68ed510-f24b-44b7-9648-e9968eb0235c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:04.643665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f68ed510-f24b-44b7-9648-e9968eb0235c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:04.644114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f68ed510-f24b-44b7-9648-e9968eb0235c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:04.644518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f68ed510-f24b-44b7-9648-e9968eb0235c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:04.681012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f68ed510-f24b-44b7-9648-e9968eb0235c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052001 Sep 13 20:07:04.681853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 489/864] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:05.693626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ca8636df-94f7-4ea1-9919-f8d2e422051a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:05.695774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ca8636df-94f7-4ea1-9919-f8d2e422051a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:05.702733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca8636df-94f7-4ea1-9919-f8d2e422051a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:05.703442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca8636df-94f7-4ea1-9919-f8d2e422051a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:05.703871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca8636df-94f7-4ea1-9919-f8d2e422051a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:05.704559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca8636df-94f7-4ea1-9919-f8d2e422051a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:05.705000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca8636df-94f7-4ea1-9919-f8d2e422051a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:05.705410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca8636df-94f7-4ea1-9919-f8d2e422051a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:05.736494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ca8636df-94f7-4ea1-9919-f8d2e422051a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047180 Sep 13 20:07:05.741758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 376/865] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:06.749481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0f425475-cac0-4f69-960e-6a900e1d6b22 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:06.751668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0f425475-cac0-4f69-960e-6a900e1d6b22 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:06.759144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f425475-cac0-4f69-960e-6a900e1d6b22 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:06.759637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f425475-cac0-4f69-960e-6a900e1d6b22 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:06.761673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f425475-cac0-4f69-960e-6a900e1d6b22 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:06.762400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f425475-cac0-4f69-960e-6a900e1d6b22 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:06.762863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f425475-cac0-4f69-960e-6a900e1d6b22 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:06.763368 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f425475-cac0-4f69-960e-6a900e1d6b22 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:06.795679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0f425475-cac0-4f69-960e-6a900e1d6b22 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050181 Sep 13 20:07:06.796421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 490/866] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:06 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:07.808741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0f163965-2a76-49a8-9d50-0986dcd2bf46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:07.810871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0f163965-2a76-49a8-9d50-0986dcd2bf46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:07.817900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f163965-2a76-49a8-9d50-0986dcd2bf46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:07.818397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f163965-2a76-49a8-9d50-0986dcd2bf46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:07.818831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f163965-2a76-49a8-9d50-0986dcd2bf46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:07.819516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f163965-2a76-49a8-9d50-0986dcd2bf46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:07.819958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f163965-2a76-49a8-9d50-0986dcd2bf46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:07.820382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f163965-2a76-49a8-9d50-0986dcd2bf46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:07.851307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0f163965-2a76-49a8-9d50-0986dcd2bf46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046813 Sep 13 20:07:07.852019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 377/867] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:08.864210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ef667fe6-156c-42e1-bd85-e7878ec8809e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:08.866343 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ef667fe6-156c-42e1-bd85-e7878ec8809e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:08.872836 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef667fe6-156c-42e1-bd85-e7878ec8809e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:08.873323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef667fe6-156c-42e1-bd85-e7878ec8809e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:08.873747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef667fe6-156c-42e1-bd85-e7878ec8809e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:08.874573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef667fe6-156c-42e1-bd85-e7878ec8809e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:08.875028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef667fe6-156c-42e1-bd85-e7878ec8809e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:08.875457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef667fe6-156c-42e1-bd85-e7878ec8809e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:08.906824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ef667fe6-156c-42e1-bd85-e7878ec8809e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046667 Sep 13 20:07:08.907547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 491/868] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:09.919656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-305de29a-0f2e-4d8b-a084-58df98730cda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:09.921757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-305de29a-0f2e-4d8b-a084-58df98730cda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:09.928962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-305de29a-0f2e-4d8b-a084-58df98730cda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:09.929452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-305de29a-0f2e-4d8b-a084-58df98730cda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:09.929884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-305de29a-0f2e-4d8b-a084-58df98730cda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:09.930704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-305de29a-0f2e-4d8b-a084-58df98730cda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:09.931156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-305de29a-0f2e-4d8b-a084-58df98730cda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:09.931671 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-305de29a-0f2e-4d8b-a084-58df98730cda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:09.967084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-305de29a-0f2e-4d8b-a084-58df98730cda tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051307 Sep 13 20:07:09.967665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 378/869] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:10.980251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-860d03e4-abb5-40fc-b4cd-6c6a3db0f446 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:10.982295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-860d03e4-abb5-40fc-b4cd-6c6a3db0f446 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:10.990674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-860d03e4-abb5-40fc-b4cd-6c6a3db0f446 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:10.991170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-860d03e4-abb5-40fc-b4cd-6c6a3db0f446 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:10.991614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-860d03e4-abb5-40fc-b4cd-6c6a3db0f446 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:10.992466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-860d03e4-abb5-40fc-b4cd-6c6a3db0f446 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:10.992916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-860d03e4-abb5-40fc-b4cd-6c6a3db0f446 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:10.993330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-860d03e4-abb5-40fc-b4cd-6c6a3db0f446 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:11.024812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-860d03e4-abb5-40fc-b4cd-6c6a3db0f446 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048635 Sep 13 20:07:11.025536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 492/870] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:12.037571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-be04e418-da41-4397-8b57-92a256a7cab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:12.039976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-be04e418-da41-4397-8b57-92a256a7cab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:12.047181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be04e418-da41-4397-8b57-92a256a7cab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:12.047581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be04e418-da41-4397-8b57-92a256a7cab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:12.048008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be04e418-da41-4397-8b57-92a256a7cab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:12.048724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be04e418-da41-4397-8b57-92a256a7cab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:12.049167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be04e418-da41-4397-8b57-92a256a7cab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:12.049563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be04e418-da41-4397-8b57-92a256a7cab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:12.081253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-be04e418-da41-4397-8b57-92a256a7cab1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047775 Sep 13 20:07:12.081834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 379/871] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:13.094917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3b540a0a-d50e-4ddb-9b70-7201778a9ffa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:13.097088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3b540a0a-d50e-4ddb-9b70-7201778a9ffa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:13.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b540a0a-d50e-4ddb-9b70-7201778a9ffa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:13.104835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b540a0a-d50e-4ddb-9b70-7201778a9ffa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:13.105264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b540a0a-d50e-4ddb-9b70-7201778a9ffa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:13.106030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b540a0a-d50e-4ddb-9b70-7201778a9ffa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:13.106500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b540a0a-d50e-4ddb-9b70-7201778a9ffa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:13.106948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b540a0a-d50e-4ddb-9b70-7201778a9ffa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:13.139899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3b540a0a-d50e-4ddb-9b70-7201778a9ffa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049493 Sep 13 20:07:13.140492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 493/872] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:14.154675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5736c455-8d05-4c35-bd64-ce895735bfb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:14.157473 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5736c455-8d05-4c35-bd64-ce895735bfb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:14.167767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5736c455-8d05-4c35-bd64-ce895735bfb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:14.168267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5736c455-8d05-4c35-bd64-ce895735bfb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:14.168699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5736c455-8d05-4c35-bd64-ce895735bfb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:14.169431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5736c455-8d05-4c35-bd64-ce895735bfb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:14.169874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5736c455-8d05-4c35-bd64-ce895735bfb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:14.170289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5736c455-8d05-4c35-bd64-ce895735bfb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:14.201958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5736c455-8d05-4c35-bd64-ce895735bfb8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052349 Sep 13 20:07:14.202553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 380/873] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:15.215551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-88929420-6570-4d78-aa4d-b25cb8c8cd0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:15.217906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-88929420-6570-4d78-aa4d-b25cb8c8cd0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:15.219889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=30 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:15.225441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88929420-6570-4d78-aa4d-b25cb8c8cd0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:15.225921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88929420-6570-4d78-aa4d-b25cb8c8cd0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:15.226391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88929420-6570-4d78-aa4d-b25cb8c8cd0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:15.227093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88929420-6570-4d78-aa4d-b25cb8c8cd0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:15.227534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88929420-6570-4d78-aa4d-b25cb8c8cd0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:15.228149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88929420-6570-4d78-aa4d-b25cb8c8cd0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:15.230600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=90 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:15.260112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-88929420-6570-4d78-aa4d-b25cb8c8cd0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048656 Sep 13 20:07:15.263141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 494/874] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:16.274336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ffe3c65c-b6c1-43bf-b535-7c9740293c7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:16.278346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ffe3c65c-b6c1-43bf-b535-7c9740293c7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:16.280368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=30 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:16.287204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ffe3c65c-b6c1-43bf-b535-7c9740293c7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:16.287817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ffe3c65c-b6c1-43bf-b535-7c9740293c7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:16.288358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ffe3c65c-b6c1-43bf-b535-7c9740293c7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:16.289233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ffe3c65c-b6c1-43bf-b535-7c9740293c7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:16.289792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ffe3c65c-b6c1-43bf-b535-7c9740293c7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:16.290462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ffe3c65c-b6c1-43bf-b535-7c9740293c7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:16.293133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=90 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:16.322422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ffe3c65c-b6c1-43bf-b535-7c9740293c7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053029 Sep 13 20:07:16.324124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 381/875] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:16 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:17.336077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5866c138-ebd0-4aec-9cbe-4e2cbed5041e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:17.338284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5866c138-ebd0-4aec-9cbe-4e2cbed5041e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:17.345529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5866c138-ebd0-4aec-9cbe-4e2cbed5041e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:17.346011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5866c138-ebd0-4aec-9cbe-4e2cbed5041e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:17.346476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5866c138-ebd0-4aec-9cbe-4e2cbed5041e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:17.347155 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5866c138-ebd0-4aec-9cbe-4e2cbed5041e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:17.347608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5866c138-ebd0-4aec-9cbe-4e2cbed5041e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:17.348026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5866c138-ebd0-4aec-9cbe-4e2cbed5041e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:17.378272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5866c138-ebd0-4aec-9cbe-4e2cbed5041e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046273 Sep 13 20:07:17.379023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 495/876] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:17 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:18.393163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e06cb537-171b-4b89-b99c-fd1094817ba2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:18.395634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e06cb537-171b-4b89-b99c-fd1094817ba2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:18.403725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e06cb537-171b-4b89-b99c-fd1094817ba2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:18.404213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e06cb537-171b-4b89-b99c-fd1094817ba2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:18.404650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e06cb537-171b-4b89-b99c-fd1094817ba2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:18.405361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e06cb537-171b-4b89-b99c-fd1094817ba2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:18.405811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e06cb537-171b-4b89-b99c-fd1094817ba2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:18.406252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e06cb537-171b-4b89-b99c-fd1094817ba2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:18.439308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e06cb537-171b-4b89-b99c-fd1094817ba2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051077 Sep 13 20:07:18.440145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 382/877] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:19.453735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5075c19d-4557-4f17-82d5-f1fd22008629 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:19.454591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5075c19d-4557-4f17-82d5-f1fd22008629 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:19.461548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5075c19d-4557-4f17-82d5-f1fd22008629 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:19.462092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5075c19d-4557-4f17-82d5-f1fd22008629 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:19.462466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5075c19d-4557-4f17-82d5-f1fd22008629 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:19.463157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5075c19d-4557-4f17-82d5-f1fd22008629 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:19.463606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5075c19d-4557-4f17-82d5-f1fd22008629 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:19.464022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5075c19d-4557-4f17-82d5-f1fd22008629 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:19.495673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5075c19d-4557-4f17-82d5-f1fd22008629 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047486 Sep 13 20:07:19.496276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 496/878] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:20.507892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-14cc61a8-30c2-40c5-8935-ce03fcfc8d45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:20.509995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-14cc61a8-30c2-40c5-8935-ce03fcfc8d45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:20.517000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14cc61a8-30c2-40c5-8935-ce03fcfc8d45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:20.517481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14cc61a8-30c2-40c5-8935-ce03fcfc8d45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:20.517907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14cc61a8-30c2-40c5-8935-ce03fcfc8d45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:20.518638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14cc61a8-30c2-40c5-8935-ce03fcfc8d45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:20.519073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14cc61a8-30c2-40c5-8935-ce03fcfc8d45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:20.519491 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14cc61a8-30c2-40c5-8935-ce03fcfc8d45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:20.551450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-14cc61a8-30c2-40c5-8935-ce03fcfc8d45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047506 Sep 13 20:07:20.552026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 383/879] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:21.564695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-77bff7f0-34e5-49e5-9195-9dd023675c84 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:21.566896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-77bff7f0-34e5-49e5-9195-9dd023675c84 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:21.574050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77bff7f0-34e5-49e5-9195-9dd023675c84 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:21.574569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77bff7f0-34e5-49e5-9195-9dd023675c84 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:21.574991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77bff7f0-34e5-49e5-9195-9dd023675c84 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:21.575680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77bff7f0-34e5-49e5-9195-9dd023675c84 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:21.576119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77bff7f0-34e5-49e5-9195-9dd023675c84 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:21.576530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77bff7f0-34e5-49e5-9195-9dd023675c84 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:21.608149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-77bff7f0-34e5-49e5-9195-9dd023675c84 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047822 Sep 13 20:07:21.608683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 497/880] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:22.621983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-808a4f81-8af1-4877-90ab-21ce18ad8452 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:22.624169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-808a4f81-8af1-4877-90ab-21ce18ad8452 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:22.631050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-808a4f81-8af1-4877-90ab-21ce18ad8452 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:22.631523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-808a4f81-8af1-4877-90ab-21ce18ad8452 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:22.631949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-808a4f81-8af1-4877-90ab-21ce18ad8452 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:22.632675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-808a4f81-8af1-4877-90ab-21ce18ad8452 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:22.633119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-808a4f81-8af1-4877-90ab-21ce18ad8452 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:22.633541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-808a4f81-8af1-4877-90ab-21ce18ad8452 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:22.665595 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-808a4f81-8af1-4877-90ab-21ce18ad8452 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047691 Sep 13 20:07:22.666149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 384/881] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:22 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:23.680025 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-40fb36bd-6788-459a-a7f1-28d1fc771b3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:23.682221 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-40fb36bd-6788-459a-a7f1-28d1fc771b3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:23.689465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-40fb36bd-6788-459a-a7f1-28d1fc771b3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:23.689941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-40fb36bd-6788-459a-a7f1-28d1fc771b3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:23.690402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-40fb36bd-6788-459a-a7f1-28d1fc771b3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:23.691168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-40fb36bd-6788-459a-a7f1-28d1fc771b3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:23.691615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-40fb36bd-6788-459a-a7f1-28d1fc771b3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:23.692034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-40fb36bd-6788-459a-a7f1-28d1fc771b3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:23.722246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-40fb36bd-6788-459a-a7f1-28d1fc771b3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046426 Sep 13 20:07:23.722861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 498/882] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:23 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:24.737569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4a942bd5-8831-4fb7-a9f4-d3b7ff3490ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:24.740431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4a942bd5-8831-4fb7-a9f4-d3b7ff3490ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:24.749514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a942bd5-8831-4fb7-a9f4-d3b7ff3490ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:24.750129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a942bd5-8831-4fb7-a9f4-d3b7ff3490ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:24.750771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a942bd5-8831-4fb7-a9f4-d3b7ff3490ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:24.751699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a942bd5-8831-4fb7-a9f4-d3b7ff3490ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:24.752284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a942bd5-8831-4fb7-a9f4-d3b7ff3490ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:24.752849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a942bd5-8831-4fb7-a9f4-d3b7ff3490ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:24.785499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4a942bd5-8831-4fb7-a9f4-d3b7ff3490ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053365 Sep 13 20:07:24.786068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 385/883] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:25.801517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-caaf6c5f-2e14-479a-8fec-8c6ac8bd502c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:25.805290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-caaf6c5f-2e14-479a-8fec-8c6ac8bd502c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:25.813508 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-caaf6c5f-2e14-479a-8fec-8c6ac8bd502c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:25.814018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-caaf6c5f-2e14-479a-8fec-8c6ac8bd502c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:25.814482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-caaf6c5f-2e14-479a-8fec-8c6ac8bd502c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:25.815180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-caaf6c5f-2e14-479a-8fec-8c6ac8bd502c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:25.815626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-caaf6c5f-2e14-479a-8fec-8c6ac8bd502c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:25.816045 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-caaf6c5f-2e14-479a-8fec-8c6ac8bd502c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:25.847241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-caaf6c5f-2e14-479a-8fec-8c6ac8bd502c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052193 Sep 13 20:07:25.847678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 499/884] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:26.865547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-26abc2ab-3de7-4f47-85ca-f467c537975a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:26.868659 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-26abc2ab-3de7-4f47-85ca-f467c537975a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:26.878852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26abc2ab-3de7-4f47-85ca-f467c537975a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:26.879577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26abc2ab-3de7-4f47-85ca-f467c537975a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:26.880217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26abc2ab-3de7-4f47-85ca-f467c537975a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:26.881207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26abc2ab-3de7-4f47-85ca-f467c537975a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:26.881862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26abc2ab-3de7-4f47-85ca-f467c537975a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:26.882476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26abc2ab-3de7-4f47-85ca-f467c537975a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:26.913910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-26abc2ab-3de7-4f47-85ca-f467c537975a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055237 Sep 13 20:07:26.914713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 386/885] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:27.930271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d52258b5-1d7c-4d09-a8ab-20cf99fa43b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:27.933080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d52258b5-1d7c-4d09-a8ab-20cf99fa43b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:27.941387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d52258b5-1d7c-4d09-a8ab-20cf99fa43b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:27.941872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d52258b5-1d7c-4d09-a8ab-20cf99fa43b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:27.942300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d52258b5-1d7c-4d09-a8ab-20cf99fa43b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:27.943044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d52258b5-1d7c-4d09-a8ab-20cf99fa43b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:27.943493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d52258b5-1d7c-4d09-a8ab-20cf99fa43b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:27.943915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d52258b5-1d7c-4d09-a8ab-20cf99fa43b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:27.974821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d52258b5-1d7c-4d09-a8ab-20cf99fa43b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050790 Sep 13 20:07:27.975396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 500/886] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:27 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:28.989014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e7988249-18ad-4be9-aa1f-f0d9a0efc6aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:28.991178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e7988249-18ad-4be9-aa1f-f0d9a0efc6aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:28.993184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:07:28.993373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:07:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments (ip 10.222.0.52) !!! Sep 13 20:07:29.001371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7988249-18ad-4be9-aa1f-f0d9a0efc6aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:29.001840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7988249-18ad-4be9-aa1f-f0d9a0efc6aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:29.002263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7988249-18ad-4be9-aa1f-f0d9a0efc6aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:29.002970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7988249-18ad-4be9-aa1f-f0d9a0efc6aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:29.003410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7988249-18ad-4be9-aa1f-f0d9a0efc6aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:29.003820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e7988249-18ad-4be9-aa1f-f0d9a0efc6aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:29.034602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e7988249-18ad-4be9-aa1f-f0d9a0efc6aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050400 Sep 13 20:07:29.035167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 387/887] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:30.048563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-95ff6961-3069-462a-b782-c838ab6a7c3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:30.050779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-95ff6961-3069-462a-b782-c838ab6a7c3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:30.057696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95ff6961-3069-462a-b782-c838ab6a7c3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:30.058164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95ff6961-3069-462a-b782-c838ab6a7c3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:30.058770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95ff6961-3069-462a-b782-c838ab6a7c3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:30.061104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95ff6961-3069-462a-b782-c838ab6a7c3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:30.061553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95ff6961-3069-462a-b782-c838ab6a7c3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:30.061970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95ff6961-3069-462a-b782-c838ab6a7c3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:30.092846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-95ff6961-3069-462a-b782-c838ab6a7c3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048346 Sep 13 20:07:30.093397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 501/888] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:30 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:31.106079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f8e5bf46-e8eb-40e8-b1c6-5e5db21b8f53 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:31.108286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f8e5bf46-e8eb-40e8-b1c6-5e5db21b8f53 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:31.114758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8e5bf46-e8eb-40e8-b1c6-5e5db21b8f53 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:31.115235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8e5bf46-e8eb-40e8-b1c6-5e5db21b8f53 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:31.115659 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8e5bf46-e8eb-40e8-b1c6-5e5db21b8f53 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:31.116334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8e5bf46-e8eb-40e8-b1c6-5e5db21b8f53 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:31.116796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8e5bf46-e8eb-40e8-b1c6-5e5db21b8f53 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:31.117208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8e5bf46-e8eb-40e8-b1c6-5e5db21b8f53 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:31.147805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f8e5bf46-e8eb-40e8-b1c6-5e5db21b8f53 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045514 Sep 13 20:07:31.148712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 388/889] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:32.161942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3e794cef-a7b7-4023-8ba2-ff4a23d822c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:32.164062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3e794cef-a7b7-4023-8ba2-ff4a23d822c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:32.171028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e794cef-a7b7-4023-8ba2-ff4a23d822c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:32.171499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e794cef-a7b7-4023-8ba2-ff4a23d822c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:32.171922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e794cef-a7b7-4023-8ba2-ff4a23d822c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:32.172601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e794cef-a7b7-4023-8ba2-ff4a23d822c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:32.173040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e794cef-a7b7-4023-8ba2-ff4a23d822c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:32.173454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e794cef-a7b7-4023-8ba2-ff4a23d822c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:32.204523 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3e794cef-a7b7-4023-8ba2-ff4a23d822c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046753 Sep 13 20:07:32.205071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 502/890] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:33.218421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7e37e465-d46e-483a-95ce-8bef87986135 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:33.220653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7e37e465-d46e-483a-95ce-8bef87986135 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:33.227515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e37e465-d46e-483a-95ce-8bef87986135 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:33.227997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e37e465-d46e-483a-95ce-8bef87986135 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:33.228437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e37e465-d46e-483a-95ce-8bef87986135 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:33.230404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e37e465-d46e-483a-95ce-8bef87986135 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:33.230879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e37e465-d46e-483a-95ce-8bef87986135 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:33.231310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e37e465-d46e-483a-95ce-8bef87986135 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:33.262014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7e37e465-d46e-483a-95ce-8bef87986135 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047667 Sep 13 20:07:33.262605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 389/891] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:34.279601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6d45cfc5-e42b-45d7-a9f7-5c17e3a211fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:34.283278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6d45cfc5-e42b-45d7-a9f7-5c17e3a211fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:34.293318 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d45cfc5-e42b-45d7-a9f7-5c17e3a211fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:34.293786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d45cfc5-e42b-45d7-a9f7-5c17e3a211fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:34.294211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d45cfc5-e42b-45d7-a9f7-5c17e3a211fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:34.294924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d45cfc5-e42b-45d7-a9f7-5c17e3a211fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:34.295361 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d45cfc5-e42b-45d7-a9f7-5c17e3a211fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:34.295770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d45cfc5-e42b-45d7-a9f7-5c17e3a211fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:34.328693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6d45cfc5-e42b-45d7-a9f7-5c17e3a211fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056028 Sep 13 20:07:34.329251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 503/892] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:34 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:35.344117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-97d8ff22-0b33-426b-bc48-ca5412819528 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:35.347208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-97d8ff22-0b33-426b-bc48-ca5412819528 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:35.355976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-97d8ff22-0b33-426b-bc48-ca5412819528 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:35.356468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-97d8ff22-0b33-426b-bc48-ca5412819528 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:35.356906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-97d8ff22-0b33-426b-bc48-ca5412819528 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:35.357622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-97d8ff22-0b33-426b-bc48-ca5412819528 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:35.358041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-97d8ff22-0b33-426b-bc48-ca5412819528 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:35.358507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-97d8ff22-0b33-426b-bc48-ca5412819528 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:35.389102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-97d8ff22-0b33-426b-bc48-ca5412819528 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051143 Sep 13 20:07:35.389664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 390/893] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:35 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:36.405898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4920dd14-63ad-499c-beb9-ebd940904305 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:36.408088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4920dd14-63ad-499c-beb9-ebd940904305 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:36.415037 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4920dd14-63ad-499c-beb9-ebd940904305 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:36.415522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4920dd14-63ad-499c-beb9-ebd940904305 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:36.415951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4920dd14-63ad-499c-beb9-ebd940904305 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:36.416640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4920dd14-63ad-499c-beb9-ebd940904305 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:36.417057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4920dd14-63ad-499c-beb9-ebd940904305 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:36.417510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4920dd14-63ad-499c-beb9-ebd940904305 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:36.449051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4920dd14-63ad-499c-beb9-ebd940904305 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047312 Sep 13 20:07:36.449611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 504/894] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:37.464412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0e12c1c3-68ad-4afd-9b31-d33a495cc109 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:37.467408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0e12c1c3-68ad-4afd-9b31-d33a495cc109 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:37.476852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0e12c1c3-68ad-4afd-9b31-d33a495cc109 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:37.477526 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0e12c1c3-68ad-4afd-9b31-d33a495cc109 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:37.478145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0e12c1c3-68ad-4afd-9b31-d33a495cc109 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:37.479146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0e12c1c3-68ad-4afd-9b31-d33a495cc109 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:37.479593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0e12c1c3-68ad-4afd-9b31-d33a495cc109 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:37.480003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0e12c1c3-68ad-4afd-9b31-d33a495cc109 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:37.519181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0e12c1c3-68ad-4afd-9b31-d33a495cc109 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060596 Sep 13 20:07:37.520625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 391/895] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:38.536219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e66b66c0-814a-4464-be3b-91eb739875f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:38.539673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e66b66c0-814a-4464-be3b-91eb739875f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:38.549934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e66b66c0-814a-4464-be3b-91eb739875f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:38.550708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e66b66c0-814a-4464-be3b-91eb739875f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:38.551398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e66b66c0-814a-4464-be3b-91eb739875f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:38.553066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e66b66c0-814a-4464-be3b-91eb739875f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:38.553066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e66b66c0-814a-4464-be3b-91eb739875f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:38.553480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e66b66c0-814a-4464-be3b-91eb739875f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:38.586653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e66b66c0-814a-4464-be3b-91eb739875f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057086 Sep 13 20:07:38.587216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 505/896] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:39.599621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c6b3b835-0481-4806-b60e-891da1108a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:39.601836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c6b3b835-0481-4806-b60e-891da1108a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:39.608860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c6b3b835-0481-4806-b60e-891da1108a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:39.609342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c6b3b835-0481-4806-b60e-891da1108a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:39.610078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c6b3b835-0481-4806-b60e-891da1108a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:39.610484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c6b3b835-0481-4806-b60e-891da1108a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:39.610927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c6b3b835-0481-4806-b60e-891da1108a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:39.611341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c6b3b835-0481-4806-b60e-891da1108a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:39.641693 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c6b3b835-0481-4806-b60e-891da1108a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046125 Sep 13 20:07:39.642254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 392/897] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:40.655240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5e1f5e62-78a1-4f16-a309-22545963be55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:40.657449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5e1f5e62-78a1-4f16-a309-22545963be55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:40.664334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5e1f5e62-78a1-4f16-a309-22545963be55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:40.664819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5e1f5e62-78a1-4f16-a309-22545963be55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:40.665252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5e1f5e62-78a1-4f16-a309-22545963be55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:40.665953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5e1f5e62-78a1-4f16-a309-22545963be55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:40.666415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5e1f5e62-78a1-4f16-a309-22545963be55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:40.666850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5e1f5e62-78a1-4f16-a309-22545963be55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:40.697429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5e1f5e62-78a1-4f16-a309-22545963be55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046440 Sep 13 20:07:40.697981 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 506/898] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:41.710122 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3083b964-3aac-47f1-8d9b-cfabef4d82b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:41.712329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3083b964-3aac-47f1-8d9b-cfabef4d82b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:41.719193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3083b964-3aac-47f1-8d9b-cfabef4d82b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:41.719676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3083b964-3aac-47f1-8d9b-cfabef4d82b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:41.720105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3083b964-3aac-47f1-8d9b-cfabef4d82b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:41.720795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3083b964-3aac-47f1-8d9b-cfabef4d82b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:41.721243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3083b964-3aac-47f1-8d9b-cfabef4d82b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:41.721664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3083b964-3aac-47f1-8d9b-cfabef4d82b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:41.751866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3083b964-3aac-47f1-8d9b-cfabef4d82b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045789 Sep 13 20:07:41.752421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 393/899] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:41 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:42.766662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1ba2dc94-87b4-4b44-b651-e138d86fbd40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:42.769019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1ba2dc94-87b4-4b44-b651-e138d86fbd40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:42.776541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ba2dc94-87b4-4b44-b651-e138d86fbd40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:42.777064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ba2dc94-87b4-4b44-b651-e138d86fbd40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:42.777533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ba2dc94-87b4-4b44-b651-e138d86fbd40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:42.778292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ba2dc94-87b4-4b44-b651-e138d86fbd40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:42.778817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ba2dc94-87b4-4b44-b651-e138d86fbd40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:42.779272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ba2dc94-87b4-4b44-b651-e138d86fbd40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:42.810718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1ba2dc94-87b4-4b44-b651-e138d86fbd40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048526 Sep 13 20:07:42.811300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 507/900] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:43.827496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1a62c9df-ca3a-453a-92d2-30563adc6f9a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:43.829745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1a62c9df-ca3a-453a-92d2-30563adc6f9a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:43.837277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1a62c9df-ca3a-453a-92d2-30563adc6f9a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:43.837814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1a62c9df-ca3a-453a-92d2-30563adc6f9a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:43.838292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1a62c9df-ca3a-453a-92d2-30563adc6f9a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:43.839225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1a62c9df-ca3a-453a-92d2-30563adc6f9a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:43.839693 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1a62c9df-ca3a-453a-92d2-30563adc6f9a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:43.840113 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1a62c9df-ca3a-453a-92d2-30563adc6f9a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:43.870335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1a62c9df-ca3a-453a-92d2-30563adc6f9a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047341 Sep 13 20:07:43.870927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 394/901] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:44.886017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b50fd7ad-f7e3-45ea-9b81-0b1d01b220a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:44.888157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b50fd7ad-f7e3-45ea-9b81-0b1d01b220a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:44.894658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b50fd7ad-f7e3-45ea-9b81-0b1d01b220a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:44.895131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b50fd7ad-f7e3-45ea-9b81-0b1d01b220a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:44.895554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b50fd7ad-f7e3-45ea-9b81-0b1d01b220a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:44.896229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b50fd7ad-f7e3-45ea-9b81-0b1d01b220a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:44.896670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b50fd7ad-f7e3-45ea-9b81-0b1d01b220a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:44.897082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b50fd7ad-f7e3-45ea-9b81-0b1d01b220a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:44.927137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b50fd7ad-f7e3-45ea-9b81-0b1d01b220a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045566 Sep 13 20:07:44.927699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 508/902] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:45.941716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cead7eba-d0fd-4b40-8e28-694570250caa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:45.943816 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cead7eba-d0fd-4b40-8e28-694570250caa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:45.950712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cead7eba-d0fd-4b40-8e28-694570250caa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:45.951198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cead7eba-d0fd-4b40-8e28-694570250caa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:45.951633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cead7eba-d0fd-4b40-8e28-694570250caa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:45.952331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cead7eba-d0fd-4b40-8e28-694570250caa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:45.952779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cead7eba-d0fd-4b40-8e28-694570250caa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:45.953205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cead7eba-d0fd-4b40-8e28-694570250caa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:45.984332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cead7eba-d0fd-4b40-8e28-694570250caa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047390 Sep 13 20:07:45.984895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 395/903] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:47.000189 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-27cd4a8d-7e54-4358-821e-00ab0ae63918 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:47.003140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-27cd4a8d-7e54-4358-821e-00ab0ae63918 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:47.006106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=30 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:47.013317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27cd4a8d-7e54-4358-821e-00ab0ae63918 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:47.013786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27cd4a8d-7e54-4358-821e-00ab0ae63918 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:47.014193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27cd4a8d-7e54-4358-821e-00ab0ae63918 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:47.014942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27cd4a8d-7e54-4358-821e-00ab0ae63918 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:47.015396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27cd4a8d-7e54-4358-821e-00ab0ae63918 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:47.015816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27cd4a8d-7e54-4358-821e-00ab0ae63918 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:47.018277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=90 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:47.048046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-27cd4a8d-7e54-4358-821e-00ab0ae63918 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053357 Sep 13 20:07:47.048628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 509/904] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:48.060287 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-301f36b2-4f86-4000-8493-174d80c90d72 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:48.062865 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-301f36b2-4f86-4000-8493-174d80c90d72 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:48.065206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=30 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:48.070898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-301f36b2-4f86-4000-8493-174d80c90d72 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:48.071368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-301f36b2-4f86-4000-8493-174d80c90d72 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:48.071796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-301f36b2-4f86-4000-8493-174d80c90d72 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:48.072572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-301f36b2-4f86-4000-8493-174d80c90d72 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:48.072921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-301f36b2-4f86-4000-8493-174d80c90d72 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:48.073352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-301f36b2-4f86-4000-8493-174d80c90d72 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:48.075799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=90 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:48.104882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-301f36b2-4f86-4000-8493-174d80c90d72 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048656 Sep 13 20:07:48.105434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 396/905] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:48 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:49.119655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1d2c40d5-ac41-458c-befb-12115287d0a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:49.121998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1d2c40d5-ac41-458c-befb-12115287d0a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:49.131806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d2c40d5-ac41-458c-befb-12115287d0a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:49.131806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d2c40d5-ac41-458c-befb-12115287d0a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:49.131806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d2c40d5-ac41-458c-befb-12115287d0a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:49.131806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d2c40d5-ac41-458c-befb-12115287d0a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:49.132270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d2c40d5-ac41-458c-befb-12115287d0a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:49.132270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d2c40d5-ac41-458c-befb-12115287d0a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:49.164783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1d2c40d5-ac41-458c-befb-12115287d0a8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049288 Sep 13 20:07:49.165360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 510/906] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:50.178019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-213d5c81-ad0c-4bdc-b62a-b1303afa9523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:50.180304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-213d5c81-ad0c-4bdc-b62a-b1303afa9523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:50.188032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-213d5c81-ad0c-4bdc-b62a-b1303afa9523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:50.188543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-213d5c81-ad0c-4bdc-b62a-b1303afa9523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:50.189005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-213d5c81-ad0c-4bdc-b62a-b1303afa9523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:50.189734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-213d5c81-ad0c-4bdc-b62a-b1303afa9523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:50.190204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-213d5c81-ad0c-4bdc-b62a-b1303afa9523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:50.190683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-213d5c81-ad0c-4bdc-b62a-b1303afa9523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:50.224104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-213d5c81-ad0c-4bdc-b62a-b1303afa9523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050318 Sep 13 20:07:50.224672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 397/907] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:51.240102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a89f7048-3d3e-45be-a2fd-3544a908bb29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:51.243359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a89f7048-3d3e-45be-a2fd-3544a908bb29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:51.251223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a89f7048-3d3e-45be-a2fd-3544a908bb29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:51.251708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a89f7048-3d3e-45be-a2fd-3544a908bb29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:51.252429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a89f7048-3d3e-45be-a2fd-3544a908bb29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:51.253128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a89f7048-3d3e-45be-a2fd-3544a908bb29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:51.253586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a89f7048-3d3e-45be-a2fd-3544a908bb29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:51.254006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a89f7048-3d3e-45be-a2fd-3544a908bb29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:51.284765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a89f7048-3d3e-45be-a2fd-3544a908bb29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051089 Sep 13 20:07:51.285325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 511/908] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:52.300254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b1c2e882-11e1-4921-991a-e491f9ead017 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:52.302773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b1c2e882-11e1-4921-991a-e491f9ead017 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:52.310791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1c2e882-11e1-4921-991a-e491f9ead017 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:52.311365 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1c2e882-11e1-4921-991a-e491f9ead017 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:52.311883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1c2e882-11e1-4921-991a-e491f9ead017 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:52.313186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1c2e882-11e1-4921-991a-e491f9ead017 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:52.313592 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1c2e882-11e1-4921-991a-e491f9ead017 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:52.314087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1c2e882-11e1-4921-991a-e491f9ead017 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:52.346184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b1c2e882-11e1-4921-991a-e491f9ead017 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050694 Sep 13 20:07:52.346774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 398/909] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:53.361040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7101f753-d7e1-4783-a154-db95dc9aea2b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:53.363284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7101f753-d7e1-4783-a154-db95dc9aea2b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:53.370340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7101f753-d7e1-4783-a154-db95dc9aea2b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:53.370857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7101f753-d7e1-4783-a154-db95dc9aea2b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:53.371298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7101f753-d7e1-4783-a154-db95dc9aea2b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:53.371986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7101f753-d7e1-4783-a154-db95dc9aea2b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:53.372553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7101f753-d7e1-4783-a154-db95dc9aea2b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:53.372983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7101f753-d7e1-4783-a154-db95dc9aea2b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:53.405056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7101f753-d7e1-4783-a154-db95dc9aea2b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048014 Sep 13 20:07:53.406093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 512/910] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:53 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:54.420130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-81373bcb-daf6-487f-aff9-803175d14c40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:54.422330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-81373bcb-daf6-487f-aff9-803175d14c40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:54.429270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-81373bcb-daf6-487f-aff9-803175d14c40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:54.429755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-81373bcb-daf6-487f-aff9-803175d14c40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:54.430190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-81373bcb-daf6-487f-aff9-803175d14c40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:54.430917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-81373bcb-daf6-487f-aff9-803175d14c40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:54.431368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-81373bcb-daf6-487f-aff9-803175d14c40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:54.431817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-81373bcb-daf6-487f-aff9-803175d14c40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:54.461954 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-81373bcb-daf6-487f-aff9-803175d14c40 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047059 Sep 13 20:07:54.462538 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 399/911] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:54 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:55.475876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f89618c9-e4d0-40fc-8f09-d823ae63474c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:55.478229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f89618c9-e4d0-40fc-8f09-d823ae63474c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:55.485407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f89618c9-e4d0-40fc-8f09-d823ae63474c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:55.485885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f89618c9-e4d0-40fc-8f09-d823ae63474c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:55.486307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f89618c9-e4d0-40fc-8f09-d823ae63474c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:55.487017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f89618c9-e4d0-40fc-8f09-d823ae63474c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:55.487457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f89618c9-e4d0-40fc-8f09-d823ae63474c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:55.487871 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f89618c9-e4d0-40fc-8f09-d823ae63474c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:55.519134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f89618c9-e4d0-40fc-8f09-d823ae63474c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047698 Sep 13 20:07:55.519685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 513/912] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:56.533577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-029ff4b2-d360-49d4-b16a-a2553faea53e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:56.535854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-029ff4b2-d360-49d4-b16a-a2553faea53e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:56.543119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-029ff4b2-d360-49d4-b16a-a2553faea53e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:56.543586 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-029ff4b2-d360-49d4-b16a-a2553faea53e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:56.544025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-029ff4b2-d360-49d4-b16a-a2553faea53e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:56.544813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-029ff4b2-d360-49d4-b16a-a2553faea53e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:56.545269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-029ff4b2-d360-49d4-b16a-a2553faea53e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:56.545673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-029ff4b2-d360-49d4-b16a-a2553faea53e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:56.579767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-029ff4b2-d360-49d4-b16a-a2553faea53e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050594 Sep 13 20:07:56.580332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 400/913] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:57.595398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c39247cf-9a9f-4bcf-b93f-5ec5beef0a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:57.597625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c39247cf-9a9f-4bcf-b93f-5ec5beef0a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:57.604556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c39247cf-9a9f-4bcf-b93f-5ec5beef0a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:57.605042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c39247cf-9a9f-4bcf-b93f-5ec5beef0a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:57.605475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c39247cf-9a9f-4bcf-b93f-5ec5beef0a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:57.606171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c39247cf-9a9f-4bcf-b93f-5ec5beef0a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:57.606655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c39247cf-9a9f-4bcf-b93f-5ec5beef0a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:57.607076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c39247cf-9a9f-4bcf-b93f-5ec5beef0a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:57.638284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c39247cf-9a9f-4bcf-b93f-5ec5beef0a42 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046941 Sep 13 20:07:57.638953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 514/914] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:58.651678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-badd64c1-7695-4d87-bbb6-13040a7f3f70 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:58.654331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-badd64c1-7695-4d87-bbb6-13040a7f3f70 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:58.661308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-badd64c1-7695-4d87-bbb6-13040a7f3f70 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:58.661795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-badd64c1-7695-4d87-bbb6-13040a7f3f70 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:58.662234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-badd64c1-7695-4d87-bbb6-13040a7f3f70 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:58.662961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-badd64c1-7695-4d87-bbb6-13040a7f3f70 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:58.663419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-badd64c1-7695-4d87-bbb6-13040a7f3f70 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:58.663838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-badd64c1-7695-4d87-bbb6-13040a7f3f70 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:58.696919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-badd64c1-7695-4d87-bbb6-13040a7f3f70 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049681 Sep 13 20:07:58.697481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 401/915] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:07:59.710400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9be557a0-0937-4cb1-9ab5-29f5fa5ac73f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:59.712848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9be557a0-0937-4cb1-9ab5-29f5fa5ac73f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:59.720913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9be557a0-0937-4cb1-9ab5-29f5fa5ac73f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:59.721447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9be557a0-0937-4cb1-9ab5-29f5fa5ac73f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:59.721919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9be557a0-0937-4cb1-9ab5-29f5fa5ac73f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:59.722761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9be557a0-0937-4cb1-9ab5-29f5fa5ac73f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:59.723266 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9be557a0-0937-4cb1-9ab5-29f5fa5ac73f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:59.723751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9be557a0-0937-4cb1-9ab5-29f5fa5ac73f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:59.755197 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9be557a0-0937-4cb1-9ab5-29f5fa5ac73f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049413 Sep 13 20:07:59.755741 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 515/916] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:07:59 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:00.769314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-47c91910-23e1-4899-87f4-bdf058602f3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:00.771673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-47c91910-23e1-4899-87f4-bdf058602f3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:00.778748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47c91910-23e1-4899-87f4-bdf058602f3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:00.779267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47c91910-23e1-4899-87f4-bdf058602f3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:00.779746 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47c91910-23e1-4899-87f4-bdf058602f3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:00.780533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47c91910-23e1-4899-87f4-bdf058602f3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:00.780988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47c91910-23e1-4899-87f4-bdf058602f3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:00.781411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47c91910-23e1-4899-87f4-bdf058602f3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:00.812825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-47c91910-23e1-4899-87f4-bdf058602f3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048311 Sep 13 20:08:00.813394 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 402/917] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:00 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:01.829474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5bfa9ad5-93f5-4914-a664-cab466931aeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:01.832368 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5bfa9ad5-93f5-4914-a664-cab466931aeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:01.841886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bfa9ad5-93f5-4914-a664-cab466931aeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:01.842447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bfa9ad5-93f5-4914-a664-cab466931aeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:01.843021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bfa9ad5-93f5-4914-a664-cab466931aeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:01.843993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bfa9ad5-93f5-4914-a664-cab466931aeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:01.844447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bfa9ad5-93f5-4914-a664-cab466931aeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:01.844868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bfa9ad5-93f5-4914-a664-cab466931aeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:01.875494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5bfa9ad5-93f5-4914-a664-cab466931aeb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051823 Sep 13 20:08:01.876049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 516/918] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:02.888975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3cbf6c00-483a-43d4-9bfa-eb91a4c1b3a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:02.891162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3cbf6c00-483a-43d4-9bfa-eb91a4c1b3a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:02.898034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3cbf6c00-483a-43d4-9bfa-eb91a4c1b3a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:02.898544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3cbf6c00-483a-43d4-9bfa-eb91a4c1b3a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:02.899000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3cbf6c00-483a-43d4-9bfa-eb91a4c1b3a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:02.899686 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3cbf6c00-483a-43d4-9bfa-eb91a4c1b3a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:02.900109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3cbf6c00-483a-43d4-9bfa-eb91a4c1b3a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:02.900557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3cbf6c00-483a-43d4-9bfa-eb91a4c1b3a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:02.936554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3cbf6c00-483a-43d4-9bfa-eb91a4c1b3a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051549 Sep 13 20:08:02.937143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 403/919] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:03.953949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6e68de9f-4dcf-408e-9ae2-981bb346d62d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:03.956950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6e68de9f-4dcf-408e-9ae2-981bb346d62d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:03.967130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e68de9f-4dcf-408e-9ae2-981bb346d62d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:03.967788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e68de9f-4dcf-408e-9ae2-981bb346d62d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:03.968364 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e68de9f-4dcf-408e-9ae2-981bb346d62d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:03.969320 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e68de9f-4dcf-408e-9ae2-981bb346d62d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:03.969979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e68de9f-4dcf-408e-9ae2-981bb346d62d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:03.970414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e68de9f-4dcf-408e-9ae2-981bb346d62d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:04.001402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6e68de9f-4dcf-408e-9ae2-981bb346d62d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053808 Sep 13 20:08:04.001971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 517/920] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:05.016203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b9e6601f-7f0d-4dd9-9b75-a3135ffe68ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:05.018603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b9e6601f-7f0d-4dd9-9b75-a3135ffe68ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:05.025542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9e6601f-7f0d-4dd9-9b75-a3135ffe68ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:05.026025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9e6601f-7f0d-4dd9-9b75-a3135ffe68ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:05.026489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9e6601f-7f0d-4dd9-9b75-a3135ffe68ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:05.027186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9e6601f-7f0d-4dd9-9b75-a3135ffe68ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:05.027632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9e6601f-7f0d-4dd9-9b75-a3135ffe68ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:05.028060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9e6601f-7f0d-4dd9-9b75-a3135ffe68ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:05.058545 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b9e6601f-7f0d-4dd9-9b75-a3135ffe68ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047096 Sep 13 20:08:05.059103 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 404/921] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:06.072090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f9d8111a-d2c8-4820-9b36-bcf403886e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:06.074274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f9d8111a-d2c8-4820-9b36-bcf403886e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:06.081254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9d8111a-d2c8-4820-9b36-bcf403886e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:06.081739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9d8111a-d2c8-4820-9b36-bcf403886e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:06.082173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9d8111a-d2c8-4820-9b36-bcf403886e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:06.082922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9d8111a-d2c8-4820-9b36-bcf403886e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:06.083364 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9d8111a-d2c8-4820-9b36-bcf403886e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:06.083790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9d8111a-d2c8-4820-9b36-bcf403886e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:06.114246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f9d8111a-d2c8-4820-9b36-bcf403886e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046260 Sep 13 20:08:06.115089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 518/922] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:06 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:07.128027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0deb24d0-daf9-4a9a-a5a6-5294c43fdfee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:07.130170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0deb24d0-daf9-4a9a-a5a6-5294c43fdfee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:07.137186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0deb24d0-daf9-4a9a-a5a6-5294c43fdfee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:07.137644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0deb24d0-daf9-4a9a-a5a6-5294c43fdfee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:07.138102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0deb24d0-daf9-4a9a-a5a6-5294c43fdfee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:07.138840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0deb24d0-daf9-4a9a-a5a6-5294c43fdfee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:07.139283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0deb24d0-daf9-4a9a-a5a6-5294c43fdfee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:07.139695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0deb24d0-daf9-4a9a-a5a6-5294c43fdfee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:07.172623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0deb24d0-daf9-4a9a-a5a6-5294c43fdfee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048728 Sep 13 20:08:07.173196 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 405/923] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:08.186517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c2910fb5-5466-4cef-9114-b69dc312816b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:08.188712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c2910fb5-5466-4cef-9114-b69dc312816b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:08.195975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c2910fb5-5466-4cef-9114-b69dc312816b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:08.196452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c2910fb5-5466-4cef-9114-b69dc312816b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:08.196873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c2910fb5-5466-4cef-9114-b69dc312816b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:08.197568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c2910fb5-5466-4cef-9114-b69dc312816b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:08.198006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c2910fb5-5466-4cef-9114-b69dc312816b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:08.198413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c2910fb5-5466-4cef-9114-b69dc312816b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:08.231502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c2910fb5-5466-4cef-9114-b69dc312816b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048712 Sep 13 20:08:08.232111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 519/924] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:09.247446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b841006b-2c61-445b-a858-6eb5184328a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:09.249620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b841006b-2c61-445b-a858-6eb5184328a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:09.256404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b841006b-2c61-445b-a858-6eb5184328a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:09.256876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b841006b-2c61-445b-a858-6eb5184328a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:09.257303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b841006b-2c61-445b-a858-6eb5184328a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:09.257978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b841006b-2c61-445b-a858-6eb5184328a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:09.258416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b841006b-2c61-445b-a858-6eb5184328a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:09.258925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b841006b-2c61-445b-a858-6eb5184328a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:09.289455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b841006b-2c61-445b-a858-6eb5184328a5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046120 Sep 13 20:08:09.290015 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 406/925] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:10.307429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-14e9a615-561d-4271-b875-c6dc42a6a193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:10.310386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-14e9a615-561d-4271-b875-c6dc42a6a193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:10.319131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14e9a615-561d-4271-b875-c6dc42a6a193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:10.319587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14e9a615-561d-4271-b875-c6dc42a6a193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:10.320010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14e9a615-561d-4271-b875-c6dc42a6a193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:10.320700 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14e9a615-561d-4271-b875-c6dc42a6a193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:10.321146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14e9a615-561d-4271-b875-c6dc42a6a193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:10.321561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14e9a615-561d-4271-b875-c6dc42a6a193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:10.351569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-14e9a615-561d-4271-b875-c6dc42a6a193 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050411 Sep 13 20:08:10.352112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 520/926] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:11.368223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f444b9b3-0dbb-4fa0-bfcd-3c4aa3fb5556 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:11.370505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f444b9b3-0dbb-4fa0-bfcd-3c4aa3fb5556 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:11.377151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f444b9b3-0dbb-4fa0-bfcd-3c4aa3fb5556 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:11.377627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f444b9b3-0dbb-4fa0-bfcd-3c4aa3fb5556 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:11.378065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f444b9b3-0dbb-4fa0-bfcd-3c4aa3fb5556 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:11.378789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f444b9b3-0dbb-4fa0-bfcd-3c4aa3fb5556 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:11.379236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f444b9b3-0dbb-4fa0-bfcd-3c4aa3fb5556 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:11.379652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f444b9b3-0dbb-4fa0-bfcd-3c4aa3fb5556 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:11.414593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f444b9b3-0dbb-4fa0-bfcd-3c4aa3fb5556 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050922 Sep 13 20:08:11.415152 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 407/927] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:11 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:12.427881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8e58a934-1575-4f2d-ab79-504584075e94 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:12.430057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8e58a934-1575-4f2d-ab79-504584075e94 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:12.436998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e58a934-1575-4f2d-ab79-504584075e94 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:12.437469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e58a934-1575-4f2d-ab79-504584075e94 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:12.437923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e58a934-1575-4f2d-ab79-504584075e94 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:12.438635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e58a934-1575-4f2d-ab79-504584075e94 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:12.439078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e58a934-1575-4f2d-ab79-504584075e94 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:12.439485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e58a934-1575-4f2d-ab79-504584075e94 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:12.469683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8e58a934-1575-4f2d-ab79-504584075e94 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045848 Sep 13 20:08:12.470234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 521/928] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:13.483302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-664aa0fc-4a46-4770-b618-2c7b058027e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:13.485469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-664aa0fc-4a46-4770-b618-2c7b058027e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:13.492476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-664aa0fc-4a46-4770-b618-2c7b058027e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:13.492959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-664aa0fc-4a46-4770-b618-2c7b058027e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:13.493401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-664aa0fc-4a46-4770-b618-2c7b058027e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:13.494100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-664aa0fc-4a46-4770-b618-2c7b058027e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:13.494592 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-664aa0fc-4a46-4770-b618-2c7b058027e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:13.495019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-664aa0fc-4a46-4770-b618-2c7b058027e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:13.524852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-664aa0fc-4a46-4770-b618-2c7b058027e1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045798 Sep 13 20:08:13.525433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 408/929] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:14.543152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-90328e7d-ded7-4765-a165-9fc46c7fb14f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:14.546443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-90328e7d-ded7-4765-a165-9fc46c7fb14f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:14.568556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90328e7d-ded7-4765-a165-9fc46c7fb14f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:14.569068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90328e7d-ded7-4765-a165-9fc46c7fb14f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:14.569482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90328e7d-ded7-4765-a165-9fc46c7fb14f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:14.570224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90328e7d-ded7-4765-a165-9fc46c7fb14f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:14.570720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90328e7d-ded7-4765-a165-9fc46c7fb14f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:14.571128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90328e7d-ded7-4765-a165-9fc46c7fb14f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:14.613796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-90328e7d-ded7-4765-a165-9fc46c7fb14f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077133 Sep 13 20:08:14.614454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 522/930] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:15.627530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dc8c39d0-dde4-4f78-8fad-394e661f466d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:15.629703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dc8c39d0-dde4-4f78-8fad-394e661f466d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:15.636707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc8c39d0-dde4-4f78-8fad-394e661f466d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:15.637195 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc8c39d0-dde4-4f78-8fad-394e661f466d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:15.637631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc8c39d0-dde4-4f78-8fad-394e661f466d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:15.638322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc8c39d0-dde4-4f78-8fad-394e661f466d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:15.638814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc8c39d0-dde4-4f78-8fad-394e661f466d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:15.639245 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc8c39d0-dde4-4f78-8fad-394e661f466d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:15.669959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dc8c39d0-dde4-4f78-8fad-394e661f466d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046493 Sep 13 20:08:15.670578 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 409/931] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:16.683488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-550da014-a7f3-47c2-8505-fb1bb73237b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:16.685660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-550da014-a7f3-47c2-8505-fb1bb73237b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:16.693322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-550da014-a7f3-47c2-8505-fb1bb73237b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:16.693833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-550da014-a7f3-47c2-8505-fb1bb73237b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:16.694267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-550da014-a7f3-47c2-8505-fb1bb73237b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:16.695009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-550da014-a7f3-47c2-8505-fb1bb73237b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:16.695460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-550da014-a7f3-47c2-8505-fb1bb73237b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:16.695880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-550da014-a7f3-47c2-8505-fb1bb73237b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:16.726851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-550da014-a7f3-47c2-8505-fb1bb73237b3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046333 Sep 13 20:08:16.726851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 523/932] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:16 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:17.741114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a5542d63-f756-4a7c-81f9-e980b94c5563 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:17.743322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a5542d63-f756-4a7c-81f9-e980b94c5563 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:17.750494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5542d63-f756-4a7c-81f9-e980b94c5563 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:17.750984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5542d63-f756-4a7c-81f9-e980b94c5563 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:17.751412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5542d63-f756-4a7c-81f9-e980b94c5563 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:17.752100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5542d63-f756-4a7c-81f9-e980b94c5563 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:17.752549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5542d63-f756-4a7c-81f9-e980b94c5563 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:17.752969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5542d63-f756-4a7c-81f9-e980b94c5563 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:17.783597 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a5542d63-f756-4a7c-81f9-e980b94c5563 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046900 Sep 13 20:08:17.784164 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 410/933] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:17 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:18.800630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-38bb28a9-4180-46e5-bd50-ada00b93eab9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:18.803644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-38bb28a9-4180-46e5-bd50-ada00b93eab9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:18.806068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=30 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:18.811906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-38bb28a9-4180-46e5-bd50-ada00b93eab9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:18.812382 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-38bb28a9-4180-46e5-bd50-ada00b93eab9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:18.812823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-38bb28a9-4180-46e5-bd50-ada00b93eab9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:18.813506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-38bb28a9-4180-46e5-bd50-ada00b93eab9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:18.813950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-38bb28a9-4180-46e5-bd50-ada00b93eab9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:18.814362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-38bb28a9-4180-46e5-bd50-ada00b93eab9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:18.817297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=90 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:18.847156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-38bb28a9-4180-46e5-bd50-ada00b93eab9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052910 Sep 13 20:08:18.847705 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 524/934] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:19.860808 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f42eaefe-f630-46e0-aa9e-78baa9d4f336 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:19.863046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f42eaefe-f630-46e0-aa9e-78baa9d4f336 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:19.865491 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=30 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:19.871260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f42eaefe-f630-46e0-aa9e-78baa9d4f336 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:19.871766 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f42eaefe-f630-46e0-aa9e-78baa9d4f336 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:19.872222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f42eaefe-f630-46e0-aa9e-78baa9d4f336 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:19.872947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f42eaefe-f630-46e0-aa9e-78baa9d4f336 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:19.873414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f42eaefe-f630-46e0-aa9e-78baa9d4f336 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:19.873860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f42eaefe-f630-46e0-aa9e-78baa9d4f336 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:19.876576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=90 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:19.904780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f42eaefe-f630-46e0-aa9e-78baa9d4f336 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048300 Sep 13 20:08:19.905350 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 411/935] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:20.918003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-25b001cf-31f3-496c-aa7f-85a8af177ec0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:20.920159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-25b001cf-31f3-496c-aa7f-85a8af177ec0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:20.927138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-25b001cf-31f3-496c-aa7f-85a8af177ec0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:20.927614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-25b001cf-31f3-496c-aa7f-85a8af177ec0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:20.928048 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-25b001cf-31f3-496c-aa7f-85a8af177ec0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:20.928874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-25b001cf-31f3-496c-aa7f-85a8af177ec0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:20.929326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-25b001cf-31f3-496c-aa7f-85a8af177ec0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:20.929749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-25b001cf-31f3-496c-aa7f-85a8af177ec0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:20.962744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-25b001cf-31f3-496c-aa7f-85a8af177ec0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048854 Sep 13 20:08:20.963313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 525/936] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:21.976775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-36b2118b-252f-4d82-92e2-b699a67c4c83 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:21.979049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-36b2118b-252f-4d82-92e2-b699a67c4c83 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:21.986088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36b2118b-252f-4d82-92e2-b699a67c4c83 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:21.986606 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36b2118b-252f-4d82-92e2-b699a67c4c83 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:21.987019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36b2118b-252f-4d82-92e2-b699a67c4c83 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:21.987745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36b2118b-252f-4d82-92e2-b699a67c4c83 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:21.988201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36b2118b-252f-4d82-92e2-b699a67c4c83 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:21.988653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36b2118b-252f-4d82-92e2-b699a67c4c83 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:22.018945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-36b2118b-252f-4d82-92e2-b699a67c4c83 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046857 Sep 13 20:08:22.019506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 412/937] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:23.035994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f3286fba-3cc6-4831-ace9-8b0a98adac88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:23.039150 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f3286fba-3cc6-4831-ace9-8b0a98adac88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:23.045926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f3286fba-3cc6-4831-ace9-8b0a98adac88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:23.046411 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f3286fba-3cc6-4831-ace9-8b0a98adac88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:23.046875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f3286fba-3cc6-4831-ace9-8b0a98adac88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:23.047567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f3286fba-3cc6-4831-ace9-8b0a98adac88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:23.048006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f3286fba-3cc6-4831-ace9-8b0a98adac88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:23.048427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f3286fba-3cc6-4831-ace9-8b0a98adac88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:23.079661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f3286fba-3cc6-4831-ace9-8b0a98adac88 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050145 Sep 13 20:08:23.080230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 526/938] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:23 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:24.093625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9aa56fa2-2747-4dab-a32d-0c66e92d76b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:24.096073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9aa56fa2-2747-4dab-a32d-0c66e92d76b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:24.103688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aa56fa2-2747-4dab-a32d-0c66e92d76b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:24.104231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aa56fa2-2747-4dab-a32d-0c66e92d76b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:24.104716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aa56fa2-2747-4dab-a32d-0c66e92d76b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:24.105609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aa56fa2-2747-4dab-a32d-0c66e92d76b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:24.106114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aa56fa2-2747-4dab-a32d-0c66e92d76b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:24.106668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aa56fa2-2747-4dab-a32d-0c66e92d76b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:24.139092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9aa56fa2-2747-4dab-a32d-0c66e92d76b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049977 Sep 13 20:08:24.139657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 413/939] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:25.152554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3c4e495d-1f85-49ff-886b-4d332928fad2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:25.154758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3c4e495d-1f85-49ff-886b-4d332928fad2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:25.161892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c4e495d-1f85-49ff-886b-4d332928fad2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:25.162351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c4e495d-1f85-49ff-886b-4d332928fad2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:25.162812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c4e495d-1f85-49ff-886b-4d332928fad2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:25.163511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c4e495d-1f85-49ff-886b-4d332928fad2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:25.164056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c4e495d-1f85-49ff-886b-4d332928fad2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:25.164477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c4e495d-1f85-49ff-886b-4d332928fad2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:25.195194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3c4e495d-1f85-49ff-886b-4d332928fad2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046647 Sep 13 20:08:25.195804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 527/940] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:25.874977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4dbc692b-72ce-466d-b21c-3a460c8aa50c tempest-TestShelveInstance-1135103935 tempest-TestShelveInstance-1135103935-project] Calling method '.version_select at 0x7f98463f6430>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:25.901851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4dbc692b-72ce-466d-b21c-3a460c8aa50c tempest-TestShelveInstance-1135103935 tempest-TestShelveInstance-1135103935-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-293906173" status: 202 len: 0 microversion: 2.1 time: 0.030785 Sep 13 20:08:25.902507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 414/941] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 13 20:08:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-293906173 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 20:08:26.208938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5601686a-e5a7-4fbf-9c10-1a61bc5c02b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:26.211479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5601686a-e5a7-4fbf-9c10-1a61bc5c02b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:26.218229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5601686a-e5a7-4fbf-9c10-1a61bc5c02b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:26.218738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5601686a-e5a7-4fbf-9c10-1a61bc5c02b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:26.219172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5601686a-e5a7-4fbf-9c10-1a61bc5c02b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:26.219975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5601686a-e5a7-4fbf-9c10-1a61bc5c02b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:26.220345 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5601686a-e5a7-4fbf-9c10-1a61bc5c02b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:26.220768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5601686a-e5a7-4fbf-9c10-1a61bc5c02b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:26.251545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5601686a-e5a7-4fbf-9c10-1a61bc5c02b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046618 Sep 13 20:08:26.252324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 528/942] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:27.371050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-29d3723b-6213-41cd-8434-418dcadfed7d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:27.374724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-29d3723b-6213-41cd-8434-418dcadfed7d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:27.380786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29d3723b-6213-41cd-8434-418dcadfed7d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:27.381271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29d3723b-6213-41cd-8434-418dcadfed7d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:27.381697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29d3723b-6213-41cd-8434-418dcadfed7d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:27.382612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29d3723b-6213-41cd-8434-418dcadfed7d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:27.383105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29d3723b-6213-41cd-8434-418dcadfed7d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:27.383524 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29d3723b-6213-41cd-8434-418dcadfed7d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:27.412936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-29d3723b-6213-41cd-8434-418dcadfed7d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.152411 Sep 13 20:08:27.413544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 415/943] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:27 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:28.426041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7963f237-8ebb-4d88-823b-19a2c2070cde tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:28.428570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7963f237-8ebb-4d88-823b-19a2c2070cde tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:28.435236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7963f237-8ebb-4d88-823b-19a2c2070cde tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:28.435858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7963f237-8ebb-4d88-823b-19a2c2070cde tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:28.436427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7963f237-8ebb-4d88-823b-19a2c2070cde tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:28.437208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7963f237-8ebb-4d88-823b-19a2c2070cde tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:28.437939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7963f237-8ebb-4d88-823b-19a2c2070cde tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:28.438449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7963f237-8ebb-4d88-823b-19a2c2070cde tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:28.470881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7963f237-8ebb-4d88-823b-19a2c2070cde tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049195 Sep 13 20:08:28.471698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 529/944] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:29.483862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b0c9b56b-e81c-49c7-b791-8f97ce697506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:29.486015 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b0c9b56b-e81c-49c7-b791-8f97ce697506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:29.495513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b0c9b56b-e81c-49c7-b791-8f97ce697506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:29.496006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b0c9b56b-e81c-49c7-b791-8f97ce697506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:29.496435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b0c9b56b-e81c-49c7-b791-8f97ce697506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:29.497137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b0c9b56b-e81c-49c7-b791-8f97ce697506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:29.497826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b0c9b56b-e81c-49c7-b791-8f97ce697506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:29.498299 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b0c9b56b-e81c-49c7-b791-8f97ce697506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:29.529788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b0c9b56b-e81c-49c7-b791-8f97ce697506 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049867 Sep 13 20:08:29.530355 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 416/945] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:29 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:30.549593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-32eebcae-7ac2-4a6d-8ecd-8cde1022dd45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:30.551894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-32eebcae-7ac2-4a6d-8ecd-8cde1022dd45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:30.558416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-32eebcae-7ac2-4a6d-8ecd-8cde1022dd45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:30.558929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-32eebcae-7ac2-4a6d-8ecd-8cde1022dd45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:30.559358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-32eebcae-7ac2-4a6d-8ecd-8cde1022dd45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:30.560528 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-32eebcae-7ac2-4a6d-8ecd-8cde1022dd45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:30.560528 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-32eebcae-7ac2-4a6d-8ecd-8cde1022dd45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:30.560936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-32eebcae-7ac2-4a6d-8ecd-8cde1022dd45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:30.593116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-32eebcae-7ac2-4a6d-8ecd-8cde1022dd45 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053368 Sep 13 20:08:30.593670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 530/946] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:30 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:31.605644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ecea0bef-9baa-4404-a7a0-cc14b3fb13fe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:31.608042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ecea0bef-9baa-4404-a7a0-cc14b3fb13fe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:31.615490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ecea0bef-9baa-4404-a7a0-cc14b3fb13fe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:31.616257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ecea0bef-9baa-4404-a7a0-cc14b3fb13fe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:31.616731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ecea0bef-9baa-4404-a7a0-cc14b3fb13fe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:31.617626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ecea0bef-9baa-4404-a7a0-cc14b3fb13fe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:31.618082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ecea0bef-9baa-4404-a7a0-cc14b3fb13fe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:31.618600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ecea0bef-9baa-4404-a7a0-cc14b3fb13fe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:31.650659 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ecea0bef-9baa-4404-a7a0-cc14b3fb13fe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048990 Sep 13 20:08:31.651572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 417/947] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:32.663919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-812e6278-f7b3-4854-a4e7-c15e5ca4cf15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:32.666267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-812e6278-f7b3-4854-a4e7-c15e5ca4cf15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:32.673925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-812e6278-f7b3-4854-a4e7-c15e5ca4cf15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:32.674984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-812e6278-f7b3-4854-a4e7-c15e5ca4cf15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:32.674984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-812e6278-f7b3-4854-a4e7-c15e5ca4cf15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:32.675912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-812e6278-f7b3-4854-a4e7-c15e5ca4cf15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:32.676447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-812e6278-f7b3-4854-a4e7-c15e5ca4cf15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:32.676903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-812e6278-f7b3-4854-a4e7-c15e5ca4cf15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:32.709572 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-812e6278-f7b3-4854-a4e7-c15e5ca4cf15 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049606 Sep 13 20:08:32.710518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 531/948] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:33.721386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4d4d9cf5-e247-46d7-8db4-eaaac3367865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:33.723667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4d4d9cf5-e247-46d7-8db4-eaaac3367865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:33.730646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d4d9cf5-e247-46d7-8db4-eaaac3367865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:33.731132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d4d9cf5-e247-46d7-8db4-eaaac3367865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:33.731792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d4d9cf5-e247-46d7-8db4-eaaac3367865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:33.732489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d4d9cf5-e247-46d7-8db4-eaaac3367865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:33.732935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d4d9cf5-e247-46d7-8db4-eaaac3367865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:33.733337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d4d9cf5-e247-46d7-8db4-eaaac3367865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:33.763279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4d4d9cf5-e247-46d7-8db4-eaaac3367865 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045822 Sep 13 20:08:33.763823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 418/949] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:34.384999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-922891d0-900f-4fdf-8652-2e51e3ad9329 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:34.384999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-922891d0-900f-4fdf-8652-2e51e3ad9329 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:34.384999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-922891d0-900f-4fdf-8652-2e51e3ad9329 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:34.384999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-922891d0-900f-4fdf-8652-2e51e3ad9329 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:34.385810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-922891d0-900f-4fdf-8652-2e51e3ad9329 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:34.385810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-922891d0-900f-4fdf-8652-2e51e3ad9329 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:34.386103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-922891d0-900f-4fdf-8652-2e51e3ad9329 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:34.386550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-922891d0-900f-4fdf-8652-2e51e3ad9329 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:34.709717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-922891d0-900f-4fdf-8652-2e51e3ad9329 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lazy-loading 'services' on Instance uuid de498757-f0f1-4f8b-a415-4d6b12f64d37 {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:08:34.777315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dd011e18-ceee-4b2c-a4cf-4adc41adc19c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:34.779779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dd011e18-ceee-4b2c-a4cf-4adc41adc19c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:34.787073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd011e18-ceee-4b2c-a4cf-4adc41adc19c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:34.787677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd011e18-ceee-4b2c-a4cf-4adc41adc19c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:34.788160 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd011e18-ceee-4b2c-a4cf-4adc41adc19c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:34.789055 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd011e18-ceee-4b2c-a4cf-4adc41adc19c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:34.789585 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd011e18-ceee-4b2c-a4cf-4adc41adc19c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:34.790011 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd011e18-ceee-4b2c-a4cf-4adc41adc19c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:34.793590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR oslo.messaging._drivers.impl_rabbit [None req-922891d0-900f-4fdf-8652-2e51e3ad9329 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [a118af4a-3fce-4635-a129-ce73a2ce12b8] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 20:08:34.820680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dd011e18-ceee-4b2c-a4cf-4adc41adc19c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047914 Sep 13 20:08:34.821339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 419/950] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:34 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:35.804968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [None req-922891d0-900f-4fdf-8652-2e51e3ad9329 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [a118af4a-3fce-4635-a129-ce73a2ce12b8] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 48188. Sep 13 20:08:35.810569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-922891d0-900f-4fdf-8652-2e51e3ad9329 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37/os-volume_attachments/1f99cdb4-f2d0-4077-b85b-d4cf6739ede0" status: 202 len: 0 microversion: 2.1 time: 1.437691 Sep 13 20:08:35.811389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 532/951] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 13 20:08:34 2022] DELETE /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37/os-volume_attachments/1f99cdb4-f2d0-4077-b85b-d4cf6739ede0 => generated 0 bytes in 1439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 20:08:35.836246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bec10038-f9dc-4ce1-895b-ab20540b93c8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:35.839889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bec10038-f9dc-4ce1-895b-ab20540b93c8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:35.846697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bec10038-f9dc-4ce1-895b-ab20540b93c8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:35.847418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bec10038-f9dc-4ce1-895b-ab20540b93c8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:35.847996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bec10038-f9dc-4ce1-895b-ab20540b93c8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:35.848839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bec10038-f9dc-4ce1-895b-ab20540b93c8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:35.849518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bec10038-f9dc-4ce1-895b-ab20540b93c8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:35.849970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bec10038-f9dc-4ce1-895b-ab20540b93c8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:35.881173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bec10038-f9dc-4ce1-895b-ab20540b93c8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051368 Sep 13 20:08:35.882280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 420/952] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:35 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:36.894486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-75e09d91-e71f-4b6e-a75f-e3253ec4acd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:36.896817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-75e09d91-e71f-4b6e-a75f-e3253ec4acd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:36.903481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75e09d91-e71f-4b6e-a75f-e3253ec4acd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:36.903954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75e09d91-e71f-4b6e-a75f-e3253ec4acd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:36.904421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75e09d91-e71f-4b6e-a75f-e3253ec4acd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:36.905132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75e09d91-e71f-4b6e-a75f-e3253ec4acd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:36.905580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75e09d91-e71f-4b6e-a75f-e3253ec4acd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:36.906000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75e09d91-e71f-4b6e-a75f-e3253ec4acd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:36.938458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-75e09d91-e71f-4b6e-a75f-e3253ec4acd5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048884 Sep 13 20:08:36.939022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 533/953] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:37.951959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-670972e6-44f1-4234-9703-0f26b3adf4ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:37.954198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-670972e6-44f1-4234-9703-0f26b3adf4ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:37.961086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-670972e6-44f1-4234-9703-0f26b3adf4ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:37.961566 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-670972e6-44f1-4234-9703-0f26b3adf4ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:37.961997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-670972e6-44f1-4234-9703-0f26b3adf4ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:37.962723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-670972e6-44f1-4234-9703-0f26b3adf4ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:37.963166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-670972e6-44f1-4234-9703-0f26b3adf4ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:37.963557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-670972e6-44f1-4234-9703-0f26b3adf4ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:37.994172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-670972e6-44f1-4234-9703-0f26b3adf4ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046373 Sep 13 20:08:37.994883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 421/954] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:39.008783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3e452985-117a-410c-8a60-7af2ad7a1658 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:39.011471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3e452985-117a-410c-8a60-7af2ad7a1658 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:39.019663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e452985-117a-410c-8a60-7af2ad7a1658 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:39.020265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e452985-117a-410c-8a60-7af2ad7a1658 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:39.020804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e452985-117a-410c-8a60-7af2ad7a1658 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:39.021673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e452985-117a-410c-8a60-7af2ad7a1658 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:39.022236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e452985-117a-410c-8a60-7af2ad7a1658 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:39.022793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e452985-117a-410c-8a60-7af2ad7a1658 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:39.055325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3e452985-117a-410c-8a60-7af2ad7a1658 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051593 Sep 13 20:08:39.056162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 534/955] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:40.071869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7023e619-c220-4c69-9f51-f26e130e114c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:40.075000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7023e619-c220-4c69-9f51-f26e130e114c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:40.081470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7023e619-c220-4c69-9f51-f26e130e114c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:40.081978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7023e619-c220-4c69-9f51-f26e130e114c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:40.082413 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7023e619-c220-4c69-9f51-f26e130e114c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:40.083107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7023e619-c220-4c69-9f51-f26e130e114c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:40.083552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7023e619-c220-4c69-9f51-f26e130e114c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:40.083972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7023e619-c220-4c69-9f51-f26e130e114c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:40.114023 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7023e619-c220-4c69-9f51-f26e130e114c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048815 Sep 13 20:08:40.114653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 422/956] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:41.127324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6fcb22f2-969f-4de1-8f45-928d4ceb1fd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:41.129540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6fcb22f2-969f-4de1-8f45-928d4ceb1fd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:41.136461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6fcb22f2-969f-4de1-8f45-928d4ceb1fd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:41.136940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6fcb22f2-969f-4de1-8f45-928d4ceb1fd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:41.137356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6fcb22f2-969f-4de1-8f45-928d4ceb1fd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:41.138048 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6fcb22f2-969f-4de1-8f45-928d4ceb1fd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:41.138527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6fcb22f2-969f-4de1-8f45-928d4ceb1fd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:41.138940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6fcb22f2-969f-4de1-8f45-928d4ceb1fd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:41.170434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6fcb22f2-969f-4de1-8f45-928d4ceb1fd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047086 Sep 13 20:08:41.171044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 535/957] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:41 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:42.184761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3fa3c34d-a540-4adc-8fc0-f344a46e4ae9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:42.186925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3fa3c34d-a540-4adc-8fc0-f344a46e4ae9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:42.193850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3fa3c34d-a540-4adc-8fc0-f344a46e4ae9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:42.194330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3fa3c34d-a540-4adc-8fc0-f344a46e4ae9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:42.195162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3fa3c34d-a540-4adc-8fc0-f344a46e4ae9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:42.195854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3fa3c34d-a540-4adc-8fc0-f344a46e4ae9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:42.196319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3fa3c34d-a540-4adc-8fc0-f344a46e4ae9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:42.196735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3fa3c34d-a540-4adc-8fc0-f344a46e4ae9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:42.228529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3fa3c34d-a540-4adc-8fc0-f344a46e4ae9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047932 Sep 13 20:08:42.229297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 423/958] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:43.241686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-42df2726-14d7-4862-ade0-826d04116871 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:43.243909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-42df2726-14d7-4862-ade0-826d04116871 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:43.250951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42df2726-14d7-4862-ade0-826d04116871 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:43.251428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42df2726-14d7-4862-ade0-826d04116871 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:43.251852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42df2726-14d7-4862-ade0-826d04116871 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:43.252534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42df2726-14d7-4862-ade0-826d04116871 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:43.252971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42df2726-14d7-4862-ade0-826d04116871 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:43.253386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42df2726-14d7-4862-ade0-826d04116871 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:43.284422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-42df2726-14d7-4862-ade0-826d04116871 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046765 Sep 13 20:08:43.284993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 536/959] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:44.297658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1e16fe56-c153-4570-8bed-038298ce1822 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:44.299851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1e16fe56-c153-4570-8bed-038298ce1822 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:44.306821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e16fe56-c153-4570-8bed-038298ce1822 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:44.307302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e16fe56-c153-4570-8bed-038298ce1822 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:44.307745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e16fe56-c153-4570-8bed-038298ce1822 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:44.308437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e16fe56-c153-4570-8bed-038298ce1822 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:44.308881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e16fe56-c153-4570-8bed-038298ce1822 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:44.309301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e16fe56-c153-4570-8bed-038298ce1822 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:44.341201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1e16fe56-c153-4570-8bed-038298ce1822 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047463 Sep 13 20:08:44.341772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 424/960] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:45.354247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-490eed68-f8a1-4c04-9ce9-a939eefdca52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:45.356539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-490eed68-f8a1-4c04-9ce9-a939eefdca52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:45.363198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-490eed68-f8a1-4c04-9ce9-a939eefdca52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:45.363673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-490eed68-f8a1-4c04-9ce9-a939eefdca52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:45.364094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-490eed68-f8a1-4c04-9ce9-a939eefdca52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:45.364801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-490eed68-f8a1-4c04-9ce9-a939eefdca52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:45.365243 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-490eed68-f8a1-4c04-9ce9-a939eefdca52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:45.365664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-490eed68-f8a1-4c04-9ce9-a939eefdca52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:45.396712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-490eed68-f8a1-4c04-9ce9-a939eefdca52 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046462 Sep 13 20:08:45.400500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 537/961] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:46.413705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cf942de6-96eb-4c81-b2ca-f93b66d3755e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:46.416397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cf942de6-96eb-4c81-b2ca-f93b66d3755e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:46.425275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cf942de6-96eb-4c81-b2ca-f93b66d3755e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:46.425940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cf942de6-96eb-4c81-b2ca-f93b66d3755e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:46.426553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cf942de6-96eb-4c81-b2ca-f93b66d3755e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:46.427500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cf942de6-96eb-4c81-b2ca-f93b66d3755e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:46.428089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cf942de6-96eb-4c81-b2ca-f93b66d3755e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:46.428649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cf942de6-96eb-4c81-b2ca-f93b66d3755e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:46.461492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cf942de6-96eb-4c81-b2ca-f93b66d3755e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053276 Sep 13 20:08:46.462048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 425/962] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:47.477055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fbaf7bc4-4008-4da2-9cec-608ee991def5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:47.480065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fbaf7bc4-4008-4da2-9cec-608ee991def5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:47.487684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fbaf7bc4-4008-4da2-9cec-608ee991def5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:47.488156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fbaf7bc4-4008-4da2-9cec-608ee991def5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:47.488608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fbaf7bc4-4008-4da2-9cec-608ee991def5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:47.489325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fbaf7bc4-4008-4da2-9cec-608ee991def5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:47.489765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fbaf7bc4-4008-4da2-9cec-608ee991def5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:47.490226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fbaf7bc4-4008-4da2-9cec-608ee991def5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:47.520070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fbaf7bc4-4008-4da2-9cec-608ee991def5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049266 Sep 13 20:08:47.520623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 538/963] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:47 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:48.533590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8c60b93c-06bc-4683-b6b5-6c9a301ce5e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:48.535758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8c60b93c-06bc-4683-b6b5-6c9a301ce5e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:48.542694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c60b93c-06bc-4683-b6b5-6c9a301ce5e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:48.543185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c60b93c-06bc-4683-b6b5-6c9a301ce5e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:48.543625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c60b93c-06bc-4683-b6b5-6c9a301ce5e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:48.544330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c60b93c-06bc-4683-b6b5-6c9a301ce5e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:48.544809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c60b93c-06bc-4683-b6b5-6c9a301ce5e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:48.545233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c60b93c-06bc-4683-b6b5-6c9a301ce5e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:48.578417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8c60b93c-06bc-4683-b6b5-6c9a301ce5e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048958 Sep 13 20:08:48.579041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 426/964] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:48 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:49.594163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-62a1658b-6cbc-422d-ab61-a77af942fce4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:49.596483 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-62a1658b-6cbc-422d-ab61-a77af942fce4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:49.598970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=30 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:49.604685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-62a1658b-6cbc-422d-ab61-a77af942fce4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:49.605170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-62a1658b-6cbc-422d-ab61-a77af942fce4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:49.605601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-62a1658b-6cbc-422d-ab61-a77af942fce4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:49.606297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-62a1658b-6cbc-422d-ab61-a77af942fce4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:49.606773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-62a1658b-6cbc-422d-ab61-a77af942fce4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:49.607189 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-62a1658b-6cbc-422d-ab61-a77af942fce4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:49.609613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:49.638501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-62a1658b-6cbc-422d-ab61-a77af942fce4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050403 Sep 13 20:08:49.639058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 539/965] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:50.654646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f7380ef8-1554-4191-b312-12e588b5e7cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:50.657666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f7380ef8-1554-4191-b312-12e588b5e7cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:50.660063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:50.667622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7380ef8-1554-4191-b312-12e588b5e7cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:50.668105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7380ef8-1554-4191-b312-12e588b5e7cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:50.668536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7380ef8-1554-4191-b312-12e588b5e7cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:50.669264 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7380ef8-1554-4191-b312-12e588b5e7cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:50.669713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7380ef8-1554-4191-b312-12e588b5e7cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:50.670138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7380ef8-1554-4191-b312-12e588b5e7cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:50.674110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=90 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:50.708282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f7380ef8-1554-4191-b312-12e588b5e7cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058689 Sep 13 20:08:50.708898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 427/966] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:51.722180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-354a5df2-4837-4da9-a3b5-0d04cf604e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:51.724393 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-354a5df2-4837-4da9-a3b5-0d04cf604e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:51.731288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-354a5df2-4837-4da9-a3b5-0d04cf604e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:51.731767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-354a5df2-4837-4da9-a3b5-0d04cf604e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:51.732191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-354a5df2-4837-4da9-a3b5-0d04cf604e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:51.732870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-354a5df2-4837-4da9-a3b5-0d04cf604e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:51.733313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-354a5df2-4837-4da9-a3b5-0d04cf604e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:51.733722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-354a5df2-4837-4da9-a3b5-0d04cf604e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:51.763921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-354a5df2-4837-4da9-a3b5-0d04cf604e62 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046258 Sep 13 20:08:51.764471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 540/967] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:52.781102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5f64fd21-bd7e-444d-b75c-7ac6b7d50ec6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:52.784541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5f64fd21-bd7e-444d-b75c-7ac6b7d50ec6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:52.795342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f64fd21-bd7e-444d-b75c-7ac6b7d50ec6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:52.796624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f64fd21-bd7e-444d-b75c-7ac6b7d50ec6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:52.796624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f64fd21-bd7e-444d-b75c-7ac6b7d50ec6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:52.797649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f64fd21-bd7e-444d-b75c-7ac6b7d50ec6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:52.798449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f64fd21-bd7e-444d-b75c-7ac6b7d50ec6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:52.799093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f64fd21-bd7e-444d-b75c-7ac6b7d50ec6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:52.830029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5f64fd21-bd7e-444d-b75c-7ac6b7d50ec6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055591 Sep 13 20:08:52.830624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 428/968] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:53.843659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-238d466e-40f9-49f1-a532-b74d923204f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:53.845942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-238d466e-40f9-49f1-a532-b74d923204f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:53.853245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-238d466e-40f9-49f1-a532-b74d923204f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:53.853719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-238d466e-40f9-49f1-a532-b74d923204f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:53.854151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-238d466e-40f9-49f1-a532-b74d923204f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:53.854883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-238d466e-40f9-49f1-a532-b74d923204f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:53.855329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-238d466e-40f9-49f1-a532-b74d923204f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:53.855744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-238d466e-40f9-49f1-a532-b74d923204f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:53.888693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-238d466e-40f9-49f1-a532-b74d923204f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049394 Sep 13 20:08:53.889259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 541/969] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:53 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:54.904576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-15ec5ce1-dcfc-4f91-b351-48962d19d792 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:54.907401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-15ec5ce1-dcfc-4f91-b351-48962d19d792 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:54.916863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15ec5ce1-dcfc-4f91-b351-48962d19d792 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:54.917524 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15ec5ce1-dcfc-4f91-b351-48962d19d792 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:54.918120 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15ec5ce1-dcfc-4f91-b351-48962d19d792 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:54.919102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15ec5ce1-dcfc-4f91-b351-48962d19d792 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:54.919728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15ec5ce1-dcfc-4f91-b351-48962d19d792 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:54.920317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15ec5ce1-dcfc-4f91-b351-48962d19d792 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:54.953549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-15ec5ce1-dcfc-4f91-b351-48962d19d792 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054720 Sep 13 20:08:54.954124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 429/970] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:54 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:55.967697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1e008b7b-f9f7-49f0-9a68-2e9109da5527 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:55.969863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1e008b7b-f9f7-49f0-9a68-2e9109da5527 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:55.976845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e008b7b-f9f7-49f0-9a68-2e9109da5527 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:55.977325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e008b7b-f9f7-49f0-9a68-2e9109da5527 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:55.977754 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e008b7b-f9f7-49f0-9a68-2e9109da5527 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:55.978471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e008b7b-f9f7-49f0-9a68-2e9109da5527 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:55.978921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e008b7b-f9f7-49f0-9a68-2e9109da5527 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:55.979338 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e008b7b-f9f7-49f0-9a68-2e9109da5527 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:56.008832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1e008b7b-f9f7-49f0-9a68-2e9109da5527 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045218 Sep 13 20:08:56.009377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 542/971] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:57.025867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e3292a92-7283-46fc-a7ff-edf25cb83d8c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:57.029310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e3292a92-7283-46fc-a7ff-edf25cb83d8c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:57.038777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3292a92-7283-46fc-a7ff-edf25cb83d8c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:57.039259 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3292a92-7283-46fc-a7ff-edf25cb83d8c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:57.039689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3292a92-7283-46fc-a7ff-edf25cb83d8c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:57.040365 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3292a92-7283-46fc-a7ff-edf25cb83d8c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:57.040806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3292a92-7283-46fc-a7ff-edf25cb83d8c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:57.041225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3292a92-7283-46fc-a7ff-edf25cb83d8c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:57.072212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e3292a92-7283-46fc-a7ff-edf25cb83d8c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052589 Sep 13 20:08:57.072747 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 430/972] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:58.085355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cee1739a-b07c-45b1-80da-c97c73d9c3d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:58.087590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cee1739a-b07c-45b1-80da-c97c73d9c3d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:58.094738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cee1739a-b07c-45b1-80da-c97c73d9c3d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:58.095227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cee1739a-b07c-45b1-80da-c97c73d9c3d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:58.095665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cee1739a-b07c-45b1-80da-c97c73d9c3d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:58.096372 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cee1739a-b07c-45b1-80da-c97c73d9c3d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:58.096850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cee1739a-b07c-45b1-80da-c97c73d9c3d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:58.097246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cee1739a-b07c-45b1-80da-c97c73d9c3d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:58.130294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cee1739a-b07c-45b1-80da-c97c73d9c3d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049882 Sep 13 20:08:58.130897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 543/973] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:08:59.148163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-900940a0-f106-4d80-afdb-c7de7b34060e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:59.151178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-900940a0-f106-4d80-afdb-c7de7b34060e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:59.159424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-900940a0-f106-4d80-afdb-c7de7b34060e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:59.159956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-900940a0-f106-4d80-afdb-c7de7b34060e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:59.160433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-900940a0-f106-4d80-afdb-c7de7b34060e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:59.161561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-900940a0-f106-4d80-afdb-c7de7b34060e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:59.162332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-900940a0-f106-4d80-afdb-c7de7b34060e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:59.162332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-900940a0-f106-4d80-afdb-c7de7b34060e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:59.194100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-900940a0-f106-4d80-afdb-c7de7b34060e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051750 Sep 13 20:08:59.194100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 431/974] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:08:59 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:00.208899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-676cb170-5ea2-4b2a-ba71-b049c23e38eb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:00.211399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-676cb170-5ea2-4b2a-ba71-b049c23e38eb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:00.218683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-676cb170-5ea2-4b2a-ba71-b049c23e38eb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:00.219344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-676cb170-5ea2-4b2a-ba71-b049c23e38eb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:00.219788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-676cb170-5ea2-4b2a-ba71-b049c23e38eb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:00.220477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-676cb170-5ea2-4b2a-ba71-b049c23e38eb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:00.220923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-676cb170-5ea2-4b2a-ba71-b049c23e38eb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:00.221336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-676cb170-5ea2-4b2a-ba71-b049c23e38eb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:00.252560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-676cb170-5ea2-4b2a-ba71-b049c23e38eb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048297 Sep 13 20:09:00.253137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 544/975] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:00 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:01.268332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1ccc88e0-e274-4a29-80e0-969896d8e9bf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:01.271548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1ccc88e0-e274-4a29-80e0-969896d8e9bf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:01.280748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ccc88e0-e274-4a29-80e0-969896d8e9bf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:01.281389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ccc88e0-e274-4a29-80e0-969896d8e9bf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:01.281970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ccc88e0-e274-4a29-80e0-969896d8e9bf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:01.282950 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ccc88e0-e274-4a29-80e0-969896d8e9bf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:01.283566 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ccc88e0-e274-4a29-80e0-969896d8e9bf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:01.284135 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ccc88e0-e274-4a29-80e0-969896d8e9bf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:01.315303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1ccc88e0-e274-4a29-80e0-969896d8e9bf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053219 Sep 13 20:09:01.315831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 432/976] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:02.332228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cefd7298-ee73-495f-9017-d91612bb8368 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:02.335141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cefd7298-ee73-495f-9017-d91612bb8368 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:02.341949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cefd7298-ee73-495f-9017-d91612bb8368 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:02.342457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cefd7298-ee73-495f-9017-d91612bb8368 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:02.342896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cefd7298-ee73-495f-9017-d91612bb8368 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:02.343591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cefd7298-ee73-495f-9017-d91612bb8368 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:02.344041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cefd7298-ee73-495f-9017-d91612bb8368 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:02.344463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cefd7298-ee73-495f-9017-d91612bb8368 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:02.376612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cefd7298-ee73-495f-9017-d91612bb8368 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051365 Sep 13 20:09:02.377181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 545/977] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:03.390770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e53e8e96-1600-4d70-94a8-5bd766c699d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:03.392826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e53e8e96-1600-4d70-94a8-5bd766c699d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:03.399996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e53e8e96-1600-4d70-94a8-5bd766c699d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:03.400477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e53e8e96-1600-4d70-94a8-5bd766c699d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:03.400909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e53e8e96-1600-4d70-94a8-5bd766c699d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:03.401596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e53e8e96-1600-4d70-94a8-5bd766c699d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:03.402042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e53e8e96-1600-4d70-94a8-5bd766c699d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:03.402497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e53e8e96-1600-4d70-94a8-5bd766c699d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:03.434255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e53e8e96-1600-4d70-94a8-5bd766c699d0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047684 Sep 13 20:09:03.434855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 433/978] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:04.449026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-303e12de-0d1c-41ea-ba13-a11dbe16481c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:04.451157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-303e12de-0d1c-41ea-ba13-a11dbe16481c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:04.458099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-303e12de-0d1c-41ea-ba13-a11dbe16481c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:04.458626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-303e12de-0d1c-41ea-ba13-a11dbe16481c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:04.459071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-303e12de-0d1c-41ea-ba13-a11dbe16481c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:04.459776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-303e12de-0d1c-41ea-ba13-a11dbe16481c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:04.460231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-303e12de-0d1c-41ea-ba13-a11dbe16481c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:04.460651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-303e12de-0d1c-41ea-ba13-a11dbe16481c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:04.491755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-303e12de-0d1c-41ea-ba13-a11dbe16481c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047730 Sep 13 20:09:04.492325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 546/979] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:05.504354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ec87438a-65cd-4292-8215-2911601c0ee9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:05.506619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ec87438a-65cd-4292-8215-2911601c0ee9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:05.513767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec87438a-65cd-4292-8215-2911601c0ee9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:05.514225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec87438a-65cd-4292-8215-2911601c0ee9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:05.514709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec87438a-65cd-4292-8215-2911601c0ee9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:05.515406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec87438a-65cd-4292-8215-2911601c0ee9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:05.515857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec87438a-65cd-4292-8215-2911601c0ee9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:05.516282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec87438a-65cd-4292-8215-2911601c0ee9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:05.546787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ec87438a-65cd-4292-8215-2911601c0ee9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046442 Sep 13 20:09:05.547361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 434/980] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:06.563349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c9e6295c-c986-4147-9b46-a12c6bbfe983 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:06.566221 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c9e6295c-c986-4147-9b46-a12c6bbfe983 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:06.573918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9e6295c-c986-4147-9b46-a12c6bbfe983 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:06.574399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9e6295c-c986-4147-9b46-a12c6bbfe983 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:06.575007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9e6295c-c986-4147-9b46-a12c6bbfe983 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:06.575820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9e6295c-c986-4147-9b46-a12c6bbfe983 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:06.576270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9e6295c-c986-4147-9b46-a12c6bbfe983 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:06.576689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9e6295c-c986-4147-9b46-a12c6bbfe983 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:06.607268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c9e6295c-c986-4147-9b46-a12c6bbfe983 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050220 Sep 13 20:09:06.607832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 547/981] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:06 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:07.625052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8d202fe8-ff3a-419f-b850-1944903a267e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:07.627241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8d202fe8-ff3a-419f-b850-1944903a267e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:07.634254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d202fe8-ff3a-419f-b850-1944903a267e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:07.634827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d202fe8-ff3a-419f-b850-1944903a267e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:07.635292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d202fe8-ff3a-419f-b850-1944903a267e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:07.635989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d202fe8-ff3a-419f-b850-1944903a267e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:07.636436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d202fe8-ff3a-419f-b850-1944903a267e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:07.636853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8d202fe8-ff3a-419f-b850-1944903a267e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:07.667940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8d202fe8-ff3a-419f-b850-1944903a267e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047831 Sep 13 20:09:07.668537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 435/982] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:08.682870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-be8e3aee-d2d8-47b6-a591-664d60b47e79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:08.685975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-be8e3aee-d2d8-47b6-a591-664d60b47e79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:08.693340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:09:08.693602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:09:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments (ip 10.222.0.52) !!! Sep 13 20:09:08.698635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be8e3aee-d2d8-47b6-a591-664d60b47e79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:08.699122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be8e3aee-d2d8-47b6-a591-664d60b47e79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:08.699551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be8e3aee-d2d8-47b6-a591-664d60b47e79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:08.700285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be8e3aee-d2d8-47b6-a591-664d60b47e79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:08.700730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be8e3aee-d2d8-47b6-a591-664d60b47e79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:08.701146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be8e3aee-d2d8-47b6-a591-664d60b47e79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:08.734598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-be8e3aee-d2d8-47b6-a591-664d60b47e79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057352 Sep 13 20:09:08.735138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 548/983] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:09.250971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-90702541-c578-4cd8-b2cd-a1519ea84a87 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:09.253130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-90702541-c578-4cd8-b2cd-a1519ea84a87 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:09.255727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:09:09.255875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:09:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments (ip 10.222.0.52) !!! Sep 13 20:09:09.263829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90702541-c578-4cd8-b2cd-a1519ea84a87 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:09.264407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90702541-c578-4cd8-b2cd-a1519ea84a87 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:09.264842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90702541-c578-4cd8-b2cd-a1519ea84a87 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:09.265577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90702541-c578-4cd8-b2cd-a1519ea84a87 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:09.266027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90702541-c578-4cd8-b2cd-a1519ea84a87 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:09.266481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90702541-c578-4cd8-b2cd-a1519ea84a87 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:09.297098 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-90702541-c578-4cd8-b2cd-a1519ea84a87 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050239 Sep 13 20:09:09.297637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 436/984] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:09.748377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8878e531-9876-49b2-99ad-6dab588818de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:09.750745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8878e531-9876-49b2-99ad-6dab588818de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:09.757674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8878e531-9876-49b2-99ad-6dab588818de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:09.758152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8878e531-9876-49b2-99ad-6dab588818de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:09.758622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8878e531-9876-49b2-99ad-6dab588818de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:09.759302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8878e531-9876-49b2-99ad-6dab588818de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:09.759772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8878e531-9876-49b2-99ad-6dab588818de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:09.760193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8878e531-9876-49b2-99ad-6dab588818de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:09.790252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8878e531-9876-49b2-99ad-6dab588818de tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045981 Sep 13 20:09:09.790837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 549/985] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:10.313365 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b4c2b47d-05b9-4c69-afbe-0685dcb043ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:10.316732 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b4c2b47d-05b9-4c69-afbe-0685dcb043ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:10.327256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4c2b47d-05b9-4c69-afbe-0685dcb043ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:10.327733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4c2b47d-05b9-4c69-afbe-0685dcb043ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:10.328167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4c2b47d-05b9-4c69-afbe-0685dcb043ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:10.328854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4c2b47d-05b9-4c69-afbe-0685dcb043ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:10.329294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4c2b47d-05b9-4c69-afbe-0685dcb043ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:10.329707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4c2b47d-05b9-4c69-afbe-0685dcb043ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:10.360251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b4c2b47d-05b9-4c69-afbe-0685dcb043ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053025 Sep 13 20:09:10.360805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 437/986] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:10 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:10.805415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0f6b70a9-6082-4e58-b428-a4ae1ed53aa1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:10.808121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0f6b70a9-6082-4e58-b428-a4ae1ed53aa1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:10.815361 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f6b70a9-6082-4e58-b428-a4ae1ed53aa1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:10.815828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f6b70a9-6082-4e58-b428-a4ae1ed53aa1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:10.816255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f6b70a9-6082-4e58-b428-a4ae1ed53aa1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:10.816933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f6b70a9-6082-4e58-b428-a4ae1ed53aa1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:10.817375 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f6b70a9-6082-4e58-b428-a4ae1ed53aa1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:10.817792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f6b70a9-6082-4e58-b428-a4ae1ed53aa1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:10.848255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0f6b70a9-6082-4e58-b428-a4ae1ed53aa1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046896 Sep 13 20:09:10.849257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 550/987] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:11.375448 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-204f3f49-25d3-4f63-9bcf-7d9179377be7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:11.377580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-204f3f49-25d3-4f63-9bcf-7d9179377be7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:11.384192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-204f3f49-25d3-4f63-9bcf-7d9179377be7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:11.384686 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-204f3f49-25d3-4f63-9bcf-7d9179377be7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:11.385119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-204f3f49-25d3-4f63-9bcf-7d9179377be7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:11.385810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-204f3f49-25d3-4f63-9bcf-7d9179377be7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:11.386285 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-204f3f49-25d3-4f63-9bcf-7d9179377be7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:11.386713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-204f3f49-25d3-4f63-9bcf-7d9179377be7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:11.416513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-204f3f49-25d3-4f63-9bcf-7d9179377be7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046935 Sep 13 20:09:11.417350 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 438/988] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:11 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:11.860772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-aa787211-b50c-4914-b9df-cabc10192d07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:11.862981 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-aa787211-b50c-4914-b9df-cabc10192d07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:11.869763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa787211-b50c-4914-b9df-cabc10192d07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:11.870248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa787211-b50c-4914-b9df-cabc10192d07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:11.870708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa787211-b50c-4914-b9df-cabc10192d07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:11.871416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa787211-b50c-4914-b9df-cabc10192d07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:11.871859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa787211-b50c-4914-b9df-cabc10192d07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:11.872283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa787211-b50c-4914-b9df-cabc10192d07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:11.903145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-aa787211-b50c-4914-b9df-cabc10192d07 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046566 Sep 13 20:09:11.903677 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 551/989] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:11 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:12.428943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a4c11c10-7553-474f-8554-5aa2670be28f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:12.431115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a4c11c10-7553-474f-8554-5aa2670be28f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:12.438162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a4c11c10-7553-474f-8554-5aa2670be28f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:12.438661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a4c11c10-7553-474f-8554-5aa2670be28f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:12.439087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a4c11c10-7553-474f-8554-5aa2670be28f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:12.439776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a4c11c10-7553-474f-8554-5aa2670be28f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:12.440216 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a4c11c10-7553-474f-8554-5aa2670be28f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:12.440608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a4c11c10-7553-474f-8554-5aa2670be28f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:12.470581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a4c11c10-7553-474f-8554-5aa2670be28f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 Sep 13 20:09:12.471141 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 439/990] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:12 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:12.915752 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5bce362d-5a8a-4120-bdf6-74b2d0658df8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:12.917861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5bce362d-5a8a-4120-bdf6-74b2d0658df8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:12.924753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bce362d-5a8a-4120-bdf6-74b2d0658df8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:12.925216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bce362d-5a8a-4120-bdf6-74b2d0658df8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:12.925652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bce362d-5a8a-4120-bdf6-74b2d0658df8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:12.926351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bce362d-5a8a-4120-bdf6-74b2d0658df8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:12.926841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bce362d-5a8a-4120-bdf6-74b2d0658df8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:12.927252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bce362d-5a8a-4120-bdf6-74b2d0658df8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:12.959416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5bce362d-5a8a-4120-bdf6-74b2d0658df8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047773 Sep 13 20:09:12.959979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 552/991] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:13.484089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-50d95fa6-3eb0-44cd-bbb2-d631f1bba2a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:13.486439 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-50d95fa6-3eb0-44cd-bbb2-d631f1bba2a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:13.494637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50d95fa6-3eb0-44cd-bbb2-d631f1bba2a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:13.495331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50d95fa6-3eb0-44cd-bbb2-d631f1bba2a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:13.495949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50d95fa6-3eb0-44cd-bbb2-d631f1bba2a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:13.496663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50d95fa6-3eb0-44cd-bbb2-d631f1bba2a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:13.497306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50d95fa6-3eb0-44cd-bbb2-d631f1bba2a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:13.497912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50d95fa6-3eb0-44cd-bbb2-d631f1bba2a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:13.530868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-50d95fa6-3eb0-44cd-bbb2-d631f1bba2a9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051354 Sep 13 20:09:13.531487 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 440/992] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:13.972996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ee663886-c0f1-4cb2-9374-0645b7d7858c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:13.975215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ee663886-c0f1-4cb2-9374-0645b7d7858c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:13.981733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ee663886-c0f1-4cb2-9374-0645b7d7858c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:13.982216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ee663886-c0f1-4cb2-9374-0645b7d7858c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:13.982677 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ee663886-c0f1-4cb2-9374-0645b7d7858c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:13.983377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ee663886-c0f1-4cb2-9374-0645b7d7858c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:13.983828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ee663886-c0f1-4cb2-9374-0645b7d7858c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:13.984362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ee663886-c0f1-4cb2-9374-0645b7d7858c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:14.014069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ee663886-c0f1-4cb2-9374-0645b7d7858c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045177 Sep 13 20:09:14.014682 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 553/993] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:14.543925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-28c38d15-ec22-4ab0-9bee-c015fbdfd6e3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:14.546066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-28c38d15-ec22-4ab0-9bee-c015fbdfd6e3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:14.552797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28c38d15-ec22-4ab0-9bee-c015fbdfd6e3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:14.553269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28c38d15-ec22-4ab0-9bee-c015fbdfd6e3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:14.553697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28c38d15-ec22-4ab0-9bee-c015fbdfd6e3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:14.554420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28c38d15-ec22-4ab0-9bee-c015fbdfd6e3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:14.554851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28c38d15-ec22-4ab0-9bee-c015fbdfd6e3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:14.555261 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28c38d15-ec22-4ab0-9bee-c015fbdfd6e3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:14.585528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-28c38d15-ec22-4ab0-9bee-c015fbdfd6e3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045442 Sep 13 20:09:14.586007 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 441/994] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:14 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:15.031623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-70d45e5e-67e3-4034-9740-391b3a2b8e7e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:15.033936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-70d45e5e-67e3-4034-9740-391b3a2b8e7e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:15.041098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70d45e5e-67e3-4034-9740-391b3a2b8e7e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:15.041581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70d45e5e-67e3-4034-9740-391b3a2b8e7e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:15.042013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70d45e5e-67e3-4034-9740-391b3a2b8e7e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:15.042756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70d45e5e-67e3-4034-9740-391b3a2b8e7e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:15.043206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70d45e5e-67e3-4034-9740-391b3a2b8e7e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:15.043626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70d45e5e-67e3-4034-9740-391b3a2b8e7e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:15.074457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-70d45e5e-67e3-4034-9740-391b3a2b8e7e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049727 Sep 13 20:09:15.075027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 554/995] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:15.597598 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-80411b39-93d1-4d40-b92f-0d7837ace828 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:15.599830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-80411b39-93d1-4d40-b92f-0d7837ace828 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:15.606655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80411b39-93d1-4d40-b92f-0d7837ace828 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:15.607129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80411b39-93d1-4d40-b92f-0d7837ace828 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:15.607563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80411b39-93d1-4d40-b92f-0d7837ace828 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:15.608277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80411b39-93d1-4d40-b92f-0d7837ace828 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:15.608718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80411b39-93d1-4d40-b92f-0d7837ace828 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:15.609132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80411b39-93d1-4d40-b92f-0d7837ace828 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:15.639563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-80411b39-93d1-4d40-b92f-0d7837ace828 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046058 Sep 13 20:09:15.640119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 442/996] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:16.087940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-41b5c7e0-b1e9-48d2-9e86-0b1b22fa3c1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:16.090099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-41b5c7e0-b1e9-48d2-9e86-0b1b22fa3c1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:16.096774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41b5c7e0-b1e9-48d2-9e86-0b1b22fa3c1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:16.097248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41b5c7e0-b1e9-48d2-9e86-0b1b22fa3c1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:16.097669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41b5c7e0-b1e9-48d2-9e86-0b1b22fa3c1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:16.098349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41b5c7e0-b1e9-48d2-9e86-0b1b22fa3c1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:16.098821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41b5c7e0-b1e9-48d2-9e86-0b1b22fa3c1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:16.099231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41b5c7e0-b1e9-48d2-9e86-0b1b22fa3c1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:16.125955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:16.132851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-41b5c7e0-b1e9-48d2-9e86-0b1b22fa3c1a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049081 Sep 13 20:09:16.133421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 555/997] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:16 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:16.656183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-291b223c-c941-4c54-af17-7045321df096 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:16.658858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-291b223c-c941-4c54-af17-7045321df096 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:16.665711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-291b223c-c941-4c54-af17-7045321df096 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:16.666213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-291b223c-c941-4c54-af17-7045321df096 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:16.666678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-291b223c-c941-4c54-af17-7045321df096 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:16.667371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-291b223c-c941-4c54-af17-7045321df096 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:16.667818 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-291b223c-c941-4c54-af17-7045321df096 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:16.668237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-291b223c-c941-4c54-af17-7045321df096 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:16.692763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:16.700282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-291b223c-c941-4c54-af17-7045321df096 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050821 Sep 13 20:09:16.700842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 443/998] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:16 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:17.148718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d6258103-1b5c-4bae-b6d9-7b8f8c54183b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:17.151130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d6258103-1b5c-4bae-b6d9-7b8f8c54183b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:17.159121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6258103-1b5c-4bae-b6d9-7b8f8c54183b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:17.159625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6258103-1b5c-4bae-b6d9-7b8f8c54183b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:17.160063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6258103-1b5c-4bae-b6d9-7b8f8c54183b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:17.160754 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6258103-1b5c-4bae-b6d9-7b8f8c54183b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:17.161203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6258103-1b5c-4bae-b6d9-7b8f8c54183b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:17.161621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6258103-1b5c-4bae-b6d9-7b8f8c54183b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:17.193069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d6258103-1b5c-4bae-b6d9-7b8f8c54183b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050220 Sep 13 20:09:17.193634 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 556/999] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:17 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:17.716612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6f05774a-30e2-425f-9a9a-f4fcf66e44a0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:17.719140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6f05774a-30e2-425f-9a9a-f4fcf66e44a0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:17.728673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f05774a-30e2-425f-9a9a-f4fcf66e44a0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:17.729303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f05774a-30e2-425f-9a9a-f4fcf66e44a0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:17.729820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f05774a-30e2-425f-9a9a-f4fcf66e44a0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:17.730869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f05774a-30e2-425f-9a9a-f4fcf66e44a0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:17.731437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f05774a-30e2-425f-9a9a-f4fcf66e44a0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:17.731988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f05774a-30e2-425f-9a9a-f4fcf66e44a0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:17.771416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6f05774a-30e2-425f-9a9a-f4fcf66e44a0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061219 Sep 13 20:09:17.771953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 444/1000] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:17 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:18.206760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1bac2f1a-88ca-4bba-b9fc-9ab736900590 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:18.208824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1bac2f1a-88ca-4bba-b9fc-9ab736900590 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:18.215517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bac2f1a-88ca-4bba-b9fc-9ab736900590 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:18.215993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bac2f1a-88ca-4bba-b9fc-9ab736900590 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:18.216422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bac2f1a-88ca-4bba-b9fc-9ab736900590 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:18.217109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bac2f1a-88ca-4bba-b9fc-9ab736900590 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:18.217548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bac2f1a-88ca-4bba-b9fc-9ab736900590 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:18.217964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bac2f1a-88ca-4bba-b9fc-9ab736900590 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:18.249094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1bac2f1a-88ca-4bba-b9fc-9ab736900590 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046602 Sep 13 20:09:18.249657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 557/1001] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:18.784461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e5f8b00d-c38d-4ff9-8623-8dd4bcb9c2b9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:18.786662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e5f8b00d-c38d-4ff9-8623-8dd4bcb9c2b9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:18.793706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e5f8b00d-c38d-4ff9-8623-8dd4bcb9c2b9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:18.794188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e5f8b00d-c38d-4ff9-8623-8dd4bcb9c2b9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:18.794725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e5f8b00d-c38d-4ff9-8623-8dd4bcb9c2b9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:18.795415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e5f8b00d-c38d-4ff9-8623-8dd4bcb9c2b9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:18.795863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e5f8b00d-c38d-4ff9-8623-8dd4bcb9c2b9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:18.796278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e5f8b00d-c38d-4ff9-8623-8dd4bcb9c2b9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:18.826614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e5f8b00d-c38d-4ff9-8623-8dd4bcb9c2b9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046237 Sep 13 20:09:18.827086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 445/1002] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:19.262043 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c1fbf4dd-ca00-46e4-9903-d910a5a478fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:19.264216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c1fbf4dd-ca00-46e4-9903-d910a5a478fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:19.270817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1fbf4dd-ca00-46e4-9903-d910a5a478fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:19.271295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1fbf4dd-ca00-46e4-9903-d910a5a478fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:19.271712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1fbf4dd-ca00-46e4-9903-d910a5a478fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:19.272388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1fbf4dd-ca00-46e4-9903-d910a5a478fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:19.272823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1fbf4dd-ca00-46e4-9903-d910a5a478fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:19.273230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1fbf4dd-ca00-46e4-9903-d910a5a478fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:19.304005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c1fbf4dd-ca00-46e4-9903-d910a5a478fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046063 Sep 13 20:09:19.304566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 558/1003] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:19.839933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-149264da-4851-43f3-bfcd-f9d62fb096da tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:19.842092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-149264da-4851-43f3-bfcd-f9d62fb096da tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:19.849225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-149264da-4851-43f3-bfcd-f9d62fb096da tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:19.849706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-149264da-4851-43f3-bfcd-f9d62fb096da tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:19.850150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-149264da-4851-43f3-bfcd-f9d62fb096da tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:19.850877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-149264da-4851-43f3-bfcd-f9d62fb096da tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:19.851330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-149264da-4851-43f3-bfcd-f9d62fb096da tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:19.851753 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-149264da-4851-43f3-bfcd-f9d62fb096da tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:19.882276 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-149264da-4851-43f3-bfcd-f9d62fb096da tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046923 Sep 13 20:09:19.882878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 446/1004] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:20.319427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9e1e6b61-78f8-4b2f-bf34-a48b7116af74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:20.321605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9e1e6b61-78f8-4b2f-bf34-a48b7116af74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:20.323959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=40 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:20.329937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9e1e6b61-78f8-4b2f-bf34-a48b7116af74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:20.330565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9e1e6b61-78f8-4b2f-bf34-a48b7116af74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:20.330866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9e1e6b61-78f8-4b2f-bf34-a48b7116af74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:20.331551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9e1e6b61-78f8-4b2f-bf34-a48b7116af74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:20.331997 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9e1e6b61-78f8-4b2f-bf34-a48b7116af74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:20.332417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9e1e6b61-78f8-4b2f-bf34-a48b7116af74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:20.367815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9e1e6b61-78f8-4b2f-bf34-a48b7116af74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053069 Sep 13 20:09:20.368659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 559/1005] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:20.894715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ecdcd05e-4491-4b71-a243-e2939348615f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:20.896897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ecdcd05e-4491-4b71-a243-e2939348615f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:20.899230 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=40 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:20.904599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ecdcd05e-4491-4b71-a243-e2939348615f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:20.905066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ecdcd05e-4491-4b71-a243-e2939348615f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:20.905490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ecdcd05e-4491-4b71-a243-e2939348615f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:20.906159 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ecdcd05e-4491-4b71-a243-e2939348615f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:20.906626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ecdcd05e-4491-4b71-a243-e2939348615f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:20.907033 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ecdcd05e-4491-4b71-a243-e2939348615f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:20.938722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ecdcd05e-4491-4b71-a243-e2939348615f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047846 Sep 13 20:09:20.939826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 447/1006] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:21.381258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f9687dac-11bd-4ce2-ac22-507737184a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:21.383537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f9687dac-11bd-4ce2-ac22-507737184a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:21.390082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9687dac-11bd-4ce2-ac22-507737184a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:21.390602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9687dac-11bd-4ce2-ac22-507737184a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:21.391030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9687dac-11bd-4ce2-ac22-507737184a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:21.391712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9687dac-11bd-4ce2-ac22-507737184a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:21.392166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9687dac-11bd-4ce2-ac22-507737184a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:21.392577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9687dac-11bd-4ce2-ac22-507737184a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:21.424050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f9687dac-11bd-4ce2-ac22-507737184a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047010 Sep 13 20:09:21.424607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 560/1007] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:21.951877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d494257d-e1d3-4a99-8211-366852ee2fc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:21.954055 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d494257d-e1d3-4a99-8211-366852ee2fc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:21.961347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d494257d-e1d3-4a99-8211-366852ee2fc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:21.961840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d494257d-e1d3-4a99-8211-366852ee2fc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:21.962277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d494257d-e1d3-4a99-8211-366852ee2fc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:21.963008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d494257d-e1d3-4a99-8211-366852ee2fc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:21.963451 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d494257d-e1d3-4a99-8211-366852ee2fc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:21.963899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d494257d-e1d3-4a99-8211-366852ee2fc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:21.995105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d494257d-e1d3-4a99-8211-366852ee2fc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047566 Sep 13 20:09:21.995675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 448/1008] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:21 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:22.440211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-954628a1-ab82-49cc-9f29-c340edeb1ce8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:22.442577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-954628a1-ab82-49cc-9f29-c340edeb1ce8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:22.449772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-954628a1-ab82-49cc-9f29-c340edeb1ce8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:22.450244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-954628a1-ab82-49cc-9f29-c340edeb1ce8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:22.450763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-954628a1-ab82-49cc-9f29-c340edeb1ce8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:22.451383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-954628a1-ab82-49cc-9f29-c340edeb1ce8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:22.451828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-954628a1-ab82-49cc-9f29-c340edeb1ce8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:22.452240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-954628a1-ab82-49cc-9f29-c340edeb1ce8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:22.482018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-954628a1-ab82-49cc-9f29-c340edeb1ce8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046008 Sep 13 20:09:22.482595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 561/1009] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:22 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:23.012037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-986b1ff5-4870-4017-a4af-8b0d9cd26d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:23.014264 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-986b1ff5-4870-4017-a4af-8b0d9cd26d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:23.023173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-986b1ff5-4870-4017-a4af-8b0d9cd26d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:23.023695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-986b1ff5-4870-4017-a4af-8b0d9cd26d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:23.024342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-986b1ff5-4870-4017-a4af-8b0d9cd26d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:23.025182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-986b1ff5-4870-4017-a4af-8b0d9cd26d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:23.025643 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-986b1ff5-4870-4017-a4af-8b0d9cd26d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:23.026081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-986b1ff5-4870-4017-a4af-8b0d9cd26d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:23.058467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-986b1ff5-4870-4017-a4af-8b0d9cd26d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052428 Sep 13 20:09:23.059056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 449/1010] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:23.351630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-37df651d-0ab1-4556-8674-eea5ff7cc18e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:23.352125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-37df651d-0ab1-4556-8674-eea5ff7cc18e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:23.358676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37df651d-0ab1-4556-8674-eea5ff7cc18e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:23.359164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37df651d-0ab1-4556-8674-eea5ff7cc18e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:23.359609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37df651d-0ab1-4556-8674-eea5ff7cc18e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:23.360294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37df651d-0ab1-4556-8674-eea5ff7cc18e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:23.360744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37df651d-0ab1-4556-8674-eea5ff7cc18e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:23.361166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37df651d-0ab1-4556-8674-eea5ff7cc18e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:23.386300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-37df651d-0ab1-4556-8674-eea5ff7cc18e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Going to try to terminate instance {{(pid=120844) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:09:23.469203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-37df651d-0ab1-4556-8674-eea5ff7cc18e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 204 len: 0 microversion: 2.1 time: 0.121467 Sep 13 20:09:23.470120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 562/1011] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:09:23 2022] DELETE /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:09:23.480879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f7e458bb-93e0-4d1a-a9ba-43453d686eff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:23.481562 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f7e458bb-93e0-4d1a-a9ba-43453d686eff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:23.490121 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7e458bb-93e0-4d1a-a9ba-43453d686eff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:23.490644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7e458bb-93e0-4d1a-a9ba-43453d686eff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:23.491080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7e458bb-93e0-4d1a-a9ba-43453d686eff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:23.491777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7e458bb-93e0-4d1a-a9ba-43453d686eff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:23.492226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7e458bb-93e0-4d1a-a9ba-43453d686eff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:23.492652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f7e458bb-93e0-4d1a-a9ba-43453d686eff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:23.495453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b6046e8a-61fc-4444-8b83-ce6b8061d164 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:23.497715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b6046e8a-61fc-4444-8b83-ce6b8061d164 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:23.503760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6046e8a-61fc-4444-8b83-ce6b8061d164 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:23.504238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6046e8a-61fc-4444-8b83-ce6b8061d164 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:23.504659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6046e8a-61fc-4444-8b83-ce6b8061d164 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:23.505333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6046e8a-61fc-4444-8b83-ce6b8061d164 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:23.505771 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6046e8a-61fc-4444-8b83-ce6b8061d164 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:23.506192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6046e8a-61fc-4444-8b83-ce6b8061d164 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:23.537650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b6046e8a-61fc-4444-8b83-ce6b8061d164 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046592 Sep 13 20:09:23.538945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 563/1012] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:23 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 20:09:24.004132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f7e458bb-93e0-4d1a-a9ba-43453d686eff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:24.015438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f7e458bb-93e0-4d1a-a9ba-43453d686eff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.540629 Sep 13 20:09:24.026605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 450/1013] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:23 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:24.073073 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d3057266-6bea-44f4-bdef-8ad0043a7b84 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:24.077408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d3057266-6bea-44f4-bdef-8ad0043a7b84 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:24.086679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3057266-6bea-44f4-bdef-8ad0043a7b84 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:24.087388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3057266-6bea-44f4-bdef-8ad0043a7b84 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:24.087990 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3057266-6bea-44f4-bdef-8ad0043a7b84 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:24.088905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3057266-6bea-44f4-bdef-8ad0043a7b84 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:24.089539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3057266-6bea-44f4-bdef-8ad0043a7b84 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:24.090162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3057266-6bea-44f4-bdef-8ad0043a7b84 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:24.122187 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d3057266-6bea-44f4-bdef-8ad0043a7b84 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055018 Sep 13 20:09:24.122777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 564/1014] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:24 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:24.551565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9e432e74-2db5-4595-81c5-46951b7b8ced tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:24.554061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9e432e74-2db5-4595-81c5-46951b7b8ced tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:24.561761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e432e74-2db5-4595-81c5-46951b7b8ced tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:24.562310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e432e74-2db5-4595-81c5-46951b7b8ced tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:24.562840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e432e74-2db5-4595-81c5-46951b7b8ced tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:24.563646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e432e74-2db5-4595-81c5-46951b7b8ced tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:24.564125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e432e74-2db5-4595-81c5-46951b7b8ced tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:24.564591 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e432e74-2db5-4595-81c5-46951b7b8ced tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:24.595712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9e432e74-2db5-4595-81c5-46951b7b8ced tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048614 Sep 13 20:09:24.596274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 451/1015] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:25.043083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2fcfe1b2-9030-4b00-b8d3-8aae2d5e4796 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:25.044074 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2fcfe1b2-9030-4b00-b8d3-8aae2d5e4796 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:25.053956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fcfe1b2-9030-4b00-b8d3-8aae2d5e4796 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:25.058253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fcfe1b2-9030-4b00-b8d3-8aae2d5e4796 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:25.058726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fcfe1b2-9030-4b00-b8d3-8aae2d5e4796 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:25.060377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fcfe1b2-9030-4b00-b8d3-8aae2d5e4796 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:25.060843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fcfe1b2-9030-4b00-b8d3-8aae2d5e4796 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:25.061239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fcfe1b2-9030-4b00-b8d3-8aae2d5e4796 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:25.135076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-634da76f-e095-4f71-b218-776c88cd3117 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:25.137487 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-634da76f-e095-4f71-b218-776c88cd3117 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:25.145261 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-634da76f-e095-4f71-b218-776c88cd3117 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:25.145975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-634da76f-e095-4f71-b218-776c88cd3117 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:25.146444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-634da76f-e095-4f71-b218-776c88cd3117 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:25.147673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-634da76f-e095-4f71-b218-776c88cd3117 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:25.148194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-634da76f-e095-4f71-b218-776c88cd3117 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:25.149518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-634da76f-e095-4f71-b218-776c88cd3117 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:25.180103 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-634da76f-e095-4f71-b218-776c88cd3117 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048990 Sep 13 20:09:25.180678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 452/1016] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:09:25.195053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2fcfe1b2-9030-4b00-b8d3-8aae2d5e4796 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:25.203768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2fcfe1b2-9030-4b00-b8d3-8aae2d5e4796 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167144 Sep 13 20:09:25.204376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 565/1017] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:25 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:25.608069 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6c42fd89-ecc9-4c2f-86c6-04ab70c27856 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:25.610197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6c42fd89-ecc9-4c2f-86c6-04ab70c27856 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:25.617284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c42fd89-ecc9-4c2f-86c6-04ab70c27856 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:25.617770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c42fd89-ecc9-4c2f-86c6-04ab70c27856 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:25.618205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c42fd89-ecc9-4c2f-86c6-04ab70c27856 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:25.618959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c42fd89-ecc9-4c2f-86c6-04ab70c27856 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:25.619410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c42fd89-ecc9-4c2f-86c6-04ab70c27856 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:25.619836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c42fd89-ecc9-4c2f-86c6-04ab70c27856 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:25.650418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6c42fd89-ecc9-4c2f-86c6-04ab70c27856 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046335 Sep 13 20:09:25.651006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 453/1018] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:26.192776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a03bec6b-c05f-4826-a562-787f3c67e351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:26.195076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a03bec6b-c05f-4826-a562-787f3c67e351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:26.201892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a03bec6b-c05f-4826-a562-787f3c67e351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:26.202389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a03bec6b-c05f-4826-a562-787f3c67e351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:26.202802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a03bec6b-c05f-4826-a562-787f3c67e351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:26.203473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a03bec6b-c05f-4826-a562-787f3c67e351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:26.203907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a03bec6b-c05f-4826-a562-787f3c67e351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:26.204326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a03bec6b-c05f-4826-a562-787f3c67e351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:26.226291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9d1a71ce-7c21-4bb4-8452-8ef5a155d650 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:26.227148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9d1a71ce-7c21-4bb4-8452-8ef5a155d650 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:26.233301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a03bec6b-c05f-4826-a562-787f3c67e351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044547 Sep 13 20:09:26.233447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d1a71ce-7c21-4bb4-8452-8ef5a155d650 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:26.233847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d1a71ce-7c21-4bb4-8452-8ef5a155d650 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:26.234175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 566/1019] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:26.234333 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d1a71ce-7c21-4bb4-8452-8ef5a155d650 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:26.234999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d1a71ce-7c21-4bb4-8452-8ef5a155d650 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:26.235452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d1a71ce-7c21-4bb4-8452-8ef5a155d650 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:26.235860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d1a71ce-7c21-4bb4-8452-8ef5a155d650 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:26.376684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9d1a71ce-7c21-4bb4-8452-8ef5a155d650 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:26.385567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9d1a71ce-7c21-4bb4-8452-8ef5a155d650 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163246 Sep 13 20:09:26.386143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 454/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:26 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:26.665846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a9b392d3-90cf-4701-a9a5-c4abafea5698 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:26.668628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a9b392d3-90cf-4701-a9a5-c4abafea5698 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:26.677108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9b392d3-90cf-4701-a9a5-c4abafea5698 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:26.677595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9b392d3-90cf-4701-a9a5-c4abafea5698 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:26.677999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9b392d3-90cf-4701-a9a5-c4abafea5698 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:26.678771 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9b392d3-90cf-4701-a9a5-c4abafea5698 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:26.679219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9b392d3-90cf-4701-a9a5-c4abafea5698 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:26.679644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9b392d3-90cf-4701-a9a5-c4abafea5698 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:26.711273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a9b392d3-90cf-4701-a9a5-c4abafea5698 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051357 Sep 13 20:09:26.711826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 567/1021] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:27.245513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cda143c6-740b-41db-b89b-12e8ff14dc12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:27.248268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cda143c6-740b-41db-b89b-12e8ff14dc12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:27.256023 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cda143c6-740b-41db-b89b-12e8ff14dc12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:27.256831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cda143c6-740b-41db-b89b-12e8ff14dc12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:27.257176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cda143c6-740b-41db-b89b-12e8ff14dc12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:27.258147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cda143c6-740b-41db-b89b-12e8ff14dc12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:27.258979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cda143c6-740b-41db-b89b-12e8ff14dc12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:27.259238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cda143c6-740b-41db-b89b-12e8ff14dc12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:27.292244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cda143c6-740b-41db-b89b-12e8ff14dc12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050682 Sep 13 20:09:27.296839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 455/1022] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:27 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:27.412384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-15dc8e48-9c1a-4cca-a7d7-34de9d15fea0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:27.413084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-15dc8e48-9c1a-4cca-a7d7-34de9d15fea0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:27.423096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15dc8e48-9c1a-4cca-a7d7-34de9d15fea0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:27.423589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15dc8e48-9c1a-4cca-a7d7-34de9d15fea0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:27.424096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15dc8e48-9c1a-4cca-a7d7-34de9d15fea0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:27.424897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15dc8e48-9c1a-4cca-a7d7-34de9d15fea0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:27.425423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15dc8e48-9c1a-4cca-a7d7-34de9d15fea0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:27.425908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15dc8e48-9c1a-4cca-a7d7-34de9d15fea0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:27.563211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-15dc8e48-9c1a-4cca-a7d7-34de9d15fea0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:27.572084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-15dc8e48-9c1a-4cca-a7d7-34de9d15fea0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163640 Sep 13 20:09:27.573161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 568/1023] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:27 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:27.724060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cdf36b83-9154-45ef-baf8-bda5bef6244a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:27.726335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cdf36b83-9154-45ef-baf8-bda5bef6244a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:27.732734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cdf36b83-9154-45ef-baf8-bda5bef6244a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:27.733224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cdf36b83-9154-45ef-baf8-bda5bef6244a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:27.733662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cdf36b83-9154-45ef-baf8-bda5bef6244a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:27.734361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cdf36b83-9154-45ef-baf8-bda5bef6244a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:27.734826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cdf36b83-9154-45ef-baf8-bda5bef6244a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:27.735246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cdf36b83-9154-45ef-baf8-bda5bef6244a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:27.766441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cdf36b83-9154-45ef-baf8-bda5bef6244a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046360 Sep 13 20:09:27.767040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 456/1024] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:27 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:28.305556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ecdb1af6-fc24-48ac-a33b-b4012b3a3c3d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:28.307777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ecdb1af6-fc24-48ac-a33b-b4012b3a3c3d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:28.314098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecdb1af6-fc24-48ac-a33b-b4012b3a3c3d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:28.314630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecdb1af6-fc24-48ac-a33b-b4012b3a3c3d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:28.315059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecdb1af6-fc24-48ac-a33b-b4012b3a3c3d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:28.315737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecdb1af6-fc24-48ac-a33b-b4012b3a3c3d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:28.316181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecdb1af6-fc24-48ac-a33b-b4012b3a3c3d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:28.316584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ecdb1af6-fc24-48ac-a33b-b4012b3a3c3d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:28.346794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ecdb1af6-fc24-48ac-a33b-b4012b3a3c3d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045173 Sep 13 20:09:28.347333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 569/1025] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:28.595462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7eb5e7e1-471b-44fa-b362-8bb0a2f4ad64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:28.596046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7eb5e7e1-471b-44fa-b362-8bb0a2f4ad64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:28.603153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7eb5e7e1-471b-44fa-b362-8bb0a2f4ad64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:28.603557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7eb5e7e1-471b-44fa-b362-8bb0a2f4ad64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:28.603992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7eb5e7e1-471b-44fa-b362-8bb0a2f4ad64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:28.604724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7eb5e7e1-471b-44fa-b362-8bb0a2f4ad64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:28.605167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7eb5e7e1-471b-44fa-b362-8bb0a2f4ad64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:28.605582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7eb5e7e1-471b-44fa-b362-8bb0a2f4ad64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:28.741956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7eb5e7e1-471b-44fa-b362-8bb0a2f4ad64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:28.750687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7eb5e7e1-471b-44fa-b362-8bb0a2f4ad64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.159105 Sep 13 20:09:28.751226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 457/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:28 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:28.783042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1cad7faf-320c-4ca7-8489-6148e4e15227 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:28.786327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1cad7faf-320c-4ca7-8489-6148e4e15227 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:28.796256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1cad7faf-320c-4ca7-8489-6148e4e15227 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:28.797017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1cad7faf-320c-4ca7-8489-6148e4e15227 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:28.797714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1cad7faf-320c-4ca7-8489-6148e4e15227 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:28.798818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1cad7faf-320c-4ca7-8489-6148e4e15227 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:28.799547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1cad7faf-320c-4ca7-8489-6148e4e15227 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:28.800087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1cad7faf-320c-4ca7-8489-6148e4e15227 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:28.827899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:28.834806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1cad7faf-320c-4ca7-8489-6148e4e15227 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058323 Sep 13 20:09:28.835402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 570/1027] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:29.359750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a6ead1bc-e936-4b2d-9c41-f38801db3d27 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:29.361928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a6ead1bc-e936-4b2d-9c41-f38801db3d27 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:29.368595 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6ead1bc-e936-4b2d-9c41-f38801db3d27 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:29.369070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6ead1bc-e936-4b2d-9c41-f38801db3d27 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:29.369497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6ead1bc-e936-4b2d-9c41-f38801db3d27 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:29.370180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6ead1bc-e936-4b2d-9c41-f38801db3d27 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:29.370652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6ead1bc-e936-4b2d-9c41-f38801db3d27 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:29.371089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6ead1bc-e936-4b2d-9c41-f38801db3d27 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:29.401440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a6ead1bc-e936-4b2d-9c41-f38801db3d27 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045602 Sep 13 20:09:29.401985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 458/1028] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:29.775148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-15920296-eaec-47ea-8d5c-20e326667997 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:29.775754 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-15920296-eaec-47ea-8d5c-20e326667997 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:29.782951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15920296-eaec-47ea-8d5c-20e326667997 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:29.783488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15920296-eaec-47ea-8d5c-20e326667997 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:29.784062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15920296-eaec-47ea-8d5c-20e326667997 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:29.784672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15920296-eaec-47ea-8d5c-20e326667997 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:29.785124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15920296-eaec-47ea-8d5c-20e326667997 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:29.785544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-15920296-eaec-47ea-8d5c-20e326667997 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:29.847769 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-727a3eea-e5a1-4c93-9e80-cfcc743f8ea1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:29.850002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-727a3eea-e5a1-4c93-9e80-cfcc743f8ea1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:29.856313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-727a3eea-e5a1-4c93-9e80-cfcc743f8ea1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:29.856795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-727a3eea-e5a1-4c93-9e80-cfcc743f8ea1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:29.857228 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-727a3eea-e5a1-4c93-9e80-cfcc743f8ea1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:29.857922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-727a3eea-e5a1-4c93-9e80-cfcc743f8ea1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:29.858383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-727a3eea-e5a1-4c93-9e80-cfcc743f8ea1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:29.858805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-727a3eea-e5a1-4c93-9e80-cfcc743f8ea1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:29.889834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-727a3eea-e5a1-4c93-9e80-cfcc743f8ea1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046119 Sep 13 20:09:29.890655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 459/1029] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:29 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:29.917458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-15920296-eaec-47ea-8d5c-20e326667997 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:29.926160 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-15920296-eaec-47ea-8d5c-20e326667997 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156003 Sep 13 20:09:29.926781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 571/1030] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:29 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:30.413731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-de5fa28d-76e6-475c-996a-64b0d4435621 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:30.416075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-de5fa28d-76e6-475c-996a-64b0d4435621 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:30.424799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de5fa28d-76e6-475c-996a-64b0d4435621 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:30.425523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de5fa28d-76e6-475c-996a-64b0d4435621 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:30.426129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de5fa28d-76e6-475c-996a-64b0d4435621 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:30.427217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de5fa28d-76e6-475c-996a-64b0d4435621 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:30.427705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de5fa28d-76e6-475c-996a-64b0d4435621 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:30.428247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de5fa28d-76e6-475c-996a-64b0d4435621 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:30.443225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:30.461228 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-de5fa28d-76e6-475c-996a-64b0d4435621 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051571 Sep 13 20:09:30.461823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 460/1031] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:30 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:30.903443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cd9ff80b-40d2-40fd-9cab-58359e624fcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:30.905633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cd9ff80b-40d2-40fd-9cab-58359e624fcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:30.912237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd9ff80b-40d2-40fd-9cab-58359e624fcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:30.912717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd9ff80b-40d2-40fd-9cab-58359e624fcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:30.913151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd9ff80b-40d2-40fd-9cab-58359e624fcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:30.913842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd9ff80b-40d2-40fd-9cab-58359e624fcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:30.914289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd9ff80b-40d2-40fd-9cab-58359e624fcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:30.914735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd9ff80b-40d2-40fd-9cab-58359e624fcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:30.944674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cd9ff80b-40d2-40fd-9cab-58359e624fcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045289 Sep 13 20:09:30.945248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 572/1032] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:30 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:30.949625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1b190938-fb4b-4f6f-8aa7-a2fe5b267660 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:30.950451 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1b190938-fb4b-4f6f-8aa7-a2fe5b267660 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:30.957275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1b190938-fb4b-4f6f-8aa7-a2fe5b267660 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:30.957750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1b190938-fb4b-4f6f-8aa7-a2fe5b267660 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:30.958212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1b190938-fb4b-4f6f-8aa7-a2fe5b267660 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:30.958936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1b190938-fb4b-4f6f-8aa7-a2fe5b267660 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:30.959445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1b190938-fb4b-4f6f-8aa7-a2fe5b267660 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:30.959886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1b190938-fb4b-4f6f-8aa7-a2fe5b267660 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:31.100687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1b190938-fb4b-4f6f-8aa7-a2fe5b267660 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:31.109184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1b190938-fb4b-4f6f-8aa7-a2fe5b267660 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163718 Sep 13 20:09:31.109749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 461/1033] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:30 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:31.474974 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4e963d10-8dbc-4d66-9fcf-4d5c8f003e73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:31.477330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4e963d10-8dbc-4d66-9fcf-4d5c8f003e73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:31.483753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4e963d10-8dbc-4d66-9fcf-4d5c8f003e73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:31.484606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4e963d10-8dbc-4d66-9fcf-4d5c8f003e73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:31.485399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4e963d10-8dbc-4d66-9fcf-4d5c8f003e73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:31.486335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4e963d10-8dbc-4d66-9fcf-4d5c8f003e73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:31.486814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4e963d10-8dbc-4d66-9fcf-4d5c8f003e73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:31.487263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4e963d10-8dbc-4d66-9fcf-4d5c8f003e73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:31.521810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4e963d10-8dbc-4d66-9fcf-4d5c8f003e73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050780 Sep 13 20:09:31.522425 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 573/1034] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:31 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:31.959450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-714154f6-25c8-429e-9d30-b4fcf6047d9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:31.961981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-714154f6-25c8-429e-9d30-b4fcf6047d9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:31.968801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-714154f6-25c8-429e-9d30-b4fcf6047d9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:31.969285 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-714154f6-25c8-429e-9d30-b4fcf6047d9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:31.969722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-714154f6-25c8-429e-9d30-b4fcf6047d9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:31.970441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-714154f6-25c8-429e-9d30-b4fcf6047d9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:31.970898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-714154f6-25c8-429e-9d30-b4fcf6047d9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:31.971326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-714154f6-25c8-429e-9d30-b4fcf6047d9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:32.001370 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-714154f6-25c8-429e-9d30-b4fcf6047d9e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047065 Sep 13 20:09:32.001933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 462/1035] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:32.133028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-26f97cd1-84af-48d0-844a-fa766dfb6797 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:32.133589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-26f97cd1-84af-48d0-844a-fa766dfb6797 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:32.141496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-26f97cd1-84af-48d0-844a-fa766dfb6797 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:32.141962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-26f97cd1-84af-48d0-844a-fa766dfb6797 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:32.142424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-26f97cd1-84af-48d0-844a-fa766dfb6797 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:32.143171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-26f97cd1-84af-48d0-844a-fa766dfb6797 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:32.143626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-26f97cd1-84af-48d0-844a-fa766dfb6797 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:32.144054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-26f97cd1-84af-48d0-844a-fa766dfb6797 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:32.283880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-26f97cd1-84af-48d0-844a-fa766dfb6797 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:32.292719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-26f97cd1-84af-48d0-844a-fa766dfb6797 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163903 Sep 13 20:09:32.293295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 574/1036] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:32 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:32.535002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-72da27a9-e70e-4d4a-8e37-ad480c075a8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:32.544949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-72da27a9-e70e-4d4a-8e37-ad480c075a8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:32.551652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-72da27a9-e70e-4d4a-8e37-ad480c075a8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:32.552137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-72da27a9-e70e-4d4a-8e37-ad480c075a8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:32.552574 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-72da27a9-e70e-4d4a-8e37-ad480c075a8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:32.553256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-72da27a9-e70e-4d4a-8e37-ad480c075a8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:32.553697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-72da27a9-e70e-4d4a-8e37-ad480c075a8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:32.554104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-72da27a9-e70e-4d4a-8e37-ad480c075a8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:32.585814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-72da27a9-e70e-4d4a-8e37-ad480c075a8d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054709 Sep 13 20:09:32.586388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 463/1037] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:32 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:33.016839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d6b25f2f-860d-4572-8b19-30cef2034be6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:33.019128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d6b25f2f-860d-4572-8b19-30cef2034be6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:33.025520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6b25f2f-860d-4572-8b19-30cef2034be6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:33.025996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6b25f2f-860d-4572-8b19-30cef2034be6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:33.026452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6b25f2f-860d-4572-8b19-30cef2034be6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:33.027147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6b25f2f-860d-4572-8b19-30cef2034be6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:33.027585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6b25f2f-860d-4572-8b19-30cef2034be6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:33.027994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6b25f2f-860d-4572-8b19-30cef2034be6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:33.059566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d6b25f2f-860d-4572-8b19-30cef2034be6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046956 Sep 13 20:09:33.060394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 575/1038] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:33.317565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-49b1a141-6b52-4437-a973-a421d2233c33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:33.318225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-49b1a141-6b52-4437-a973-a421d2233c33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:33.325929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49b1a141-6b52-4437-a973-a421d2233c33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:33.326527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49b1a141-6b52-4437-a973-a421d2233c33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:33.327019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49b1a141-6b52-4437-a973-a421d2233c33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:33.327786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49b1a141-6b52-4437-a973-a421d2233c33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:33.328302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49b1a141-6b52-4437-a973-a421d2233c33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:33.328768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49b1a141-6b52-4437-a973-a421d2233c33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:33.465091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-49b1a141-6b52-4437-a973-a421d2233c33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:33.477653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-49b1a141-6b52-4437-a973-a421d2233c33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164388 Sep 13 20:09:33.478475 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 464/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:33 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:33.602057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b81fca15-0c44-4bdd-aaaf-b8a5964ae042 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:33.604586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b81fca15-0c44-4bdd-aaaf-b8a5964ae042 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:33.612034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b81fca15-0c44-4bdd-aaaf-b8a5964ae042 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:33.612336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b81fca15-0c44-4bdd-aaaf-b8a5964ae042 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:33.612773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b81fca15-0c44-4bdd-aaaf-b8a5964ae042 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:33.613478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b81fca15-0c44-4bdd-aaaf-b8a5964ae042 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:33.613927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b81fca15-0c44-4bdd-aaaf-b8a5964ae042 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:33.614337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b81fca15-0c44-4bdd-aaaf-b8a5964ae042 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:33.646507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b81fca15-0c44-4bdd-aaaf-b8a5964ae042 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049173 Sep 13 20:09:33.647100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 576/1040] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:33 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:34.074205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-59b8cc59-ded6-4687-8856-c54f58ec9450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:34.076761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-59b8cc59-ded6-4687-8856-c54f58ec9450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:34.083510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59b8cc59-ded6-4687-8856-c54f58ec9450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:34.083993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59b8cc59-ded6-4687-8856-c54f58ec9450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:34.084434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59b8cc59-ded6-4687-8856-c54f58ec9450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:34.085125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59b8cc59-ded6-4687-8856-c54f58ec9450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:34.085573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59b8cc59-ded6-4687-8856-c54f58ec9450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:34.086145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59b8cc59-ded6-4687-8856-c54f58ec9450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:34.116131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-59b8cc59-ded6-4687-8856-c54f58ec9450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045945 Sep 13 20:09:34.116663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 465/1041] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:34 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:34.505400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-10e25a04-3790-4195-83a2-7e45e11c57ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:34.506316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-10e25a04-3790-4195-83a2-7e45e11c57ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:34.513391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10e25a04-3790-4195-83a2-7e45e11c57ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:34.513864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10e25a04-3790-4195-83a2-7e45e11c57ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:34.514287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10e25a04-3790-4195-83a2-7e45e11c57ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:34.515019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10e25a04-3790-4195-83a2-7e45e11c57ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:34.515473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10e25a04-3790-4195-83a2-7e45e11c57ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:34.515898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10e25a04-3790-4195-83a2-7e45e11c57ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:34.657272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-10e25a04-3790-4195-83a2-7e45e11c57ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:34.659357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-28968a38-5832-4f47-845d-0e979637c370 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:34.661507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-28968a38-5832-4f47-845d-0e979637c370 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:34.673141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-10e25a04-3790-4195-83a2-7e45e11c57ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167085 Sep 13 20:09:34.673263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28968a38-5832-4f47-845d-0e979637c370 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:34.673263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28968a38-5832-4f47-845d-0e979637c370 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:34.673263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28968a38-5832-4f47-845d-0e979637c370 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:34.673263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28968a38-5832-4f47-845d-0e979637c370 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:34.673570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28968a38-5832-4f47-845d-0e979637c370 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:34.673570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28968a38-5832-4f47-845d-0e979637c370 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:34.673731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 577/1042] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:34 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:34.700731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-28968a38-5832-4f47-845d-0e979637c370 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Sep 13 20:09:34.701311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 466/1043] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:34 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:09:35.132422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f9a4fb6a-9dc9-4ee5-899a-b6c8668667cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:35.134713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f9a4fb6a-9dc9-4ee5-899a-b6c8668667cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:35.141196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9a4fb6a-9dc9-4ee5-899a-b6c8668667cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:35.141680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9a4fb6a-9dc9-4ee5-899a-b6c8668667cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:35.142116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9a4fb6a-9dc9-4ee5-899a-b6c8668667cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:35.142844 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9a4fb6a-9dc9-4ee5-899a-b6c8668667cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:35.143298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9a4fb6a-9dc9-4ee5-899a-b6c8668667cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:35.143719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9a4fb6a-9dc9-4ee5-899a-b6c8668667cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:35.174072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f9a4fb6a-9dc9-4ee5-899a-b6c8668667cf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047595 Sep 13 20:09:35.174800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 578/1044] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:35 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:35.689036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-98ee8401-0e34-4353-add9-7d0f258adbf7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:35.689635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-98ee8401-0e34-4353-add9-7d0f258adbf7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:35.696646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98ee8401-0e34-4353-add9-7d0f258adbf7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:35.697125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98ee8401-0e34-4353-add9-7d0f258adbf7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:35.697561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98ee8401-0e34-4353-add9-7d0f258adbf7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:35.698265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98ee8401-0e34-4353-add9-7d0f258adbf7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:35.698741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98ee8401-0e34-4353-add9-7d0f258adbf7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:35.699179 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-98ee8401-0e34-4353-add9-7d0f258adbf7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:35.718283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dff884d8-61fb-461b-9b0d-af2f344b263b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:35.721813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dff884d8-61fb-461b-9b0d-af2f344b263b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:35.732422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dff884d8-61fb-461b-9b0d-af2f344b263b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:35.733227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dff884d8-61fb-461b-9b0d-af2f344b263b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:35.733920 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dff884d8-61fb-461b-9b0d-af2f344b263b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:35.735232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dff884d8-61fb-461b-9b0d-af2f344b263b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:35.736168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dff884d8-61fb-461b-9b0d-af2f344b263b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:35.737080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dff884d8-61fb-461b-9b0d-af2f344b263b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:35.778543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dff884d8-61fb-461b-9b0d-af2f344b263b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068604 Sep 13 20:09:35.779730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 579/1045] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:35 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:35.862520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-98ee8401-0e34-4353-add9-7d0f258adbf7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:35.875112 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-98ee8401-0e34-4353-add9-7d0f258adbf7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.189700 Sep 13 20:09:35.875833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 467/1046] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:35 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:36.187616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-101e449b-55c3-4755-8076-999b6bf73c73 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:36.189683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-101e449b-55c3-4755-8076-999b6bf73c73 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:36.196040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-101e449b-55c3-4755-8076-999b6bf73c73 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:36.196503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-101e449b-55c3-4755-8076-999b6bf73c73 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:36.196930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-101e449b-55c3-4755-8076-999b6bf73c73 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:36.197607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-101e449b-55c3-4755-8076-999b6bf73c73 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:36.198050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-101e449b-55c3-4755-8076-999b6bf73c73 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:36.198496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-101e449b-55c3-4755-8076-999b6bf73c73 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:36.229114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-101e449b-55c3-4755-8076-999b6bf73c73 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045620 Sep 13 20:09:36.229659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 580/1047] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:36.791634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f5ac9dbe-5224-4766-8398-469370f35476 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:36.793848 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f5ac9dbe-5224-4766-8398-469370f35476 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:36.800912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f5ac9dbe-5224-4766-8398-469370f35476 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:36.801530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f5ac9dbe-5224-4766-8398-469370f35476 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:36.801967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f5ac9dbe-5224-4766-8398-469370f35476 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:36.802739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f5ac9dbe-5224-4766-8398-469370f35476 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:36.803165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f5ac9dbe-5224-4766-8398-469370f35476 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:36.803590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f5ac9dbe-5224-4766-8398-469370f35476 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:36.835632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f5ac9dbe-5224-4766-8398-469370f35476 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047896 Sep 13 20:09:36.836219 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 468/1048] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:36 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:36.899179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b92b5a61-7017-4a0f-8729-91170c578e14 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:36.899792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b92b5a61-7017-4a0f-8729-91170c578e14 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:36.906783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b92b5a61-7017-4a0f-8729-91170c578e14 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:36.907290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b92b5a61-7017-4a0f-8729-91170c578e14 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:36.907728 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b92b5a61-7017-4a0f-8729-91170c578e14 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:36.908415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b92b5a61-7017-4a0f-8729-91170c578e14 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:36.908866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b92b5a61-7017-4a0f-8729-91170c578e14 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:36.909287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b92b5a61-7017-4a0f-8729-91170c578e14 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:37.042171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b92b5a61-7017-4a0f-8729-91170c578e14 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:37.050873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b92b5a61-7017-4a0f-8729-91170c578e14 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155700 Sep 13 20:09:37.051445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 581/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:36 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:37.241696 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c44f4a7c-3657-40d6-8727-47f9858065b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:37.243884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c44f4a7c-3657-40d6-8727-47f9858065b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:37.250430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c44f4a7c-3657-40d6-8727-47f9858065b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:37.250944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c44f4a7c-3657-40d6-8727-47f9858065b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:37.251371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c44f4a7c-3657-40d6-8727-47f9858065b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:37.252069 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c44f4a7c-3657-40d6-8727-47f9858065b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:37.252548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c44f4a7c-3657-40d6-8727-47f9858065b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:37.252970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c44f4a7c-3657-40d6-8727-47f9858065b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:37.284189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c44f4a7c-3657-40d6-8727-47f9858065b4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046583 Sep 13 20:09:37.285262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 469/1050] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:37.848412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-acd42fac-1c06-4f99-9a79-bc8e799bd7db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:37.850621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-acd42fac-1c06-4f99-9a79-bc8e799bd7db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:37.857116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-acd42fac-1c06-4f99-9a79-bc8e799bd7db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:37.857598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-acd42fac-1c06-4f99-9a79-bc8e799bd7db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:37.858025 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-acd42fac-1c06-4f99-9a79-bc8e799bd7db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:37.858757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-acd42fac-1c06-4f99-9a79-bc8e799bd7db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:37.859208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-acd42fac-1c06-4f99-9a79-bc8e799bd7db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:37.859623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-acd42fac-1c06-4f99-9a79-bc8e799bd7db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:37.890494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-acd42fac-1c06-4f99-9a79-bc8e799bd7db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046077 Sep 13 20:09:37.891061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 582/1051] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:37 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:38.076404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0160ec6a-a113-4e98-9f92-ede6dfa3d117 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:38.076974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0160ec6a-a113-4e98-9f92-ede6dfa3d117 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:38.083838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0160ec6a-a113-4e98-9f92-ede6dfa3d117 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:38.084378 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0160ec6a-a113-4e98-9f92-ede6dfa3d117 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:38.084925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0160ec6a-a113-4e98-9f92-ede6dfa3d117 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:38.085709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0160ec6a-a113-4e98-9f92-ede6dfa3d117 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:38.086454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0160ec6a-a113-4e98-9f92-ede6dfa3d117 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:38.086776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0160ec6a-a113-4e98-9f92-ede6dfa3d117 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:38.227660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0160ec6a-a113-4e98-9f92-ede6dfa3d117 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:38.236255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0160ec6a-a113-4e98-9f92-ede6dfa3d117 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164262 Sep 13 20:09:38.236823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 470/1052] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:38 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:38.300804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fddb7262-f91c-4100-9d33-2045f6e638ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:38.303517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fddb7262-f91c-4100-9d33-2045f6e638ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:38.313706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fddb7262-f91c-4100-9d33-2045f6e638ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:38.314199 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fddb7262-f91c-4100-9d33-2045f6e638ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:38.314663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fddb7262-f91c-4100-9d33-2045f6e638ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:38.315369 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fddb7262-f91c-4100-9d33-2045f6e638ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:38.315814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fddb7262-f91c-4100-9d33-2045f6e638ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:38.316232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fddb7262-f91c-4100-9d33-2045f6e638ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:38.349063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fddb7262-f91c-4100-9d33-2045f6e638ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054531 Sep 13 20:09:38.349541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 583/1053] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:38.903222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-675caacf-3b83-4fea-b942-60db1d9f3f43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:38.905425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-675caacf-3b83-4fea-b942-60db1d9f3f43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:38.911709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-675caacf-3b83-4fea-b942-60db1d9f3f43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:38.912187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-675caacf-3b83-4fea-b942-60db1d9f3f43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:38.912610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-675caacf-3b83-4fea-b942-60db1d9f3f43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:38.913273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-675caacf-3b83-4fea-b942-60db1d9f3f43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:38.913716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-675caacf-3b83-4fea-b942-60db1d9f3f43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:38.914130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-675caacf-3b83-4fea-b942-60db1d9f3f43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:38.944971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-675caacf-3b83-4fea-b942-60db1d9f3f43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045703 Sep 13 20:09:38.945525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 471/1054] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:38 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:39.259497 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-70c9ec20-d70b-4c0a-a873-a38155f9fcd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:39.260194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-70c9ec20-d70b-4c0a-a873-a38155f9fcd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:39.266729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70c9ec20-d70b-4c0a-a873-a38155f9fcd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:39.267212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70c9ec20-d70b-4c0a-a873-a38155f9fcd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:39.267645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70c9ec20-d70b-4c0a-a873-a38155f9fcd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:39.268336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70c9ec20-d70b-4c0a-a873-a38155f9fcd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:39.268769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70c9ec20-d70b-4c0a-a873-a38155f9fcd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:39.269205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-70c9ec20-d70b-4c0a-a873-a38155f9fcd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:39.362547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-250cf36e-1550-4507-9be8-926cededcf63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:39.365023 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-250cf36e-1550-4507-9be8-926cededcf63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:39.372068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-250cf36e-1550-4507-9be8-926cededcf63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:39.372549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-250cf36e-1550-4507-9be8-926cededcf63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:39.372974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-250cf36e-1550-4507-9be8-926cededcf63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:39.373662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-250cf36e-1550-4507-9be8-926cededcf63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:39.374102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-250cf36e-1550-4507-9be8-926cededcf63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:39.374547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-250cf36e-1550-4507-9be8-926cededcf63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:39.404695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-250cf36e-1550-4507-9be8-926cededcf63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046419 Sep 13 20:09:39.405241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 472/1055] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:39.412363 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-70c9ec20-d70b-4c0a-a873-a38155f9fcd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:39.420872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-70c9ec20-d70b-4c0a-a873-a38155f9fcd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165398 Sep 13 20:09:39.421462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 584/1056] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:39 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:39.959523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-40b4bb27-7a9f-452c-8b7f-b90c5f731774 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:39.962169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-40b4bb27-7a9f-452c-8b7f-b90c5f731774 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:39.968855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40b4bb27-7a9f-452c-8b7f-b90c5f731774 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:39.969271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40b4bb27-7a9f-452c-8b7f-b90c5f731774 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:39.969700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40b4bb27-7a9f-452c-8b7f-b90c5f731774 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:39.970393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40b4bb27-7a9f-452c-8b7f-b90c5f731774 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:39.970875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40b4bb27-7a9f-452c-8b7f-b90c5f731774 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:39.971280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40b4bb27-7a9f-452c-8b7f-b90c5f731774 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:40.002877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-40b4bb27-7a9f-452c-8b7f-b90c5f731774 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048262 Sep 13 20:09:40.006210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 473/1057] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:39 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:40.419789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d3610737-f6e5-4a2d-8363-02e67727efe4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:40.422030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d3610737-f6e5-4a2d-8363-02e67727efe4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:40.428983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3610737-f6e5-4a2d-8363-02e67727efe4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:40.429468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3610737-f6e5-4a2d-8363-02e67727efe4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:40.429899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3610737-f6e5-4a2d-8363-02e67727efe4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:40.430644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3610737-f6e5-4a2d-8363-02e67727efe4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:40.431098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3610737-f6e5-4a2d-8363-02e67727efe4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:40.431515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3610737-f6e5-4a2d-8363-02e67727efe4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:40.444848 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0804e9bb-c8de-4bc8-87bd-05fe02481710 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:40.445628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0804e9bb-c8de-4bc8-87bd-05fe02481710 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:40.452911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0804e9bb-c8de-4bc8-87bd-05fe02481710 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:40.453291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0804e9bb-c8de-4bc8-87bd-05fe02481710 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:40.453715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0804e9bb-c8de-4bc8-87bd-05fe02481710 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:40.454434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0804e9bb-c8de-4bc8-87bd-05fe02481710 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:40.454884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0804e9bb-c8de-4bc8-87bd-05fe02481710 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:40.455303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0804e9bb-c8de-4bc8-87bd-05fe02481710 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:40.463444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d3610737-f6e5-4a2d-8363-02e67727efe4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048767 Sep 13 20:09:40.464033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 585/1058] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:40.598024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0804e9bb-c8de-4bc8-87bd-05fe02481710 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:40.610727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0804e9bb-c8de-4bc8-87bd-05fe02481710 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.169460 Sep 13 20:09:40.611457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 474/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:40 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:41.014976 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-adf62704-e5f1-409d-b891-6e1f18d61cca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:41.016986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-adf62704-e5f1-409d-b891-6e1f18d61cca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:41.023202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-adf62704-e5f1-409d-b891-6e1f18d61cca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:41.023680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-adf62704-e5f1-409d-b891-6e1f18d61cca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:41.024103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-adf62704-e5f1-409d-b891-6e1f18d61cca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:41.024777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-adf62704-e5f1-409d-b891-6e1f18d61cca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:41.025272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-adf62704-e5f1-409d-b891-6e1f18d61cca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:41.025686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-adf62704-e5f1-409d-b891-6e1f18d61cca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:41.069600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-adf62704-e5f1-409d-b891-6e1f18d61cca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058743 Sep 13 20:09:41.070304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 586/1060] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:41 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:41.477155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cbdae862-9f10-4b31-b5e6-4f435c7b4160 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:41.479417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cbdae862-9f10-4b31-b5e6-4f435c7b4160 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:41.486269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbdae862-9f10-4b31-b5e6-4f435c7b4160 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:41.486809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbdae862-9f10-4b31-b5e6-4f435c7b4160 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:41.487250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbdae862-9f10-4b31-b5e6-4f435c7b4160 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:41.487945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbdae862-9f10-4b31-b5e6-4f435c7b4160 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:41.488398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbdae862-9f10-4b31-b5e6-4f435c7b4160 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:41.488821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbdae862-9f10-4b31-b5e6-4f435c7b4160 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:41.518971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cbdae862-9f10-4b31-b5e6-4f435c7b4160 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045863 Sep 13 20:09:41.519515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 475/1061] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:41 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:41.640844 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6da8d808-b102-4c45-9fe4-7fecf1466e76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:41.641638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6da8d808-b102-4c45-9fe4-7fecf1466e76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:41.651960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6da8d808-b102-4c45-9fe4-7fecf1466e76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:41.652450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6da8d808-b102-4c45-9fe4-7fecf1466e76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:41.652916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6da8d808-b102-4c45-9fe4-7fecf1466e76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:41.653614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6da8d808-b102-4c45-9fe4-7fecf1466e76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:41.654063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6da8d808-b102-4c45-9fe4-7fecf1466e76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:41.654524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6da8d808-b102-4c45-9fe4-7fecf1466e76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:41.670279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:41.793398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6da8d808-b102-4c45-9fe4-7fecf1466e76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:41.801971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6da8d808-b102-4c45-9fe4-7fecf1466e76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167588 Sep 13 20:09:41.802649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 587/1062] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:41 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:42.082897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6b364ad9-4f19-400f-8c79-d815cc67be1f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:42.085084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6b364ad9-4f19-400f-8c79-d815cc67be1f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:42.092213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6b364ad9-4f19-400f-8c79-d815cc67be1f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:42.092698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6b364ad9-4f19-400f-8c79-d815cc67be1f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:42.093133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6b364ad9-4f19-400f-8c79-d815cc67be1f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:42.093824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6b364ad9-4f19-400f-8c79-d815cc67be1f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:42.094358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6b364ad9-4f19-400f-8c79-d815cc67be1f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:42.094851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6b364ad9-4f19-400f-8c79-d815cc67be1f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:42.128702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6b364ad9-4f19-400f-8c79-d815cc67be1f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049797 Sep 13 20:09:42.130083 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 476/1063] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:42 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:42.538324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3c482ecd-5d0a-4ae2-94f8-6a3425d86efd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:42.541481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3c482ecd-5d0a-4ae2-94f8-6a3425d86efd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:42.548775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c482ecd-5d0a-4ae2-94f8-6a3425d86efd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:42.549260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c482ecd-5d0a-4ae2-94f8-6a3425d86efd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:42.549693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c482ecd-5d0a-4ae2-94f8-6a3425d86efd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:42.550404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c482ecd-5d0a-4ae2-94f8-6a3425d86efd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:42.550884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c482ecd-5d0a-4ae2-94f8-6a3425d86efd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:42.551316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c482ecd-5d0a-4ae2-94f8-6a3425d86efd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:42.585083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3c482ecd-5d0a-4ae2-94f8-6a3425d86efd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053473 Sep 13 20:09:42.585657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 588/1064] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:42.825517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0f8f0b58-0f97-45c7-9f03-9f6bc0bcd6c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:42.826065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0f8f0b58-0f97-45c7-9f03-9f6bc0bcd6c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:42.833678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f8f0b58-0f97-45c7-9f03-9f6bc0bcd6c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:42.834173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f8f0b58-0f97-45c7-9f03-9f6bc0bcd6c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:42.834660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f8f0b58-0f97-45c7-9f03-9f6bc0bcd6c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:42.835362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f8f0b58-0f97-45c7-9f03-9f6bc0bcd6c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:42.835817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f8f0b58-0f97-45c7-9f03-9f6bc0bcd6c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:42.836245 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f8f0b58-0f97-45c7-9f03-9f6bc0bcd6c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:42.839043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:42.985390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0f8f0b58-0f97-45c7-9f03-9f6bc0bcd6c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:42.994198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0f8f0b58-0f97-45c7-9f03-9f6bc0bcd6c6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.172745 Sep 13 20:09:42.994943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 477/1065] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:42 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:43.141443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-92b98226-e133-43d5-bbea-9c173ae33c0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:43.143668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-92b98226-e133-43d5-bbea-9c173ae33c0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:43.150553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92b98226-e133-43d5-bbea-9c173ae33c0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:43.151046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92b98226-e133-43d5-bbea-9c173ae33c0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:43.151476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92b98226-e133-43d5-bbea-9c173ae33c0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:43.152270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92b98226-e133-43d5-bbea-9c173ae33c0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:43.152717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92b98226-e133-43d5-bbea-9c173ae33c0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:43.153136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92b98226-e133-43d5-bbea-9c173ae33c0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:43.194663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-92b98226-e133-43d5-bbea-9c173ae33c0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057106 Sep 13 20:09:43.195213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 589/1066] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:43 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:43.601240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-11306755-a1c9-42a5-9900-30daef16ec90 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:43.604627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-11306755-a1c9-42a5-9900-30daef16ec90 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:43.613680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-11306755-a1c9-42a5-9900-30daef16ec90 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:43.614313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-11306755-a1c9-42a5-9900-30daef16ec90 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:43.614964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-11306755-a1c9-42a5-9900-30daef16ec90 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:43.616102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-11306755-a1c9-42a5-9900-30daef16ec90 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:43.616564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-11306755-a1c9-42a5-9900-30daef16ec90 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:43.617064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-11306755-a1c9-42a5-9900-30daef16ec90 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:43.651764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-11306755-a1c9-42a5-9900-30daef16ec90 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057328 Sep 13 20:09:43.652359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 478/1067] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:44.022015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4a05068f-a9f6-4f01-825f-8429466379cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:44.023073 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4a05068f-a9f6-4f01-825f-8429466379cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:44.033418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a05068f-a9f6-4f01-825f-8429466379cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:44.034212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a05068f-a9f6-4f01-825f-8429466379cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:44.034992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a05068f-a9f6-4f01-825f-8429466379cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:44.036236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a05068f-a9f6-4f01-825f-8429466379cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:44.037001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a05068f-a9f6-4f01-825f-8429466379cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:44.037705 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a05068f-a9f6-4f01-825f-8429466379cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:44.183162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4a05068f-a9f6-4f01-825f-8429466379cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:44.195160 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4a05068f-a9f6-4f01-825f-8429466379cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.179705 Sep 13 20:09:44.195742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 590/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:44 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:44.212774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3e9b6486-0ff6-424b-983b-56bbb70bc565 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:44.215018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3e9b6486-0ff6-424b-983b-56bbb70bc565 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:44.221054 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e9b6486-0ff6-424b-983b-56bbb70bc565 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:44.221528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e9b6486-0ff6-424b-983b-56bbb70bc565 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:44.221955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e9b6486-0ff6-424b-983b-56bbb70bc565 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:44.222668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e9b6486-0ff6-424b-983b-56bbb70bc565 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:44.223107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e9b6486-0ff6-424b-983b-56bbb70bc565 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:44.223514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e9b6486-0ff6-424b-983b-56bbb70bc565 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:44.255310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3e9b6486-0ff6-424b-983b-56bbb70bc565 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051566 Sep 13 20:09:44.255871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 479/1069] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:44 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:44.665931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-481e6729-9bf9-40e0-a9ef-f3198b4ba992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:44.668168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-481e6729-9bf9-40e0-a9ef-f3198b4ba992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:44.674828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-481e6729-9bf9-40e0-a9ef-f3198b4ba992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:44.675311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-481e6729-9bf9-40e0-a9ef-f3198b4ba992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:44.675744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-481e6729-9bf9-40e0-a9ef-f3198b4ba992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:44.676440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-481e6729-9bf9-40e0-a9ef-f3198b4ba992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:44.676890 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-481e6729-9bf9-40e0-a9ef-f3198b4ba992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:44.677312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-481e6729-9bf9-40e0-a9ef-f3198b4ba992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:44.709519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-481e6729-9bf9-40e0-a9ef-f3198b4ba992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047876 Sep 13 20:09:44.710078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 591/1070] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:45.220442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0dae8b99-41e5-45be-ab16-d2d6bc91f455 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:45.221119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0dae8b99-41e5-45be-ab16-d2d6bc91f455 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:45.227965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0dae8b99-41e5-45be-ab16-d2d6bc91f455 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:45.228447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0dae8b99-41e5-45be-ab16-d2d6bc91f455 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:45.228871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0dae8b99-41e5-45be-ab16-d2d6bc91f455 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:45.229594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0dae8b99-41e5-45be-ab16-d2d6bc91f455 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:45.230038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0dae8b99-41e5-45be-ab16-d2d6bc91f455 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:45.230492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0dae8b99-41e5-45be-ab16-d2d6bc91f455 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:45.267718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3789cc2c-c3c4-46d7-970b-32ea7b1f7692 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:45.270245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3789cc2c-c3c4-46d7-970b-32ea7b1f7692 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:45.277210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3789cc2c-c3c4-46d7-970b-32ea7b1f7692 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:45.277949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3789cc2c-c3c4-46d7-970b-32ea7b1f7692 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:45.278402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3789cc2c-c3c4-46d7-970b-32ea7b1f7692 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:45.279105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3789cc2c-c3c4-46d7-970b-32ea7b1f7692 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:45.279713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3789cc2c-c3c4-46d7-970b-32ea7b1f7692 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:45.280125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3789cc2c-c3c4-46d7-970b-32ea7b1f7692 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:45.313661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3789cc2c-c3c4-46d7-970b-32ea7b1f7692 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049689 Sep 13 20:09:45.314623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 592/1071] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:45 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:45.368503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0dae8b99-41e5-45be-ab16-d2d6bc91f455 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:45.377953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0dae8b99-41e5-45be-ab16-d2d6bc91f455 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161456 Sep 13 20:09:45.378535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 480/1072] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:45 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:45.722818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c348e2f8-7a5b-48d9-a2ae-6144df3dc659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:45.724947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c348e2f8-7a5b-48d9-a2ae-6144df3dc659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:45.731470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c348e2f8-7a5b-48d9-a2ae-6144df3dc659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:45.731943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c348e2f8-7a5b-48d9-a2ae-6144df3dc659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:45.732369 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c348e2f8-7a5b-48d9-a2ae-6144df3dc659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:45.733049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c348e2f8-7a5b-48d9-a2ae-6144df3dc659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:45.733485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c348e2f8-7a5b-48d9-a2ae-6144df3dc659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:45.733894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c348e2f8-7a5b-48d9-a2ae-6144df3dc659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:45.764623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c348e2f8-7a5b-48d9-a2ae-6144df3dc659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045863 Sep 13 20:09:45.765499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 593/1073] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:46.326894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0456c56c-0099-4d77-aaab-28a8f77e2527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:46.328508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0456c56c-0099-4d77-aaab-28a8f77e2527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:46.335340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0456c56c-0099-4d77-aaab-28a8f77e2527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:46.335887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0456c56c-0099-4d77-aaab-28a8f77e2527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:46.336310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0456c56c-0099-4d77-aaab-28a8f77e2527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:46.336992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0456c56c-0099-4d77-aaab-28a8f77e2527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:46.337431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0456c56c-0099-4d77-aaab-28a8f77e2527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:46.337838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0456c56c-0099-4d77-aaab-28a8f77e2527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:46.367991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0456c56c-0099-4d77-aaab-28a8f77e2527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046273 Sep 13 20:09:46.375906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 481/1074] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:46 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:46.409874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4c4c1fc5-9770-4682-8ff7-6fbe9f149cb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:46.410792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4c4c1fc5-9770-4682-8ff7-6fbe9f149cb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:46.417606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c4c1fc5-9770-4682-8ff7-6fbe9f149cb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:46.418062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c4c1fc5-9770-4682-8ff7-6fbe9f149cb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:46.418531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c4c1fc5-9770-4682-8ff7-6fbe9f149cb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:46.419226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c4c1fc5-9770-4682-8ff7-6fbe9f149cb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:46.419676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c4c1fc5-9770-4682-8ff7-6fbe9f149cb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:46.420097 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c4c1fc5-9770-4682-8ff7-6fbe9f149cb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:46.581231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4c4c1fc5-9770-4682-8ff7-6fbe9f149cb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:46.592209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4c4c1fc5-9770-4682-8ff7-6fbe9f149cb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.186289 Sep 13 20:09:46.592783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 594/1075] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:46 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:46.779652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1c48c50c-8128-4737-8db1-8fead2f42896 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:46.781841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1c48c50c-8128-4737-8db1-8fead2f42896 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:46.788301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c48c50c-8128-4737-8db1-8fead2f42896 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:46.788779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c48c50c-8128-4737-8db1-8fead2f42896 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:46.789224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c48c50c-8128-4737-8db1-8fead2f42896 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:46.789926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c48c50c-8128-4737-8db1-8fead2f42896 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:46.790404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c48c50c-8128-4737-8db1-8fead2f42896 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:46.790833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c48c50c-8128-4737-8db1-8fead2f42896 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:46.820946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1c48c50c-8128-4737-8db1-8fead2f42896 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046349 Sep 13 20:09:46.821501 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 482/1076] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:47.385494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1fada7d5-6ccf-4863-ab6b-046c6e85c30f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:47.389025 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1fada7d5-6ccf-4863-ab6b-046c6e85c30f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:47.399305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fada7d5-6ccf-4863-ab6b-046c6e85c30f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:47.400132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fada7d5-6ccf-4863-ab6b-046c6e85c30f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:47.400860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fada7d5-6ccf-4863-ab6b-046c6e85c30f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:47.401999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fada7d5-6ccf-4863-ab6b-046c6e85c30f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:47.402799 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fada7d5-6ccf-4863-ab6b-046c6e85c30f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:47.403413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fada7d5-6ccf-4863-ab6b-046c6e85c30f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:47.442493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1fada7d5-6ccf-4863-ab6b-046c6e85c30f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063931 Sep 13 20:09:47.443106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 595/1077] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:47 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:47.616246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c6e5b830-84d1-409e-85de-f08ea37b2ef2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:47.616834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c6e5b830-84d1-409e-85de-f08ea37b2ef2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:47.625368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c6e5b830-84d1-409e-85de-f08ea37b2ef2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:47.625890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c6e5b830-84d1-409e-85de-f08ea37b2ef2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:47.626325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c6e5b830-84d1-409e-85de-f08ea37b2ef2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:47.627085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c6e5b830-84d1-409e-85de-f08ea37b2ef2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:47.627540 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c6e5b830-84d1-409e-85de-f08ea37b2ef2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:47.627965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c6e5b830-84d1-409e-85de-f08ea37b2ef2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:47.763909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c6e5b830-84d1-409e-85de-f08ea37b2ef2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:47.772902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c6e5b830-84d1-409e-85de-f08ea37b2ef2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160991 Sep 13 20:09:47.773479 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 483/1078] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:47 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:47.834829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8105a2d3-7983-44c2-ba05-27cc9d2f660b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:47.837024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8105a2d3-7983-44c2-ba05-27cc9d2f660b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:47.843509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8105a2d3-7983-44c2-ba05-27cc9d2f660b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:47.843987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8105a2d3-7983-44c2-ba05-27cc9d2f660b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:47.844410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8105a2d3-7983-44c2-ba05-27cc9d2f660b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:47.845090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8105a2d3-7983-44c2-ba05-27cc9d2f660b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:47.845528 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8105a2d3-7983-44c2-ba05-27cc9d2f660b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:47.845945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8105a2d3-7983-44c2-ba05-27cc9d2f660b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:47.886238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8105a2d3-7983-44c2-ba05-27cc9d2f660b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055134 Sep 13 20:09:47.886936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 596/1079] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:47 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:48.456980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-82cb26aa-1825-4cd5-af4f-4dcdc5bb064e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:48.459167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-82cb26aa-1825-4cd5-af4f-4dcdc5bb064e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:48.466216 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82cb26aa-1825-4cd5-af4f-4dcdc5bb064e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:48.466787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82cb26aa-1825-4cd5-af4f-4dcdc5bb064e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:48.467286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82cb26aa-1825-4cd5-af4f-4dcdc5bb064e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:48.468081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82cb26aa-1825-4cd5-af4f-4dcdc5bb064e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:48.468538 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82cb26aa-1825-4cd5-af4f-4dcdc5bb064e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:48.469013 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82cb26aa-1825-4cd5-af4f-4dcdc5bb064e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:48.500564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-82cb26aa-1825-4cd5-af4f-4dcdc5bb064e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048730 Sep 13 20:09:48.501144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 484/1080] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:48 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:48.796418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-73ec51b8-2d86-41de-b8fe-5b108eba5131 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:48.797026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-73ec51b8-2d86-41de-b8fe-5b108eba5131 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:48.804598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73ec51b8-2d86-41de-b8fe-5b108eba5131 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:48.805080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73ec51b8-2d86-41de-b8fe-5b108eba5131 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:48.805499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73ec51b8-2d86-41de-b8fe-5b108eba5131 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:48.806218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73ec51b8-2d86-41de-b8fe-5b108eba5131 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:48.806691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73ec51b8-2d86-41de-b8fe-5b108eba5131 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:48.807100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73ec51b8-2d86-41de-b8fe-5b108eba5131 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:48.898841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-af4b239c-314b-41f9-9103-44a16f23bc01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:48.901227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-af4b239c-314b-41f9-9103-44a16f23bc01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:48.908287 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af4b239c-314b-41f9-9103-44a16f23bc01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:48.908773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af4b239c-314b-41f9-9103-44a16f23bc01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:48.909208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af4b239c-314b-41f9-9103-44a16f23bc01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:48.909925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af4b239c-314b-41f9-9103-44a16f23bc01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:48.910389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af4b239c-314b-41f9-9103-44a16f23bc01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:48.910827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af4b239c-314b-41f9-9103-44a16f23bc01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:48.940744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-73ec51b8-2d86-41de-b8fe-5b108eba5131 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:48.942738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-af4b239c-314b-41f9-9103-44a16f23bc01 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047878 Sep 13 20:09:48.943633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 485/1081] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:48 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:48.949166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-73ec51b8-2d86-41de-b8fe-5b108eba5131 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156977 Sep 13 20:09:48.949722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 597/1082] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:48 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:49.515618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dc2a2d67-774d-497b-aa5b-694bfaba96e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:49.518419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dc2a2d67-774d-497b-aa5b-694bfaba96e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:49.526955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc2a2d67-774d-497b-aa5b-694bfaba96e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:49.527601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc2a2d67-774d-497b-aa5b-694bfaba96e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:49.528180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc2a2d67-774d-497b-aa5b-694bfaba96e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:49.529105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc2a2d67-774d-497b-aa5b-694bfaba96e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:49.529688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc2a2d67-774d-497b-aa5b-694bfaba96e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:49.530322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc2a2d67-774d-497b-aa5b-694bfaba96e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:49.562831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dc2a2d67-774d-497b-aa5b-694bfaba96e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052641 Sep 13 20:09:49.563608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 486/1083] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:49 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:49.957873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-65bb0b57-6559-4503-a298-b4024cffbfc2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:49.960223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-65bb0b57-6559-4503-a298-b4024cffbfc2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:49.967805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-65bb0b57-6559-4503-a298-b4024cffbfc2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:49.968427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-65bb0b57-6559-4503-a298-b4024cffbfc2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:49.968898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-65bb0b57-6559-4503-a298-b4024cffbfc2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:49.969663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-65bb0b57-6559-4503-a298-b4024cffbfc2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:49.970134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-65bb0b57-6559-4503-a298-b4024cffbfc2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:49.970639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-65bb0b57-6559-4503-a298-b4024cffbfc2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:49.974037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b142b3fd-48ba-4036-984b-822883d7ae90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:49.974743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b142b3fd-48ba-4036-984b-822883d7ae90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:49.982118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b142b3fd-48ba-4036-984b-822883d7ae90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:49.982697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b142b3fd-48ba-4036-984b-822883d7ae90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:49.983255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b142b3fd-48ba-4036-984b-822883d7ae90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:49.983979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b142b3fd-48ba-4036-984b-822883d7ae90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:49.984434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b142b3fd-48ba-4036-984b-822883d7ae90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:49.984862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b142b3fd-48ba-4036-984b-822883d7ae90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:50.002477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-65bb0b57-6559-4503-a298-b4024cffbfc2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049227 Sep 13 20:09:50.007355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 598/1084] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:50.138252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b142b3fd-48ba-4036-984b-822883d7ae90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:50.147014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b142b3fd-48ba-4036-984b-822883d7ae90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.177315 Sep 13 20:09:50.147586 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 487/1085] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:49 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:50.575679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4413914e-3bea-4bb2-9216-1d0bef476c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:50.578301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4413914e-3bea-4bb2-9216-1d0bef476c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:50.580219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:50.585853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4413914e-3bea-4bb2-9216-1d0bef476c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:50.586308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4413914e-3bea-4bb2-9216-1d0bef476c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:50.586796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4413914e-3bea-4bb2-9216-1d0bef476c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:50.587478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4413914e-3bea-4bb2-9216-1d0bef476c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:50.588251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4413914e-3bea-4bb2-9216-1d0bef476c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:50.588434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4413914e-3bea-4bb2-9216-1d0bef476c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:50.619488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4413914e-3bea-4bb2-9216-1d0bef476c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047924 Sep 13 20:09:50.620051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 599/1086] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:50 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:51.015671 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0049b857-34a5-45c8-af15-12bcab40db28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:51.017803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0049b857-34a5-45c8-af15-12bcab40db28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:51.020184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=82 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:51.026349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0049b857-34a5-45c8-af15-12bcab40db28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:51.026858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0049b857-34a5-45c8-af15-12bcab40db28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:51.027293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0049b857-34a5-45c8-af15-12bcab40db28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:51.027970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0049b857-34a5-45c8-af15-12bcab40db28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:51.028436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0049b857-34a5-45c8-af15-12bcab40db28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:51.028860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0049b857-34a5-45c8-af15-12bcab40db28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:51.061620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0049b857-34a5-45c8-af15-12bcab40db28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049917 Sep 13 20:09:51.062658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 488/1087] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:51.172956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5b038631-2228-4ae8-9d5b-35d5cf016949 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:51.173822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5b038631-2228-4ae8-9d5b-35d5cf016949 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:51.182988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b038631-2228-4ae8-9d5b-35d5cf016949 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:51.183655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b038631-2228-4ae8-9d5b-35d5cf016949 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:51.184280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b038631-2228-4ae8-9d5b-35d5cf016949 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:51.185282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b038631-2228-4ae8-9d5b-35d5cf016949 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:51.185937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b038631-2228-4ae8-9d5b-35d5cf016949 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:51.186624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b038631-2228-4ae8-9d5b-35d5cf016949 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:51.337834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5b038631-2228-4ae8-9d5b-35d5cf016949 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:51.346655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5b038631-2228-4ae8-9d5b-35d5cf016949 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.178966 Sep 13 20:09:51.347241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 600/1088] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:51 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:51.632341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-472d8d86-b371-4278-b6d3-25a0b2a63b21 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:51.635673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-472d8d86-b371-4278-b6d3-25a0b2a63b21 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:51.643817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-472d8d86-b371-4278-b6d3-25a0b2a63b21 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:51.644304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-472d8d86-b371-4278-b6d3-25a0b2a63b21 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:51.644741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-472d8d86-b371-4278-b6d3-25a0b2a63b21 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:51.645434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-472d8d86-b371-4278-b6d3-25a0b2a63b21 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:51.645915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-472d8d86-b371-4278-b6d3-25a0b2a63b21 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:51.646343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-472d8d86-b371-4278-b6d3-25a0b2a63b21 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:51.678460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-472d8d86-b371-4278-b6d3-25a0b2a63b21 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050153 Sep 13 20:09:51.679039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 489/1089] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:51 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:52.075271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f8ebae74-b3ce-4d04-90b8-6dd094d20e1f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:52.077826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f8ebae74-b3ce-4d04-90b8-6dd094d20e1f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:52.084298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8ebae74-b3ce-4d04-90b8-6dd094d20e1f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:52.084781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8ebae74-b3ce-4d04-90b8-6dd094d20e1f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:52.085207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8ebae74-b3ce-4d04-90b8-6dd094d20e1f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:52.085965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8ebae74-b3ce-4d04-90b8-6dd094d20e1f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:52.086406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8ebae74-b3ce-4d04-90b8-6dd094d20e1f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:52.086872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8ebae74-b3ce-4d04-90b8-6dd094d20e1f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:52.117100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f8ebae74-b3ce-4d04-90b8-6dd094d20e1f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045958 Sep 13 20:09:52.117663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 601/1090] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:52.372231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-58a1b170-e3b7-4b5a-84de-56080d0984a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:52.372797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-58a1b170-e3b7-4b5a-84de-56080d0984a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:52.379873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58a1b170-e3b7-4b5a-84de-56080d0984a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:52.380360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58a1b170-e3b7-4b5a-84de-56080d0984a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:52.380784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58a1b170-e3b7-4b5a-84de-56080d0984a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:52.381483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58a1b170-e3b7-4b5a-84de-56080d0984a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:52.381929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58a1b170-e3b7-4b5a-84de-56080d0984a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:52.382347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58a1b170-e3b7-4b5a-84de-56080d0984a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:52.523716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-58a1b170-e3b7-4b5a-84de-56080d0984a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:52.532667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-58a1b170-e3b7-4b5a-84de-56080d0984a7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164438 Sep 13 20:09:52.533292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 490/1091] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:52 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:52.692642 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-711b5620-959a-4a3a-a980-a1af82c91514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:52.694782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-711b5620-959a-4a3a-a980-a1af82c91514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:52.701760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-711b5620-959a-4a3a-a980-a1af82c91514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:52.702649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-711b5620-959a-4a3a-a980-a1af82c91514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:52.703172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-711b5620-959a-4a3a-a980-a1af82c91514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:52.703903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-711b5620-959a-4a3a-a980-a1af82c91514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:52.704336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-711b5620-959a-4a3a-a980-a1af82c91514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:52.704773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-711b5620-959a-4a3a-a980-a1af82c91514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:52.739992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-711b5620-959a-4a3a-a980-a1af82c91514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051432 Sep 13 20:09:52.740760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 602/1092] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:52 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:53.131218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7c0a78a1-4b91-49dc-860a-c3cc4c126fc6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:53.133391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7c0a78a1-4b91-49dc-860a-c3cc4c126fc6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:53.139991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7c0a78a1-4b91-49dc-860a-c3cc4c126fc6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:53.140503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7c0a78a1-4b91-49dc-860a-c3cc4c126fc6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:53.140949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7c0a78a1-4b91-49dc-860a-c3cc4c126fc6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:53.141644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7c0a78a1-4b91-49dc-860a-c3cc4c126fc6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:53.142092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7c0a78a1-4b91-49dc-860a-c3cc4c126fc6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:53.142557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7c0a78a1-4b91-49dc-860a-c3cc4c126fc6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:53.178722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7c0a78a1-4b91-49dc-860a-c3cc4c126fc6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051897 Sep 13 20:09:53.179280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 491/1093] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:53 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:53.558852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a816b7ee-4cf3-4211-9b91-64de4114cc3c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:53.559744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a816b7ee-4cf3-4211-9b91-64de4114cc3c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:53.567438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a816b7ee-4cf3-4211-9b91-64de4114cc3c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:53.567924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a816b7ee-4cf3-4211-9b91-64de4114cc3c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:53.568355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a816b7ee-4cf3-4211-9b91-64de4114cc3c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:53.569057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a816b7ee-4cf3-4211-9b91-64de4114cc3c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:53.569576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a816b7ee-4cf3-4211-9b91-64de4114cc3c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:53.569921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a816b7ee-4cf3-4211-9b91-64de4114cc3c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:53.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a816b7ee-4cf3-4211-9b91-64de4114cc3c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:53.713166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a816b7ee-4cf3-4211-9b91-64de4114cc3c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.159918 Sep 13 20:09:53.713734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 603/1094] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:53 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:53.753116 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bab88988-9929-4267-a055-1f308c8d57e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:53.756082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bab88988-9929-4267-a055-1f308c8d57e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:53.762894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bab88988-9929-4267-a055-1f308c8d57e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:53.763433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bab88988-9929-4267-a055-1f308c8d57e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:53.763891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bab88988-9929-4267-a055-1f308c8d57e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:53.764616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bab88988-9929-4267-a055-1f308c8d57e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:53.765059 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bab88988-9929-4267-a055-1f308c8d57e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:53.765485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bab88988-9929-4267-a055-1f308c8d57e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:53.800893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bab88988-9929-4267-a055-1f308c8d57e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051828 Sep 13 20:09:53.805857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 492/1095] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:53 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:54.197356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-835636bc-8866-4c73-8fff-68f3b7c6351f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:54.200009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-835636bc-8866-4c73-8fff-68f3b7c6351f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:54.208812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-835636bc-8866-4c73-8fff-68f3b7c6351f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:54.209522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-835636bc-8866-4c73-8fff-68f3b7c6351f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:54.210204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-835636bc-8866-4c73-8fff-68f3b7c6351f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:54.211202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-835636bc-8866-4c73-8fff-68f3b7c6351f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:54.211757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-835636bc-8866-4c73-8fff-68f3b7c6351f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:54.212382 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-835636bc-8866-4c73-8fff-68f3b7c6351f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:54.216122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:54.247373 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-835636bc-8866-4c73-8fff-68f3b7c6351f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056283 Sep 13 20:09:54.247914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 604/1096] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:54 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:54.743934 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f87cbcea-e697-4713-976d-7143514339f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:54.744541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f87cbcea-e697-4713-976d-7143514339f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:54.750927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f87cbcea-e697-4713-976d-7143514339f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:54.751408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f87cbcea-e697-4713-976d-7143514339f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:54.751839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f87cbcea-e697-4713-976d-7143514339f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:54.752527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f87cbcea-e697-4713-976d-7143514339f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:54.753139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f87cbcea-e697-4713-976d-7143514339f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:54.753562 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f87cbcea-e697-4713-976d-7143514339f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:54.813789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4dfe3350-dd6d-452c-9b1e-5d05f7ec8a0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:54.816174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4dfe3350-dd6d-452c-9b1e-5d05f7ec8a0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:54.823333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dfe3350-dd6d-452c-9b1e-5d05f7ec8a0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:54.823730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dfe3350-dd6d-452c-9b1e-5d05f7ec8a0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:54.824153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dfe3350-dd6d-452c-9b1e-5d05f7ec8a0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:54.824822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dfe3350-dd6d-452c-9b1e-5d05f7ec8a0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:54.825294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dfe3350-dd6d-452c-9b1e-5d05f7ec8a0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:54.825709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dfe3350-dd6d-452c-9b1e-5d05f7ec8a0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:54.857961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4dfe3350-dd6d-452c-9b1e-5d05f7ec8a0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048439 Sep 13 20:09:54.859327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 605/1097] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:54 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:54.891085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f87cbcea-e697-4713-976d-7143514339f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:54.904072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:54.904072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f87cbcea-e697-4713-976d-7143514339f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161002 Sep 13 20:09:54.904072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 493/1098] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:54 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:55.262848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bc131b80-d72a-4d55-a94e-a2ba128d43c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:55.265023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bc131b80-d72a-4d55-a94e-a2ba128d43c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:55.271798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc131b80-d72a-4d55-a94e-a2ba128d43c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:55.272281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc131b80-d72a-4d55-a94e-a2ba128d43c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:55.272710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc131b80-d72a-4d55-a94e-a2ba128d43c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:55.273434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc131b80-d72a-4d55-a94e-a2ba128d43c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:55.273882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc131b80-d72a-4d55-a94e-a2ba128d43c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:55.274285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bc131b80-d72a-4d55-a94e-a2ba128d43c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:55.306379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bc131b80-d72a-4d55-a94e-a2ba128d43c7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047656 Sep 13 20:09:55.306972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 606/1099] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:55.872465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ee3cf98f-1649-41ee-83ad-045e119c8fd0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:55.874579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ee3cf98f-1649-41ee-83ad-045e119c8fd0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:55.881672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee3cf98f-1649-41ee-83ad-045e119c8fd0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:55.882153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee3cf98f-1649-41ee-83ad-045e119c8fd0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:55.882630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee3cf98f-1649-41ee-83ad-045e119c8fd0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:55.883320 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee3cf98f-1649-41ee-83ad-045e119c8fd0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:55.883760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee3cf98f-1649-41ee-83ad-045e119c8fd0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:55.884179 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee3cf98f-1649-41ee-83ad-045e119c8fd0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:55.914217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ee3cf98f-1649-41ee-83ad-045e119c8fd0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045896 Sep 13 20:09:55.914943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 494/1100] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:55 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:55.925113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c43832c4-4a67-42f3-9d0c-bbfcff889f89 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:55.925742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c43832c4-4a67-42f3-9d0c-bbfcff889f89 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:55.932144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c43832c4-4a67-42f3-9d0c-bbfcff889f89 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:55.932628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c43832c4-4a67-42f3-9d0c-bbfcff889f89 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:55.933027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c43832c4-4a67-42f3-9d0c-bbfcff889f89 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:55.933715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c43832c4-4a67-42f3-9d0c-bbfcff889f89 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:55.934152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c43832c4-4a67-42f3-9d0c-bbfcff889f89 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:55.934588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c43832c4-4a67-42f3-9d0c-bbfcff889f89 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:56.073806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c43832c4-4a67-42f3-9d0c-bbfcff889f89 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:56.085204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c43832c4-4a67-42f3-9d0c-bbfcff889f89 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164070 Sep 13 20:09:56.085779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 607/1101] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:55 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:56.321551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-558e3a24-e395-4fc2-be0f-1472921c5153 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:56.324535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-558e3a24-e395-4fc2-be0f-1472921c5153 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:56.334432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-558e3a24-e395-4fc2-be0f-1472921c5153 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:56.335104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-558e3a24-e395-4fc2-be0f-1472921c5153 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:56.335703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-558e3a24-e395-4fc2-be0f-1472921c5153 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:56.336626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-558e3a24-e395-4fc2-be0f-1472921c5153 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:56.337222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-558e3a24-e395-4fc2-be0f-1472921c5153 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:56.337781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-558e3a24-e395-4fc2-be0f-1472921c5153 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:56.371321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-558e3a24-e395-4fc2-be0f-1472921c5153 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055269 Sep 13 20:09:56.371867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 495/1102] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:57.078412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d99b38c6-cb5c-4cae-aa5b-489e2e623bb1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:57.080682 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d99b38c6-cb5c-4cae-aa5b-489e2e623bb1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:57.087013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d99b38c6-cb5c-4cae-aa5b-489e2e623bb1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:57.087488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d99b38c6-cb5c-4cae-aa5b-489e2e623bb1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:57.087918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d99b38c6-cb5c-4cae-aa5b-489e2e623bb1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:57.088609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d99b38c6-cb5c-4cae-aa5b-489e2e623bb1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:57.089056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d99b38c6-cb5c-4cae-aa5b-489e2e623bb1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:57.089474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d99b38c6-cb5c-4cae-aa5b-489e2e623bb1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:57.112968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b7031f28-93c3-481d-910d-3e35c4490477 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:57.113528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b7031f28-93c3-481d-910d-3e35c4490477 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:57.119557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d99b38c6-cb5c-4cae-aa5b-489e2e623bb1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195751 Sep 13 20:09:57.120156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 608/1103] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:56 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:57.120592 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b7031f28-93c3-481d-910d-3e35c4490477 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:57.121085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b7031f28-93c3-481d-910d-3e35c4490477 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:57.121518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b7031f28-93c3-481d-910d-3e35c4490477 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:57.122219 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b7031f28-93c3-481d-910d-3e35c4490477 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:57.122708 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b7031f28-93c3-481d-910d-3e35c4490477 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:57.123135 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b7031f28-93c3-481d-910d-3e35c4490477 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:57.265459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b7031f28-93c3-481d-910d-3e35c4490477 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:57.275514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b7031f28-93c3-481d-910d-3e35c4490477 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166428 Sep 13 20:09:57.276086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 496/1104] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:57 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:57.388352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a53fe9f5-bae8-417f-ac71-43b768632521 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:57.391774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a53fe9f5-bae8-417f-ac71-43b768632521 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:57.403747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a53fe9f5-bae8-417f-ac71-43b768632521 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:57.404237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a53fe9f5-bae8-417f-ac71-43b768632521 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:57.404667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a53fe9f5-bae8-417f-ac71-43b768632521 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:57.405372 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a53fe9f5-bae8-417f-ac71-43b768632521 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:57.405823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a53fe9f5-bae8-417f-ac71-43b768632521 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:57.406244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a53fe9f5-bae8-417f-ac71-43b768632521 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:57.439283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a53fe9f5-bae8-417f-ac71-43b768632521 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057767 Sep 13 20:09:57.440350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 609/1105] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:58.134750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ba25098e-96d6-4ad7-84bd-cb00339cef6b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:58.136877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ba25098e-96d6-4ad7-84bd-cb00339cef6b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:58.147774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba25098e-96d6-4ad7-84bd-cb00339cef6b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:58.148290 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba25098e-96d6-4ad7-84bd-cb00339cef6b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:58.148726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba25098e-96d6-4ad7-84bd-cb00339cef6b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:58.149398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba25098e-96d6-4ad7-84bd-cb00339cef6b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:58.149848 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba25098e-96d6-4ad7-84bd-cb00339cef6b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:58.150327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba25098e-96d6-4ad7-84bd-cb00339cef6b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:58.180462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ba25098e-96d6-4ad7-84bd-cb00339cef6b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051940 Sep 13 20:09:58.181008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 497/1106] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:58 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:58.299347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-67812587-f066-4d94-beb4-73371f48cd29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:58.300076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-67812587-f066-4d94-beb4-73371f48cd29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:58.307664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67812587-f066-4d94-beb4-73371f48cd29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:58.308229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67812587-f066-4d94-beb4-73371f48cd29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:58.308710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67812587-f066-4d94-beb4-73371f48cd29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:58.309629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67812587-f066-4d94-beb4-73371f48cd29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:58.310266 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67812587-f066-4d94-beb4-73371f48cd29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:58.310710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67812587-f066-4d94-beb4-73371f48cd29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:58.449564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-67812587-f066-4d94-beb4-73371f48cd29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:58.452953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-10ac1c7c-b273-49d3-b2d9-4aca4f59f24a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:58.455277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-10ac1c7c-b273-49d3-b2d9-4aca4f59f24a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:58.459135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-67812587-f066-4d94-beb4-73371f48cd29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163781 Sep 13 20:09:58.459899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 610/1107] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:58 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:09:58.461947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10ac1c7c-b273-49d3-b2d9-4aca4f59f24a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:58.462465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10ac1c7c-b273-49d3-b2d9-4aca4f59f24a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:58.462932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10ac1c7c-b273-49d3-b2d9-4aca4f59f24a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:58.463762 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10ac1c7c-b273-49d3-b2d9-4aca4f59f24a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:58.464253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10ac1c7c-b273-49d3-b2d9-4aca4f59f24a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:58.464669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-10ac1c7c-b273-49d3-b2d9-4aca4f59f24a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:58.494743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-10ac1c7c-b273-49d3-b2d9-4aca4f59f24a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046157 Sep 13 20:09:58.495317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 498/1108] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:59.194102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-16dbcf51-b275-43b8-8021-f901901fed74 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:59.196404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-16dbcf51-b275-43b8-8021-f901901fed74 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:59.204070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16dbcf51-b275-43b8-8021-f901901fed74 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:59.204562 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16dbcf51-b275-43b8-8021-f901901fed74 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:59.205026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16dbcf51-b275-43b8-8021-f901901fed74 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:59.205714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16dbcf51-b275-43b8-8021-f901901fed74 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:59.206206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16dbcf51-b275-43b8-8021-f901901fed74 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:59.206672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16dbcf51-b275-43b8-8021-f901901fed74 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:59.236719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-16dbcf51-b275-43b8-8021-f901901fed74 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046833 Sep 13 20:09:59.237289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 611/1109] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:09:59 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:09:59.484480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a75d1ebf-433f-482c-9e9e-8939cdd2d150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:59.485073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a75d1ebf-433f-482c-9e9e-8939cdd2d150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:59.496616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a75d1ebf-433f-482c-9e9e-8939cdd2d150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:59.497105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a75d1ebf-433f-482c-9e9e-8939cdd2d150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:59.497545 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a75d1ebf-433f-482c-9e9e-8939cdd2d150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:59.498251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a75d1ebf-433f-482c-9e9e-8939cdd2d150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:59.498748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a75d1ebf-433f-482c-9e9e-8939cdd2d150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:59.499171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a75d1ebf-433f-482c-9e9e-8939cdd2d150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:59.507755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-75f7ae3d-0008-4117-a717-4d8e9fc46cf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:59.509937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-75f7ae3d-0008-4117-a717-4d8e9fc46cf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:59.516819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75f7ae3d-0008-4117-a717-4d8e9fc46cf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:59.517303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75f7ae3d-0008-4117-a717-4d8e9fc46cf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:59.517731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75f7ae3d-0008-4117-a717-4d8e9fc46cf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:59.518463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75f7ae3d-0008-4117-a717-4d8e9fc46cf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:59.519013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75f7ae3d-0008-4117-a717-4d8e9fc46cf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:59.519432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75f7ae3d-0008-4117-a717-4d8e9fc46cf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:59.551327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-75f7ae3d-0008-4117-a717-4d8e9fc46cf9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047490 Sep 13 20:09:59.551898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 612/1110] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:09:59 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:09:59.638868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a75d1ebf-433f-482c-9e9e-8939cdd2d150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:59.647574 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a75d1ebf-433f-482c-9e9e-8939cdd2d150 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167206 Sep 13 20:09:59.648130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 499/1111] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:59 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:00.248995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-33eef6fe-5c88-4230-9efe-770b8d717490 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:00.251887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-33eef6fe-5c88-4230-9efe-770b8d717490 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:00.258641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33eef6fe-5c88-4230-9efe-770b8d717490 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:00.259123 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33eef6fe-5c88-4230-9efe-770b8d717490 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:00.259551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33eef6fe-5c88-4230-9efe-770b8d717490 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:00.260245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33eef6fe-5c88-4230-9efe-770b8d717490 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:00.260691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33eef6fe-5c88-4230-9efe-770b8d717490 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:00.261104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33eef6fe-5c88-4230-9efe-770b8d717490 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:00.291037 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-33eef6fe-5c88-4230-9efe-770b8d717490 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045948 Sep 13 20:10:00.291583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 613/1112] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:00 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:00.564317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-05618440-0fbd-4ede-b5c1-ea72b6aee1e3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:00.566519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-05618440-0fbd-4ede-b5c1-ea72b6aee1e3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:00.573452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05618440-0fbd-4ede-b5c1-ea72b6aee1e3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:00.573942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05618440-0fbd-4ede-b5c1-ea72b6aee1e3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:00.574391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05618440-0fbd-4ede-b5c1-ea72b6aee1e3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:00.575087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05618440-0fbd-4ede-b5c1-ea72b6aee1e3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:00.575529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05618440-0fbd-4ede-b5c1-ea72b6aee1e3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:00.575946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05618440-0fbd-4ede-b5c1-ea72b6aee1e3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:00.606738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-05618440-0fbd-4ede-b5c1-ea72b6aee1e3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046392 Sep 13 20:10:00.607307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 500/1113] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:10:00 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:10:00.671213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-318c714c-cad9-4a23-a9b7-5a105ece7e9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:00.671859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-318c714c-cad9-4a23-a9b7-5a105ece7e9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:00.678720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-318c714c-cad9-4a23-a9b7-5a105ece7e9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:00.679195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-318c714c-cad9-4a23-a9b7-5a105ece7e9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:00.679620 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-318c714c-cad9-4a23-a9b7-5a105ece7e9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:00.680297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-318c714c-cad9-4a23-a9b7-5a105ece7e9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:00.680734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-318c714c-cad9-4a23-a9b7-5a105ece7e9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:00.681148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-318c714c-cad9-4a23-a9b7-5a105ece7e9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:00.820845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-318c714c-cad9-4a23-a9b7-5a105ece7e9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:00.829914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-318c714c-cad9-4a23-a9b7-5a105ece7e9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162902 Sep 13 20:10:00.830475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 614/1114] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:00 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:01.303844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2d8b36ed-0223-4787-a326-f07e0f9e27c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:01.306065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2d8b36ed-0223-4787-a326-f07e0f9e27c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:01.312441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2d8b36ed-0223-4787-a326-f07e0f9e27c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:01.312928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2d8b36ed-0223-4787-a326-f07e0f9e27c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:01.313322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2d8b36ed-0223-4787-a326-f07e0f9e27c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:01.314111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2d8b36ed-0223-4787-a326-f07e0f9e27c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:01.314607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2d8b36ed-0223-4787-a326-f07e0f9e27c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:01.315112 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2d8b36ed-0223-4787-a326-f07e0f9e27c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:01.345679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2d8b36ed-0223-4787-a326-f07e0f9e27c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045866 Sep 13 20:10:01.346227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 501/1115] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:01.619779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b9a95d23-d582-4bc4-bbc1-e3bf1c4b6447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:01.622034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b9a95d23-d582-4bc4-bbc1-e3bf1c4b6447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:01.628555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9a95d23-d582-4bc4-bbc1-e3bf1c4b6447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:01.629044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9a95d23-d582-4bc4-bbc1-e3bf1c4b6447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:01.629475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9a95d23-d582-4bc4-bbc1-e3bf1c4b6447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:01.630169 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9a95d23-d582-4bc4-bbc1-e3bf1c4b6447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:01.630657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9a95d23-d582-4bc4-bbc1-e3bf1c4b6447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:01.631078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9a95d23-d582-4bc4-bbc1-e3bf1c4b6447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:01.661128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b9a95d23-d582-4bc4-bbc1-e3bf1c4b6447 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045374 Sep 13 20:10:01.661683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 615/1116] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:10:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:10:01.853611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-73abdfb4-32c7-401e-b014-0315123b1188 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:01.854196 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-73abdfb4-32c7-401e-b014-0315123b1188 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:01.861063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73abdfb4-32c7-401e-b014-0315123b1188 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:01.861552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73abdfb4-32c7-401e-b014-0315123b1188 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:01.861987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73abdfb4-32c7-401e-b014-0315123b1188 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:01.862792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73abdfb4-32c7-401e-b014-0315123b1188 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:01.863250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73abdfb4-32c7-401e-b014-0315123b1188 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:01.863679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73abdfb4-32c7-401e-b014-0315123b1188 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:01.996757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-73abdfb4-32c7-401e-b014-0315123b1188 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:02.005242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-73abdfb4-32c7-401e-b014-0315123b1188 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155720 Sep 13 20:10:02.005814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 502/1117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:01 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:02.358391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ef9c3abf-49c8-4135-92be-9e77c078e78d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:02.360554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ef9c3abf-49c8-4135-92be-9e77c078e78d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:02.367302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef9c3abf-49c8-4135-92be-9e77c078e78d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:02.367631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef9c3abf-49c8-4135-92be-9e77c078e78d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:02.368032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef9c3abf-49c8-4135-92be-9e77c078e78d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:02.368713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef9c3abf-49c8-4135-92be-9e77c078e78d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:02.369151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef9c3abf-49c8-4135-92be-9e77c078e78d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:02.369556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef9c3abf-49c8-4135-92be-9e77c078e78d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:02.400336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ef9c3abf-49c8-4135-92be-9e77c078e78d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045834 Sep 13 20:10:02.400889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 616/1118] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:02 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:02.674030 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d06cbdaa-599d-4d0f-bb2b-e39c29989552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:02.676283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d06cbdaa-599d-4d0f-bb2b-e39c29989552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:02.682697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06cbdaa-599d-4d0f-bb2b-e39c29989552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:02.683196 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06cbdaa-599d-4d0f-bb2b-e39c29989552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:02.683614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06cbdaa-599d-4d0f-bb2b-e39c29989552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:02.684311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06cbdaa-599d-4d0f-bb2b-e39c29989552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:02.684750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06cbdaa-599d-4d0f-bb2b-e39c29989552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:02.685163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06cbdaa-599d-4d0f-bb2b-e39c29989552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:02.716412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d06cbdaa-599d-4d0f-bb2b-e39c29989552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046300 Sep 13 20:10:02.717072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 503/1119] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:10:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:10:03.031531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4dda26c3-bd48-4447-90cd-764596849431 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:03.032403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4dda26c3-bd48-4447-90cd-764596849431 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:03.040255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dda26c3-bd48-4447-90cd-764596849431 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:03.040751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dda26c3-bd48-4447-90cd-764596849431 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:03.041182 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dda26c3-bd48-4447-90cd-764596849431 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:03.041881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dda26c3-bd48-4447-90cd-764596849431 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:03.042330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dda26c3-bd48-4447-90cd-764596849431 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:03.042782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dda26c3-bd48-4447-90cd-764596849431 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:03.175261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4dda26c3-bd48-4447-90cd-764596849431 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:03.183621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4dda26c3-bd48-4447-90cd-764596849431 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158622 Sep 13 20:10:03.184165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 617/1120] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:03 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:03.413418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b4b6b64a-9cab-48fb-9f7c-08d90024022c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:03.415609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b4b6b64a-9cab-48fb-9f7c-08d90024022c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:03.422867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4b6b64a-9cab-48fb-9f7c-08d90024022c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:03.423351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4b6b64a-9cab-48fb-9f7c-08d90024022c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:03.423784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4b6b64a-9cab-48fb-9f7c-08d90024022c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:03.425875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4b6b64a-9cab-48fb-9f7c-08d90024022c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:03.425875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4b6b64a-9cab-48fb-9f7c-08d90024022c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:03.425875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4b6b64a-9cab-48fb-9f7c-08d90024022c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:03.456784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b4b6b64a-9cab-48fb-9f7c-08d90024022c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047631 Sep 13 20:10:03.457422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 504/1121] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:03 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:03.729669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6412ce4e-fbfa-4ded-9ebe-c8ebbd2cc4db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:03.731989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6412ce4e-fbfa-4ded-9ebe-c8ebbd2cc4db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:03.738645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6412ce4e-fbfa-4ded-9ebe-c8ebbd2cc4db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:03.739124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6412ce4e-fbfa-4ded-9ebe-c8ebbd2cc4db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:03.739551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6412ce4e-fbfa-4ded-9ebe-c8ebbd2cc4db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:03.740241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6412ce4e-fbfa-4ded-9ebe-c8ebbd2cc4db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:03.740685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6412ce4e-fbfa-4ded-9ebe-c8ebbd2cc4db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:03.741100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6412ce4e-fbfa-4ded-9ebe-c8ebbd2cc4db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:03.771875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6412ce4e-fbfa-4ded-9ebe-c8ebbd2cc4db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046227 Sep 13 20:10:03.772432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 618/1122] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:10:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:10:04.209499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a5566fab-ed91-46f3-82c3-9cc9c7031468 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:04.209993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a5566fab-ed91-46f3-82c3-9cc9c7031468 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:04.216390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5566fab-ed91-46f3-82c3-9cc9c7031468 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:04.216871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5566fab-ed91-46f3-82c3-9cc9c7031468 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:04.217301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5566fab-ed91-46f3-82c3-9cc9c7031468 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:04.217994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5566fab-ed91-46f3-82c3-9cc9c7031468 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:04.218485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5566fab-ed91-46f3-82c3-9cc9c7031468 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:04.218909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5566fab-ed91-46f3-82c3-9cc9c7031468 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:04.364402 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a5566fab-ed91-46f3-82c3-9cc9c7031468 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:04.373066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a5566fab-ed91-46f3-82c3-9cc9c7031468 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168984 Sep 13 20:10:04.373636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 505/1123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:04 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:04.469409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e7ed5df6-51a2-41f7-910d-451c1c29ba93 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:04.471935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e7ed5df6-51a2-41f7-910d-451c1c29ba93 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:04.478812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7ed5df6-51a2-41f7-910d-451c1c29ba93 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:04.479306 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7ed5df6-51a2-41f7-910d-451c1c29ba93 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:04.479740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7ed5df6-51a2-41f7-910d-451c1c29ba93 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:04.480444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7ed5df6-51a2-41f7-910d-451c1c29ba93 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:04.480896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7ed5df6-51a2-41f7-910d-451c1c29ba93 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:04.481314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7ed5df6-51a2-41f7-910d-451c1c29ba93 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:04.512244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e7ed5df6-51a2-41f7-910d-451c1c29ba93 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046718 Sep 13 20:10:04.512881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 619/1124] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:04 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:04.786024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0a237f22-d378-42ae-99ff-5538160015af tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:04.788288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0a237f22-d378-42ae-99ff-5538160015af tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:04.795274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0a237f22-d378-42ae-99ff-5538160015af tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:04.795759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0a237f22-d378-42ae-99ff-5538160015af tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:04.796198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0a237f22-d378-42ae-99ff-5538160015af tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:04.796899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0a237f22-d378-42ae-99ff-5538160015af tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:04.797351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0a237f22-d378-42ae-99ff-5538160015af tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:04.797774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0a237f22-d378-42ae-99ff-5538160015af tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:04.828838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0a237f22-d378-42ae-99ff-5538160015af tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046637 Sep 13 20:10:04.829404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 506/1125] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:10:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:10:05.397743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-08a2690a-eb18-4dee-89b1-f39c8e74fa49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:05.398309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-08a2690a-eb18-4dee-89b1-f39c8e74fa49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:05.405392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08a2690a-eb18-4dee-89b1-f39c8e74fa49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:05.405866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08a2690a-eb18-4dee-89b1-f39c8e74fa49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:05.406306 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08a2690a-eb18-4dee-89b1-f39c8e74fa49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:05.407028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08a2690a-eb18-4dee-89b1-f39c8e74fa49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:05.407472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08a2690a-eb18-4dee-89b1-f39c8e74fa49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:05.407896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08a2690a-eb18-4dee-89b1-f39c8e74fa49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:05.528474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-63d3b412-fd6b-480c-b1d4-5e1ce8d7f391 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:05.529844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-63d3b412-fd6b-480c-b1d4-5e1ce8d7f391 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:05.536270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-63d3b412-fd6b-480c-b1d4-5e1ce8d7f391 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:05.536860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-63d3b412-fd6b-480c-b1d4-5e1ce8d7f391 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:05.537306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-63d3b412-fd6b-480c-b1d4-5e1ce8d7f391 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:05.538165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-63d3b412-fd6b-480c-b1d4-5e1ce8d7f391 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:05.538659 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-63d3b412-fd6b-480c-b1d4-5e1ce8d7f391 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:05.539219 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-63d3b412-fd6b-480c-b1d4-5e1ce8d7f391 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:05.548919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-08a2690a-eb18-4dee-89b1-f39c8e74fa49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:05.551315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:05.558942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-08a2690a-eb18-4dee-89b1-f39c8e74fa49 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165207 Sep 13 20:10:05.559887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 620/1126] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:05 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:05.574663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-63d3b412-fd6b-480c-b1d4-5e1ce8d7f391 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051909 Sep 13 20:10:05.575252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 507/1127] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:05 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:05.842349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2804a676-91b7-499f-b65a-34f8855d3b8a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:05.844468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2804a676-91b7-499f-b65a-34f8855d3b8a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:05.851574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2804a676-91b7-499f-b65a-34f8855d3b8a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:05.852064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2804a676-91b7-499f-b65a-34f8855d3b8a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:05.852494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2804a676-91b7-499f-b65a-34f8855d3b8a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:05.853204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2804a676-91b7-499f-b65a-34f8855d3b8a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:05.853660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2804a676-91b7-499f-b65a-34f8855d3b8a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:05.854080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2804a676-91b7-499f-b65a-34f8855d3b8a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:05.886101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2804a676-91b7-499f-b65a-34f8855d3b8a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048044 Sep 13 20:10:05.886766 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 621/1128] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 13 20:10:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:10:06.583979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-904b5225-934f-4bd5-9b7b-0ba0bd2dffbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:06.585134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-904b5225-934f-4bd5-9b7b-0ba0bd2dffbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:06.587907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a70360ba-d2de-44a1-8db9-0f22ca753a92 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:06.591021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a70360ba-d2de-44a1-8db9-0f22ca753a92 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:06.592279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-904b5225-934f-4bd5-9b7b-0ba0bd2dffbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:06.592705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-904b5225-934f-4bd5-9b7b-0ba0bd2dffbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:06.593139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-904b5225-934f-4bd5-9b7b-0ba0bd2dffbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:06.593830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-904b5225-934f-4bd5-9b7b-0ba0bd2dffbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:06.594290 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-904b5225-934f-4bd5-9b7b-0ba0bd2dffbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:06.594923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-904b5225-934f-4bd5-9b7b-0ba0bd2dffbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:06.598451 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a70360ba-d2de-44a1-8db9-0f22ca753a92 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:06.598812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a70360ba-d2de-44a1-8db9-0f22ca753a92 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:06.599412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a70360ba-d2de-44a1-8db9-0f22ca753a92 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:06.600123 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a70360ba-d2de-44a1-8db9-0f22ca753a92 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:06.600631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a70360ba-d2de-44a1-8db9-0f22ca753a92 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:06.601230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a70360ba-d2de-44a1-8db9-0f22ca753a92 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:06.634478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a70360ba-d2de-44a1-8db9-0f22ca753a92 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050549 Sep 13 20:10:06.635325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 622/1129] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:06.732931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-904b5225-934f-4bd5-9b7b-0ba0bd2dffbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:06.743493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-904b5225-934f-4bd5-9b7b-0ba0bd2dffbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163867 Sep 13 20:10:06.744607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 508/1130] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:06 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:06.902644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3b374208-d180-4fa4-8a8d-14b4337b6763 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:10:06.905564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3b374208-d180-4fa4-8a8d-14b4337b6763 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:06.912974 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b374208-d180-4fa4-8a8d-14b4337b6763 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:06.913527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b374208-d180-4fa4-8a8d-14b4337b6763 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:06.913938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b374208-d180-4fa4-8a8d-14b4337b6763 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:06.914702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b374208-d180-4fa4-8a8d-14b4337b6763 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:06.915152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b374208-d180-4fa4-8a8d-14b4337b6763 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:06.915574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b374208-d180-4fa4-8a8d-14b4337b6763 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:06.996989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3b374208-d180-4fa4-8a8d-14b4337b6763 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "POST /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/action" status: 200 len: 37858 microversion: 2.20 time: 0.100464 Sep 13 20:10:06.997632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 623/1131] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 13 20:10:06 2022] POST /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080/action => generated 37858 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:10:07.648901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3df5869b-564c-46db-b579-5a5d11aeefdb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:07.651920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3df5869b-564c-46db-b579-5a5d11aeefdb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:07.660763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3df5869b-564c-46db-b579-5a5d11aeefdb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:07.661267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3df5869b-564c-46db-b579-5a5d11aeefdb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:07.661703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3df5869b-564c-46db-b579-5a5d11aeefdb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:07.662418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3df5869b-564c-46db-b579-5a5d11aeefdb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:07.662893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3df5869b-564c-46db-b579-5a5d11aeefdb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:07.663401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3df5869b-564c-46db-b579-5a5d11aeefdb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:07.705789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3df5869b-564c-46db-b579-5a5d11aeefdb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062326 Sep 13 20:10:07.706351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 509/1132] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:07.772913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1446fe59-a458-4b3b-b9e1-cbb883188a59 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:07.773608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1446fe59-a458-4b3b-b9e1-cbb883188a59 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:07.781336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1446fe59-a458-4b3b-b9e1-cbb883188a59 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:07.781852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1446fe59-a458-4b3b-b9e1-cbb883188a59 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:07.782296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1446fe59-a458-4b3b-b9e1-cbb883188a59 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:07.783044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1446fe59-a458-4b3b-b9e1-cbb883188a59 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:07.783496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1446fe59-a458-4b3b-b9e1-cbb883188a59 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:07.783964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1446fe59-a458-4b3b-b9e1-cbb883188a59 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:07.923704 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1446fe59-a458-4b3b-b9e1-cbb883188a59 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:07.932822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1446fe59-a458-4b3b-b9e1-cbb883188a59 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164430 Sep 13 20:10:07.933441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 624/1133] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:07 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:08.719208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7cb6217f-b759-40d3-bde7-d11f9f758275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:08.721441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7cb6217f-b759-40d3-bde7-d11f9f758275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:08.728180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cb6217f-b759-40d3-bde7-d11f9f758275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:08.728677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cb6217f-b759-40d3-bde7-d11f9f758275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:08.729102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cb6217f-b759-40d3-bde7-d11f9f758275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:08.729891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cb6217f-b759-40d3-bde7-d11f9f758275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:08.730343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cb6217f-b759-40d3-bde7-d11f9f758275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:08.730805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cb6217f-b759-40d3-bde7-d11f9f758275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:08.751741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:08.763851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7cb6217f-b759-40d3-bde7-d11f9f758275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048595 Sep 13 20:10:08.764748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 510/1134] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:08.962847 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1606d502-f973-421a-8be9-970ac1ca7d97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:08.963513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1606d502-f973-421a-8be9-970ac1ca7d97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:08.970986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1606d502-f973-421a-8be9-970ac1ca7d97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:08.971474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1606d502-f973-421a-8be9-970ac1ca7d97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:08.971933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1606d502-f973-421a-8be9-970ac1ca7d97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:08.972985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1606d502-f973-421a-8be9-970ac1ca7d97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:08.973435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1606d502-f973-421a-8be9-970ac1ca7d97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:08.973854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1606d502-f973-421a-8be9-970ac1ca7d97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:09.110159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1606d502-f973-421a-8be9-970ac1ca7d97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:09.122831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1606d502-f973-421a-8be9-970ac1ca7d97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163608 Sep 13 20:10:09.123563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 625/1135] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:08 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:09.776819 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b27e10da-5efe-4b01-b97a-9e0d5c73f527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:09.779960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b27e10da-5efe-4b01-b97a-9e0d5c73f527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:09.787679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b27e10da-5efe-4b01-b97a-9e0d5c73f527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:09.787988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b27e10da-5efe-4b01-b97a-9e0d5c73f527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:09.788534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b27e10da-5efe-4b01-b97a-9e0d5c73f527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:09.789239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b27e10da-5efe-4b01-b97a-9e0d5c73f527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:09.789714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b27e10da-5efe-4b01-b97a-9e0d5c73f527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:09.790115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b27e10da-5efe-4b01-b97a-9e0d5c73f527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:09.821089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b27e10da-5efe-4b01-b97a-9e0d5c73f527 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048590 Sep 13 20:10:09.821810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 511/1136] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:10.150018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0508c60b-7893-4993-9f78-7f63180eeb65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:10.150614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0508c60b-7893-4993-9f78-7f63180eeb65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:10.157579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0508c60b-7893-4993-9f78-7f63180eeb65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:10.158063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0508c60b-7893-4993-9f78-7f63180eeb65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:10.158528 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0508c60b-7893-4993-9f78-7f63180eeb65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:10.159219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0508c60b-7893-4993-9f78-7f63180eeb65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:10.159665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0508c60b-7893-4993-9f78-7f63180eeb65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:10.160093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0508c60b-7893-4993-9f78-7f63180eeb65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:10.304114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0508c60b-7893-4993-9f78-7f63180eeb65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:10.313022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0508c60b-7893-4993-9f78-7f63180eeb65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168301 Sep 13 20:10:10.313592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 626/1137] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:10 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:10.833625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-25aa65f1-ffe1-40fb-8d21-2b10fc418235 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:10.835942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-25aa65f1-ffe1-40fb-8d21-2b10fc418235 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:10.842655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25aa65f1-ffe1-40fb-8d21-2b10fc418235 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:10.843147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25aa65f1-ffe1-40fb-8d21-2b10fc418235 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:10.843579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25aa65f1-ffe1-40fb-8d21-2b10fc418235 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:10.844277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25aa65f1-ffe1-40fb-8d21-2b10fc418235 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:10.844719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25aa65f1-ffe1-40fb-8d21-2b10fc418235 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:10.845150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25aa65f1-ffe1-40fb-8d21-2b10fc418235 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:10.898333 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-25aa65f1-ffe1-40fb-8d21-2b10fc418235 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068410 Sep 13 20:10:10.898990 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 512/1138] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:10 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:11.337388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e674b9c7-5137-49f3-b145-85af35463f09 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:11.337989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e674b9c7-5137-49f3-b145-85af35463f09 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:11.347000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e674b9c7-5137-49f3-b145-85af35463f09 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:11.347478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e674b9c7-5137-49f3-b145-85af35463f09 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:11.347908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e674b9c7-5137-49f3-b145-85af35463f09 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:11.348605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e674b9c7-5137-49f3-b145-85af35463f09 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:11.349050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e674b9c7-5137-49f3-b145-85af35463f09 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:11.349475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e674b9c7-5137-49f3-b145-85af35463f09 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:11.488113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e674b9c7-5137-49f3-b145-85af35463f09 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:11.496955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e674b9c7-5137-49f3-b145-85af35463f09 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163535 Sep 13 20:10:11.497447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 627/1139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:11 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:11.911194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9f925454-e7da-4122-a4b1-3e1a079661b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:11.913599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9f925454-e7da-4122-a4b1-3e1a079661b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:11.920390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f925454-e7da-4122-a4b1-3e1a079661b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:11.920869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f925454-e7da-4122-a4b1-3e1a079661b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:11.921293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f925454-e7da-4122-a4b1-3e1a079661b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:11.921979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f925454-e7da-4122-a4b1-3e1a079661b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:11.922477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f925454-e7da-4122-a4b1-3e1a079661b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:11.922887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f925454-e7da-4122-a4b1-3e1a079661b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:11.954910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9f925454-e7da-4122-a4b1-3e1a079661b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047606 Sep 13 20:10:11.955465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 513/1140] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:11 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:12.520553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a3469b99-f4a4-4411-b6e0-28cf4a9a2ef5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:12.521159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a3469b99-f4a4-4411-b6e0-28cf4a9a2ef5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:12.528312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3469b99-f4a4-4411-b6e0-28cf4a9a2ef5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:12.528798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3469b99-f4a4-4411-b6e0-28cf4a9a2ef5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:12.529250 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3469b99-f4a4-4411-b6e0-28cf4a9a2ef5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:12.529950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3469b99-f4a4-4411-b6e0-28cf4a9a2ef5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:12.530407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3469b99-f4a4-4411-b6e0-28cf4a9a2ef5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:12.530861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3469b99-f4a4-4411-b6e0-28cf4a9a2ef5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:12.672744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a3469b99-f4a4-4411-b6e0-28cf4a9a2ef5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:12.675281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:10:12.675498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:10:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c (ip 10.222.0.52) !!! Sep 13 20:10:12.684678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a3469b99-f4a4-4411-b6e0-28cf4a9a2ef5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168044 Sep 13 20:10:12.685250 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 628/1141] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:12 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:12.968852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e37e6e0c-922f-43ce-b0ff-df788c7ef93f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:12.972457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e37e6e0c-922f-43ce-b0ff-df788c7ef93f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:12.982685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e37e6e0c-922f-43ce-b0ff-df788c7ef93f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:12.983462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e37e6e0c-922f-43ce-b0ff-df788c7ef93f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:12.984180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e37e6e0c-922f-43ce-b0ff-df788c7ef93f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:12.985281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e37e6e0c-922f-43ce-b0ff-df788c7ef93f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:12.986040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e37e6e0c-922f-43ce-b0ff-df788c7ef93f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:12.986746 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e37e6e0c-922f-43ce-b0ff-df788c7ef93f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:13.023897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e37e6e0c-922f-43ce-b0ff-df788c7ef93f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060286 Sep 13 20:10:13.028920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 514/1142] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:12 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:13.712442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d6302788-7820-48c0-9adb-e668569eb23e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:13.713259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d6302788-7820-48c0-9adb-e668569eb23e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:13.720206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6302788-7820-48c0-9adb-e668569eb23e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:13.720682 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6302788-7820-48c0-9adb-e668569eb23e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:13.721099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6302788-7820-48c0-9adb-e668569eb23e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:13.721777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6302788-7820-48c0-9adb-e668569eb23e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:13.722210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6302788-7820-48c0-9adb-e668569eb23e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:13.722660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6302788-7820-48c0-9adb-e668569eb23e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:13.869836 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d6302788-7820-48c0-9adb-e668569eb23e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:13.878822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d6302788-7820-48c0-9adb-e668569eb23e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.171261 Sep 13 20:10:13.879393 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 629/1143] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:13 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:14.039067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c878e58e-7e49-4ed9-9cad-9330e7a48433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:14.042208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c878e58e-7e49-4ed9-9cad-9330e7a48433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:14.051517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c878e58e-7e49-4ed9-9cad-9330e7a48433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:14.052212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c878e58e-7e49-4ed9-9cad-9330e7a48433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:14.052839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c878e58e-7e49-4ed9-9cad-9330e7a48433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:14.053832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c878e58e-7e49-4ed9-9cad-9330e7a48433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:14.054588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c878e58e-7e49-4ed9-9cad-9330e7a48433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:14.055019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c878e58e-7e49-4ed9-9cad-9330e7a48433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:14.086701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c878e58e-7e49-4ed9-9cad-9330e7a48433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053386 Sep 13 20:10:14.087424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 515/1144] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:14 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:14.905870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-50105a19-b26f-46ab-9bf8-6d0388fe2dd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:14.906807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-50105a19-b26f-46ab-9bf8-6d0388fe2dd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:14.916664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50105a19-b26f-46ab-9bf8-6d0388fe2dd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:14.917145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50105a19-b26f-46ab-9bf8-6d0388fe2dd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:14.917602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50105a19-b26f-46ab-9bf8-6d0388fe2dd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:14.918352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50105a19-b26f-46ab-9bf8-6d0388fe2dd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:14.918815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50105a19-b26f-46ab-9bf8-6d0388fe2dd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:14.919235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50105a19-b26f-46ab-9bf8-6d0388fe2dd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:15.063878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-50105a19-b26f-46ab-9bf8-6d0388fe2dd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:15.072275 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-50105a19-b26f-46ab-9bf8-6d0388fe2dd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.172513 Sep 13 20:10:15.072817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 630/1145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:14 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:15.101714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a75a26f7-c5fc-4f81-a7f4-ea2348c01b05 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:15.104515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a75a26f7-c5fc-4f81-a7f4-ea2348c01b05 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:15.110856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a75a26f7-c5fc-4f81-a7f4-ea2348c01b05 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:15.111335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a75a26f7-c5fc-4f81-a7f4-ea2348c01b05 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:15.111772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a75a26f7-c5fc-4f81-a7f4-ea2348c01b05 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:15.112466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a75a26f7-c5fc-4f81-a7f4-ea2348c01b05 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:15.112916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a75a26f7-c5fc-4f81-a7f4-ea2348c01b05 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:15.113335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a75a26f7-c5fc-4f81-a7f4-ea2348c01b05 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:15.143709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a75a26f7-c5fc-4f81-a7f4-ea2348c01b05 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047721 Sep 13 20:10:15.144265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 516/1146] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:16.105194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-46f6e63d-6e37-49d3-8d13-f77b59ef5990 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:16.105827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-46f6e63d-6e37-49d3-8d13-f77b59ef5990 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:16.112932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46f6e63d-6e37-49d3-8d13-f77b59ef5990 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:16.113413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46f6e63d-6e37-49d3-8d13-f77b59ef5990 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:16.113838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46f6e63d-6e37-49d3-8d13-f77b59ef5990 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:16.114564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46f6e63d-6e37-49d3-8d13-f77b59ef5990 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:16.115006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46f6e63d-6e37-49d3-8d13-f77b59ef5990 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:16.115443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46f6e63d-6e37-49d3-8d13-f77b59ef5990 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:16.157533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-83533814-8d09-44ef-afba-056256602c29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:16.159766 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-83533814-8d09-44ef-afba-056256602c29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:16.166706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-83533814-8d09-44ef-afba-056256602c29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:16.167197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-83533814-8d09-44ef-afba-056256602c29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:16.167624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-83533814-8d09-44ef-afba-056256602c29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:16.168317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-83533814-8d09-44ef-afba-056256602c29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:16.168760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-83533814-8d09-44ef-afba-056256602c29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:16.169176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-83533814-8d09-44ef-afba-056256602c29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:16.202619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-83533814-8d09-44ef-afba-056256602c29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049433 Sep 13 20:10:16.203277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 517/1147] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:16 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:10:16.258300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-46f6e63d-6e37-49d3-8d13-f77b59ef5990 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:16.266914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-46f6e63d-6e37-49d3-8d13-f77b59ef5990 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165530 Sep 13 20:10:16.267484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 631/1148] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:16 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:17.216755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-052e5560-c928-491f-91cf-5a14313ff8c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:17.218933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-052e5560-c928-491f-91cf-5a14313ff8c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:17.225924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-052e5560-c928-491f-91cf-5a14313ff8c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:17.226406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-052e5560-c928-491f-91cf-5a14313ff8c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:17.226834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-052e5560-c928-491f-91cf-5a14313ff8c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:17.227507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-052e5560-c928-491f-91cf-5a14313ff8c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:17.227944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-052e5560-c928-491f-91cf-5a14313ff8c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:17.230016 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-052e5560-c928-491f-91cf-5a14313ff8c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:17.265634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-052e5560-c928-491f-91cf-5a14313ff8c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052915 Sep 13 20:10:17.266462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 518/1149] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:17 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:17.289032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b4875d4a-e10b-44c5-bd9c-6ea075078b76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:17.289715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b4875d4a-e10b-44c5-bd9c-6ea075078b76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:17.296531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4875d4a-e10b-44c5-bd9c-6ea075078b76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:17.297089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4875d4a-e10b-44c5-bd9c-6ea075078b76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:17.297749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4875d4a-e10b-44c5-bd9c-6ea075078b76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:17.298501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4875d4a-e10b-44c5-bd9c-6ea075078b76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:17.299137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4875d4a-e10b-44c5-bd9c-6ea075078b76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:17.299516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4875d4a-e10b-44c5-bd9c-6ea075078b76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:17.433352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b4875d4a-e10b-44c5-bd9c-6ea075078b76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:17.441753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b4875d4a-e10b-44c5-bd9c-6ea075078b76 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156565 Sep 13 20:10:17.442352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 632/1150] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:17 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:18.279814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8c566efb-3082-42e7-aa40-5d015e0bf9b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:18.283066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8c566efb-3082-42e7-aa40-5d015e0bf9b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:18.292926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c566efb-3082-42e7-aa40-5d015e0bf9b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:18.293673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c566efb-3082-42e7-aa40-5d015e0bf9b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:18.294718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c566efb-3082-42e7-aa40-5d015e0bf9b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:18.295357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c566efb-3082-42e7-aa40-5d015e0bf9b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:18.296072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c566efb-3082-42e7-aa40-5d015e0bf9b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:18.296751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c566efb-3082-42e7-aa40-5d015e0bf9b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:18.331305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8c566efb-3082-42e7-aa40-5d015e0bf9b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055850 Sep 13 20:10:18.331907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 519/1151] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:18.465738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f2e0ca0a-d124-4fde-85df-778bd4631d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:18.466432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f2e0ca0a-d124-4fde-85df-778bd4631d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:18.473355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2e0ca0a-d124-4fde-85df-778bd4631d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:18.473837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2e0ca0a-d124-4fde-85df-778bd4631d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:18.474271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2e0ca0a-d124-4fde-85df-778bd4631d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:18.475079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2e0ca0a-d124-4fde-85df-778bd4631d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:18.475539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2e0ca0a-d124-4fde-85df-778bd4631d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:18.475964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2e0ca0a-d124-4fde-85df-778bd4631d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:18.609325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f2e0ca0a-d124-4fde-85df-778bd4631d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:18.617864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f2e0ca0a-d124-4fde-85df-778bd4631d6b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156239 Sep 13 20:10:18.618430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 633/1152] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:18 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:19.346534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-40e08547-b8d8-4406-9d2b-50ba25a1135b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:19.349224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-40e08547-b8d8-4406-9d2b-50ba25a1135b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:19.357635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40e08547-b8d8-4406-9d2b-50ba25a1135b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:19.358117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40e08547-b8d8-4406-9d2b-50ba25a1135b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:19.358603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40e08547-b8d8-4406-9d2b-50ba25a1135b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:19.359301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40e08547-b8d8-4406-9d2b-50ba25a1135b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:19.359759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40e08547-b8d8-4406-9d2b-50ba25a1135b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:19.360183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40e08547-b8d8-4406-9d2b-50ba25a1135b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:19.391495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-40e08547-b8d8-4406-9d2b-50ba25a1135b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050154 Sep 13 20:10:19.392042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 520/1153] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:19.650298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ef5f8756-6e97-472a-83d7-0e8905c89e79 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:19.651316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ef5f8756-6e97-472a-83d7-0e8905c89e79 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:19.659046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef5f8756-6e97-472a-83d7-0e8905c89e79 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:19.659546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef5f8756-6e97-472a-83d7-0e8905c89e79 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:19.659971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef5f8756-6e97-472a-83d7-0e8905c89e79 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:19.660689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef5f8756-6e97-472a-83d7-0e8905c89e79 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:19.661173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef5f8756-6e97-472a-83d7-0e8905c89e79 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:19.661616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef5f8756-6e97-472a-83d7-0e8905c89e79 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:19.800983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ef5f8756-6e97-472a-83d7-0e8905c89e79 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:19.809564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ef5f8756-6e97-472a-83d7-0e8905c89e79 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166216 Sep 13 20:10:19.810153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 634/1154] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:19 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:10:20.406063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ca20309d-4900-4c7f-86d7-9edad44b0952 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:20.408255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ca20309d-4900-4c7f-86d7-9edad44b0952 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:20.415137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca20309d-4900-4c7f-86d7-9edad44b0952 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:20.415610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca20309d-4900-4c7f-86d7-9edad44b0952 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:20.416041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca20309d-4900-4c7f-86d7-9edad44b0952 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:20.416777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca20309d-4900-4c7f-86d7-9edad44b0952 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:20.417246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca20309d-4900-4c7f-86d7-9edad44b0952 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:20.417690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca20309d-4900-4c7f-86d7-9edad44b0952 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:20.450362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ca20309d-4900-4c7f-86d7-9edad44b0952 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048687 Sep 13 20:10:20.450956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 521/1155] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:20.835676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f0a161ee-bdd3-435b-b9e1-d3915c48e62d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:20.836376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f0a161ee-bdd3-435b-b9e1-d3915c48e62d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:20.839631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=72 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:20.845912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0a161ee-bdd3-435b-b9e1-d3915c48e62d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:20.846775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0a161ee-bdd3-435b-b9e1-d3915c48e62d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:20.847302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0a161ee-bdd3-435b-b9e1-d3915c48e62d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:20.848376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0a161ee-bdd3-435b-b9e1-d3915c48e62d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:20.849012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0a161ee-bdd3-435b-b9e1-d3915c48e62d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:20.849580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0a161ee-bdd3-435b-b9e1-d3915c48e62d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:20.985457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f0a161ee-bdd3-435b-b9e1-d3915c48e62d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:20.994510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f0a161ee-bdd3-435b-b9e1-d3915c48e62d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164343 Sep 13 20:10:20.995097 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 635/1156] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:20 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:21.463830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-585d44f0-2907-4087-ab4e-4f911fe3d1d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:21.466210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-585d44f0-2907-4087-ab4e-4f911fe3d1d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:21.468615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=68 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:21.473958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-585d44f0-2907-4087-ab4e-4f911fe3d1d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:21.474452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-585d44f0-2907-4087-ab4e-4f911fe3d1d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:21.474880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-585d44f0-2907-4087-ab4e-4f911fe3d1d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:21.475573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-585d44f0-2907-4087-ab4e-4f911fe3d1d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:21.476023 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-585d44f0-2907-4087-ab4e-4f911fe3d1d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:21.476414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-585d44f0-2907-4087-ab4e-4f911fe3d1d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:21.508297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-585d44f0-2907-4087-ab4e-4f911fe3d1d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048498 Sep 13 20:10:21.508896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 522/1157] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:21 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:22.017906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-243bdafd-a798-4fd1-9be8-064bd33a5202 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:22.018473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-243bdafd-a798-4fd1-9be8-064bd33a5202 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:22.025238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-243bdafd-a798-4fd1-9be8-064bd33a5202 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:22.025730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-243bdafd-a798-4fd1-9be8-064bd33a5202 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:22.026163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-243bdafd-a798-4fd1-9be8-064bd33a5202 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:22.026904 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-243bdafd-a798-4fd1-9be8-064bd33a5202 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:22.027429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-243bdafd-a798-4fd1-9be8-064bd33a5202 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:22.027856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-243bdafd-a798-4fd1-9be8-064bd33a5202 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:22.167121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-243bdafd-a798-4fd1-9be8-064bd33a5202 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:22.175753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-243bdafd-a798-4fd1-9be8-064bd33a5202 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161957 Sep 13 20:10:22.176315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 636/1158] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:22 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:22.521452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0b1e78b4-d67a-4a17-a6f7-9da7830abc2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:22.523634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0b1e78b4-d67a-4a17-a6f7-9da7830abc2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:22.530672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0b1e78b4-d67a-4a17-a6f7-9da7830abc2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:22.531158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0b1e78b4-d67a-4a17-a6f7-9da7830abc2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:22.531594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0b1e78b4-d67a-4a17-a6f7-9da7830abc2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:22.532294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0b1e78b4-d67a-4a17-a6f7-9da7830abc2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:22.532744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0b1e78b4-d67a-4a17-a6f7-9da7830abc2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:22.533167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0b1e78b4-d67a-4a17-a6f7-9da7830abc2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:22.565813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0b1e78b4-d67a-4a17-a6f7-9da7830abc2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048551 Sep 13 20:10:22.569269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 523/1159] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:23.199390 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-eeb67e3e-4c8d-47db-b79d-ccf171635d6f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:23.200407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-eeb67e3e-4c8d-47db-b79d-ccf171635d6f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:23.208023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eeb67e3e-4c8d-47db-b79d-ccf171635d6f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:23.208507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eeb67e3e-4c8d-47db-b79d-ccf171635d6f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:23.208957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eeb67e3e-4c8d-47db-b79d-ccf171635d6f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:23.209644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eeb67e3e-4c8d-47db-b79d-ccf171635d6f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:23.210085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eeb67e3e-4c8d-47db-b79d-ccf171635d6f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:23.210541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eeb67e3e-4c8d-47db-b79d-ccf171635d6f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:23.359929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-eeb67e3e-4c8d-47db-b79d-ccf171635d6f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:23.362185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:23.371782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-eeb67e3e-4c8d-47db-b79d-ccf171635d6f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.176458 Sep 13 20:10:23.372509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 637/1160] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:23 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:23.579820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-49acad1c-5361-47d4-98de-491f57587465 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:23.581991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-49acad1c-5361-47d4-98de-491f57587465 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:23.588892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49acad1c-5361-47d4-98de-491f57587465 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:23.589367 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49acad1c-5361-47d4-98de-491f57587465 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:23.589803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49acad1c-5361-47d4-98de-491f57587465 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:23.590538 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49acad1c-5361-47d4-98de-491f57587465 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:23.591044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49acad1c-5361-47d4-98de-491f57587465 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:23.591467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49acad1c-5361-47d4-98de-491f57587465 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:23.622899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-49acad1c-5361-47d4-98de-491f57587465 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047607 Sep 13 20:10:23.623457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 524/1161] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:24.396012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0b6bfcc1-5cfe-4dbb-867f-bb4ca4876a4a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:24.396566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0b6bfcc1-5cfe-4dbb-867f-bb4ca4876a4a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:24.403421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b6bfcc1-5cfe-4dbb-867f-bb4ca4876a4a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:24.404008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b6bfcc1-5cfe-4dbb-867f-bb4ca4876a4a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:24.404459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b6bfcc1-5cfe-4dbb-867f-bb4ca4876a4a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:24.405151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b6bfcc1-5cfe-4dbb-867f-bb4ca4876a4a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:24.405594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b6bfcc1-5cfe-4dbb-867f-bb4ca4876a4a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:24.406011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b6bfcc1-5cfe-4dbb-867f-bb4ca4876a4a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:24.559785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0b6bfcc1-5cfe-4dbb-867f-bb4ca4876a4a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:24.568835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0b6bfcc1-5cfe-4dbb-867f-bb4ca4876a4a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.177101 Sep 13 20:10:24.569417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 638/1162] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:24 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:24.635758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ff6b157c-0216-44d4-9164-648f00a11e2a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:24.638026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ff6b157c-0216-44d4-9164-648f00a11e2a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:24.644672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff6b157c-0216-44d4-9164-648f00a11e2a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:24.645164 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff6b157c-0216-44d4-9164-648f00a11e2a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:24.645581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff6b157c-0216-44d4-9164-648f00a11e2a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:24.646331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff6b157c-0216-44d4-9164-648f00a11e2a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:24.646737 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff6b157c-0216-44d4-9164-648f00a11e2a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:24.647159 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff6b157c-0216-44d4-9164-648f00a11e2a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:24.678441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ff6b157c-0216-44d4-9164-648f00a11e2a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046638 Sep 13 20:10:24.679029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 525/1163] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:24 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:25.595905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ddb7a01c-285f-49e8-a903-e5fa65f96e39 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:25.596531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ddb7a01c-285f-49e8-a903-e5fa65f96e39 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:25.603574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ddb7a01c-285f-49e8-a903-e5fa65f96e39 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:25.604079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ddb7a01c-285f-49e8-a903-e5fa65f96e39 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:25.604493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ddb7a01c-285f-49e8-a903-e5fa65f96e39 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:25.605186 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ddb7a01c-285f-49e8-a903-e5fa65f96e39 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:25.605644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ddb7a01c-285f-49e8-a903-e5fa65f96e39 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:25.606066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ddb7a01c-285f-49e8-a903-e5fa65f96e39 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:25.691729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a51e1cd1-11c9-4a44-b367-ebafbdfbcf46 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:25.694506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a51e1cd1-11c9-4a44-b367-ebafbdfbcf46 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:25.702210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a51e1cd1-11c9-4a44-b367-ebafbdfbcf46 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:25.702791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a51e1cd1-11c9-4a44-b367-ebafbdfbcf46 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:25.703222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a51e1cd1-11c9-4a44-b367-ebafbdfbcf46 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:25.703943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a51e1cd1-11c9-4a44-b367-ebafbdfbcf46 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:25.704378 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a51e1cd1-11c9-4a44-b367-ebafbdfbcf46 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:25.705168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a51e1cd1-11c9-4a44-b367-ebafbdfbcf46 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:25.741467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a51e1cd1-11c9-4a44-b367-ebafbdfbcf46 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053792 Sep 13 20:10:25.742077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 526/1164] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:25.756325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ddb7a01c-285f-49e8-a903-e5fa65f96e39 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:25.765383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ddb7a01c-285f-49e8-a903-e5fa65f96e39 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.174186 Sep 13 20:10:25.765957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 639/1165] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:25 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:10:26.754761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-67c0d563-8423-4619-ae81-bed333d3783d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:26.756898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-67c0d563-8423-4619-ae81-bed333d3783d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:26.763879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67c0d563-8423-4619-ae81-bed333d3783d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:26.764354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67c0d563-8423-4619-ae81-bed333d3783d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:26.764802 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67c0d563-8423-4619-ae81-bed333d3783d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:26.765501 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67c0d563-8423-4619-ae81-bed333d3783d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:26.765948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67c0d563-8423-4619-ae81-bed333d3783d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:26.766400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67c0d563-8423-4619-ae81-bed333d3783d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:26.768863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:26.795554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-eed6211d-ce4a-4a81-8d85-41066e30b70c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:26.796163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-eed6211d-ce4a-4a81-8d85-41066e30b70c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:26.797451 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-67c0d563-8423-4619-ae81-bed333d3783d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046850 Sep 13 20:10:26.798039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 527/1166] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:26.802776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eed6211d-ce4a-4a81-8d85-41066e30b70c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:26.803256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eed6211d-ce4a-4a81-8d85-41066e30b70c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:26.803653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eed6211d-ce4a-4a81-8d85-41066e30b70c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:26.804356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eed6211d-ce4a-4a81-8d85-41066e30b70c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:26.804803 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eed6211d-ce4a-4a81-8d85-41066e30b70c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:26.805212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eed6211d-ce4a-4a81-8d85-41066e30b70c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:26.936561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-eed6211d-ce4a-4a81-8d85-41066e30b70c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:26.945181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-eed6211d-ce4a-4a81-8d85-41066e30b70c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.153562 Sep 13 20:10:26.945792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 640/1167] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:26 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:27.810843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bc89eca1-2178-4962-b5d0-9c247de819cf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:27.813022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bc89eca1-2178-4962-b5d0-9c247de819cf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:27.819859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc89eca1-2178-4962-b5d0-9c247de819cf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:27.820342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc89eca1-2178-4962-b5d0-9c247de819cf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:27.820839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc89eca1-2178-4962-b5d0-9c247de819cf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:27.821471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc89eca1-2178-4962-b5d0-9c247de819cf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:27.821919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc89eca1-2178-4962-b5d0-9c247de819cf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:27.822345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc89eca1-2178-4962-b5d0-9c247de819cf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:27.857981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bc89eca1-2178-4962-b5d0-9c247de819cf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050982 Sep 13 20:10:27.858573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 528/1168] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:27 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:27.969524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b1a773fe-3f5f-4194-9c93-cdae0642666a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:27.970067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b1a773fe-3f5f-4194-9c93-cdae0642666a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:27.976616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1a773fe-3f5f-4194-9c93-cdae0642666a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:27.977091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1a773fe-3f5f-4194-9c93-cdae0642666a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:27.977517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1a773fe-3f5f-4194-9c93-cdae0642666a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:27.978199 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1a773fe-3f5f-4194-9c93-cdae0642666a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:27.978987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1a773fe-3f5f-4194-9c93-cdae0642666a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:27.979402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1a773fe-3f5f-4194-9c93-cdae0642666a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:28.116090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b1a773fe-3f5f-4194-9c93-cdae0642666a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:28.124814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b1a773fe-3f5f-4194-9c93-cdae0642666a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.159412 Sep 13 20:10:28.125391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 641/1169] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:27 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:28.872687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6de6fed5-8f62-45a0-a190-c212c9a9c305 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:28.874918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6de6fed5-8f62-45a0-a190-c212c9a9c305 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:28.883031 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6de6fed5-8f62-45a0-a190-c212c9a9c305 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:28.883751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6de6fed5-8f62-45a0-a190-c212c9a9c305 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:28.884352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6de6fed5-8f62-45a0-a190-c212c9a9c305 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:28.885454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6de6fed5-8f62-45a0-a190-c212c9a9c305 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:28.886203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6de6fed5-8f62-45a0-a190-c212c9a9c305 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:28.886911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6de6fed5-8f62-45a0-a190-c212c9a9c305 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:28.924617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6de6fed5-8f62-45a0-a190-c212c9a9c305 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055949 Sep 13 20:10:28.925165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 529/1170] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:29.150608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3e25883b-9bb7-4491-8cdf-6d6040ee49a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:29.151423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3e25883b-9bb7-4491-8cdf-6d6040ee49a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:29.161170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e25883b-9bb7-4491-8cdf-6d6040ee49a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:29.161678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e25883b-9bb7-4491-8cdf-6d6040ee49a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:29.162101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e25883b-9bb7-4491-8cdf-6d6040ee49a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:29.162843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e25883b-9bb7-4491-8cdf-6d6040ee49a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:29.163283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e25883b-9bb7-4491-8cdf-6d6040ee49a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:29.163700 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3e25883b-9bb7-4491-8cdf-6d6040ee49a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:29.300556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3e25883b-9bb7-4491-8cdf-6d6040ee49a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:29.313340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3e25883b-9bb7-4491-8cdf-6d6040ee49a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168030 Sep 13 20:10:29.314133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 642/1171] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:29 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:29.938517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-38065d8d-478b-430b-a558-370ddb8eb498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:29.940662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-38065d8d-478b-430b-a558-370ddb8eb498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:29.947443 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-38065d8d-478b-430b-a558-370ddb8eb498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:29.947924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-38065d8d-478b-430b-a558-370ddb8eb498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:29.948366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-38065d8d-478b-430b-a558-370ddb8eb498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:29.949052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-38065d8d-478b-430b-a558-370ddb8eb498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:29.949499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-38065d8d-478b-430b-a558-370ddb8eb498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:29.949918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-38065d8d-478b-430b-a558-370ddb8eb498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:29.982529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-38065d8d-478b-430b-a558-370ddb8eb498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048134 Sep 13 20:10:29.983136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 530/1172] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:30.344076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dc136105-74c5-4d30-a764-133d6adf50c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:30.344729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dc136105-74c5-4d30-a764-133d6adf50c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:30.351800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dc136105-74c5-4d30-a764-133d6adf50c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:30.352285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dc136105-74c5-4d30-a764-133d6adf50c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:30.352748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dc136105-74c5-4d30-a764-133d6adf50c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:30.353454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dc136105-74c5-4d30-a764-133d6adf50c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:30.353909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dc136105-74c5-4d30-a764-133d6adf50c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:30.354354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dc136105-74c5-4d30-a764-133d6adf50c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:30.510631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dc136105-74c5-4d30-a764-133d6adf50c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:30.519293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dc136105-74c5-4d30-a764-133d6adf50c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.180233 Sep 13 20:10:30.519860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 643/1173] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:30 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:30.995102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b1fa1715-f3cd-4c85-9ef9-6f73cdfb1026 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:30.997257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b1fa1715-f3cd-4c85-9ef9-6f73cdfb1026 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:31.004382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1fa1715-f3cd-4c85-9ef9-6f73cdfb1026 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:31.004875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1fa1715-f3cd-4c85-9ef9-6f73cdfb1026 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:31.005310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1fa1715-f3cd-4c85-9ef9-6f73cdfb1026 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:31.006002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1fa1715-f3cd-4c85-9ef9-6f73cdfb1026 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:31.006492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1fa1715-f3cd-4c85-9ef9-6f73cdfb1026 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:31.006912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b1fa1715-f3cd-4c85-9ef9-6f73cdfb1026 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:31.037947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b1fa1715-f3cd-4c85-9ef9-6f73cdfb1026 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046900 Sep 13 20:10:31.038551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 531/1174] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:30 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:31.542969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9489ebb5-597d-420b-9962-c70531c37c82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:31.543637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9489ebb5-597d-420b-9962-c70531c37c82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:31.550260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9489ebb5-597d-420b-9962-c70531c37c82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:31.550864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9489ebb5-597d-420b-9962-c70531c37c82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:31.551356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9489ebb5-597d-420b-9962-c70531c37c82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:31.552151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9489ebb5-597d-420b-9962-c70531c37c82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:31.552578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9489ebb5-597d-420b-9962-c70531c37c82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:31.553059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9489ebb5-597d-420b-9962-c70531c37c82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:31.691213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9489ebb5-597d-420b-9962-c70531c37c82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:31.699862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9489ebb5-597d-420b-9962-c70531c37c82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160842 Sep 13 20:10:31.700403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 644/1175] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:31 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:32.052719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-12308a29-1003-49b8-9116-4f0ecf12af17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:32.055445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-12308a29-1003-49b8-9116-4f0ecf12af17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:32.063975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12308a29-1003-49b8-9116-4f0ecf12af17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:32.064579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12308a29-1003-49b8-9116-4f0ecf12af17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:32.065128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12308a29-1003-49b8-9116-4f0ecf12af17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:32.066031 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12308a29-1003-49b8-9116-4f0ecf12af17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:32.066646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12308a29-1003-49b8-9116-4f0ecf12af17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:32.067185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12308a29-1003-49b8-9116-4f0ecf12af17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:32.099997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-12308a29-1003-49b8-9116-4f0ecf12af17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052299 Sep 13 20:10:32.100561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 532/1176] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:32 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:32.730346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f062b09a-8bd2-4251-aca5-b8cc3439eba8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:32.730975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f062b09a-8bd2-4251-aca5-b8cc3439eba8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:32.738403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f062b09a-8bd2-4251-aca5-b8cc3439eba8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:32.738903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f062b09a-8bd2-4251-aca5-b8cc3439eba8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:32.739311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f062b09a-8bd2-4251-aca5-b8cc3439eba8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:32.740042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f062b09a-8bd2-4251-aca5-b8cc3439eba8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:32.740487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f062b09a-8bd2-4251-aca5-b8cc3439eba8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:32.740905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f062b09a-8bd2-4251-aca5-b8cc3439eba8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:32.884040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f062b09a-8bd2-4251-aca5-b8cc3439eba8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:32.894203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f062b09a-8bd2-4251-aca5-b8cc3439eba8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167817 Sep 13 20:10:32.894793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 645/1177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:32 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:33.112551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5848ceb5-c675-4be6-a784-c3ed63827695 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:33.114669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5848ceb5-c675-4be6-a784-c3ed63827695 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:33.121534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5848ceb5-c675-4be6-a784-c3ed63827695 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:33.122022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5848ceb5-c675-4be6-a784-c3ed63827695 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:33.122458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5848ceb5-c675-4be6-a784-c3ed63827695 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:33.123164 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5848ceb5-c675-4be6-a784-c3ed63827695 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:33.123609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5848ceb5-c675-4be6-a784-c3ed63827695 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:33.124031 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5848ceb5-c675-4be6-a784-c3ed63827695 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:33.154201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5848ceb5-c675-4be6-a784-c3ed63827695 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045746 Sep 13 20:10:33.154794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 533/1178] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:33 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:33.919606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e0d043bd-de56-45c9-95fa-143ecfb10223 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:33.920292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e0d043bd-de56-45c9-95fa-143ecfb10223 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:33.932744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0d043bd-de56-45c9-95fa-143ecfb10223 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:33.933417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0d043bd-de56-45c9-95fa-143ecfb10223 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:33.934051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0d043bd-de56-45c9-95fa-143ecfb10223 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:33.935105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0d043bd-de56-45c9-95fa-143ecfb10223 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:33.935722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0d043bd-de56-45c9-95fa-143ecfb10223 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:33.936314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0d043bd-de56-45c9-95fa-143ecfb10223 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:34.082806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e0d043bd-de56-45c9-95fa-143ecfb10223 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:34.091433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e0d043bd-de56-45c9-95fa-143ecfb10223 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.176931 Sep 13 20:10:34.092026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 646/1179] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:33 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:34.170049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-88516bc0-6894-4752-ad06-0b947a4c9a90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:34.172633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-88516bc0-6894-4752-ad06-0b947a4c9a90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:34.179841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88516bc0-6894-4752-ad06-0b947a4c9a90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:34.180328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88516bc0-6894-4752-ad06-0b947a4c9a90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:34.180765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88516bc0-6894-4752-ad06-0b947a4c9a90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:34.181463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88516bc0-6894-4752-ad06-0b947a4c9a90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:34.181890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88516bc0-6894-4752-ad06-0b947a4c9a90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:34.182314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88516bc0-6894-4752-ad06-0b947a4c9a90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:34.213279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-88516bc0-6894-4752-ad06-0b947a4c9a90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049684 Sep 13 20:10:34.213834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 534/1180] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:34 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:35.116840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-42c604ab-82c5-4ca0-9270-0d80b17c3923 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:35.117491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-42c604ab-82c5-4ca0-9270-0d80b17c3923 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:35.125902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42c604ab-82c5-4ca0-9270-0d80b17c3923 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:35.126524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42c604ab-82c5-4ca0-9270-0d80b17c3923 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:35.127034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42c604ab-82c5-4ca0-9270-0d80b17c3923 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:35.127807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42c604ab-82c5-4ca0-9270-0d80b17c3923 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:35.128330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42c604ab-82c5-4ca0-9270-0d80b17c3923 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:35.128809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42c604ab-82c5-4ca0-9270-0d80b17c3923 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:35.225550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-993316b1-7951-4a33-a054-92668bc32cff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:35.227842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-993316b1-7951-4a33-a054-92668bc32cff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:35.234876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-993316b1-7951-4a33-a054-92668bc32cff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:35.235366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-993316b1-7951-4a33-a054-92668bc32cff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:35.235800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-993316b1-7951-4a33-a054-92668bc32cff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:35.236507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-993316b1-7951-4a33-a054-92668bc32cff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:35.236957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-993316b1-7951-4a33-a054-92668bc32cff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:35.237376 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-993316b1-7951-4a33-a054-92668bc32cff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:35.269408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-993316b1-7951-4a33-a054-92668bc32cff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047918 Sep 13 20:10:35.270303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 535/1181] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:35 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:35.273875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-42c604ab-82c5-4ca0-9270-0d80b17c3923 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:35.282920 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-42c604ab-82c5-4ca0-9270-0d80b17c3923 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.170316 Sep 13 20:10:35.284911 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 647/1182] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:35 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:36.282550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8df14a2e-3af1-47af-9df3-01aa3d90e14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:36.284731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8df14a2e-3af1-47af-9df3-01aa3d90e14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:36.291494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8df14a2e-3af1-47af-9df3-01aa3d90e14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:36.291981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8df14a2e-3af1-47af-9df3-01aa3d90e14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:36.292394 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8df14a2e-3af1-47af-9df3-01aa3d90e14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:36.293078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8df14a2e-3af1-47af-9df3-01aa3d90e14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:36.293524 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8df14a2e-3af1-47af-9df3-01aa3d90e14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:36.293946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8df14a2e-3af1-47af-9df3-01aa3d90e14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:36.305916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c91915f8-154a-458a-90bd-628ba1dad097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:36.306571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c91915f8-154a-458a-90bd-628ba1dad097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:36.313363 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c91915f8-154a-458a-90bd-628ba1dad097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:36.313864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c91915f8-154a-458a-90bd-628ba1dad097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:36.314277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c91915f8-154a-458a-90bd-628ba1dad097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:36.315023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c91915f8-154a-458a-90bd-628ba1dad097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:36.315468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c91915f8-154a-458a-90bd-628ba1dad097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:36.315863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c91915f8-154a-458a-90bd-628ba1dad097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:36.324789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8df14a2e-3af1-47af-9df3-01aa3d90e14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046372 Sep 13 20:10:36.326362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 536/1183] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:36 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:36.462247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c91915f8-154a-458a-90bd-628ba1dad097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:36.470649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c91915f8-154a-458a-90bd-628ba1dad097 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168795 Sep 13 20:10:36.471207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 648/1184] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:36 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:37.337892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-40f842e7-bf0e-4d7b-a95d-45dfae93a9b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:37.340101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-40f842e7-bf0e-4d7b-a95d-45dfae93a9b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:37.347173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40f842e7-bf0e-4d7b-a95d-45dfae93a9b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:37.347671 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40f842e7-bf0e-4d7b-a95d-45dfae93a9b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:37.348097 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40f842e7-bf0e-4d7b-a95d-45dfae93a9b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:37.348799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40f842e7-bf0e-4d7b-a95d-45dfae93a9b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:37.349248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40f842e7-bf0e-4d7b-a95d-45dfae93a9b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:37.349678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-40f842e7-bf0e-4d7b-a95d-45dfae93a9b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:37.381064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-40f842e7-bf0e-4d7b-a95d-45dfae93a9b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047252 Sep 13 20:10:37.381626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 537/1185] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:37 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:37.493112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1188e7ca-7ec9-4cf8-817f-ad7709bce958 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:37.493753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1188e7ca-7ec9-4cf8-817f-ad7709bce958 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:37.500602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1188e7ca-7ec9-4cf8-817f-ad7709bce958 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:37.501086 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1188e7ca-7ec9-4cf8-817f-ad7709bce958 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:37.501479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1188e7ca-7ec9-4cf8-817f-ad7709bce958 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:37.502404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1188e7ca-7ec9-4cf8-817f-ad7709bce958 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:37.502841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1188e7ca-7ec9-4cf8-817f-ad7709bce958 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:37.503259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1188e7ca-7ec9-4cf8-817f-ad7709bce958 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:37.646224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1188e7ca-7ec9-4cf8-817f-ad7709bce958 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:37.655179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1188e7ca-7ec9-4cf8-817f-ad7709bce958 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166039 Sep 13 20:10:37.655801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 649/1186] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:37 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:38.397155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6346a622-792f-4de8-a8d7-d37dee85eaf1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:38.400014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6346a622-792f-4de8-a8d7-d37dee85eaf1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:38.409291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6346a622-792f-4de8-a8d7-d37dee85eaf1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:38.409771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6346a622-792f-4de8-a8d7-d37dee85eaf1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:38.410200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6346a622-792f-4de8-a8d7-d37dee85eaf1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:38.410924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6346a622-792f-4de8-a8d7-d37dee85eaf1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:38.411373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6346a622-792f-4de8-a8d7-d37dee85eaf1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:38.411791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6346a622-792f-4de8-a8d7-d37dee85eaf1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:38.441680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6346a622-792f-4de8-a8d7-d37dee85eaf1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050475 Sep 13 20:10:38.442236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 538/1187] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:38 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:38.687163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b6dbe398-0935-402d-abe1-19b1fcde88ae tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:38.687805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b6dbe398-0935-402d-abe1-19b1fcde88ae tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:38.695076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6dbe398-0935-402d-abe1-19b1fcde88ae tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:38.695636 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6dbe398-0935-402d-abe1-19b1fcde88ae tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:38.696068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6dbe398-0935-402d-abe1-19b1fcde88ae tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:38.696819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6dbe398-0935-402d-abe1-19b1fcde88ae tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:38.697291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6dbe398-0935-402d-abe1-19b1fcde88ae tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:38.697770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6dbe398-0935-402d-abe1-19b1fcde88ae tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:38.863284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b6dbe398-0935-402d-abe1-19b1fcde88ae tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:38.871940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b6dbe398-0935-402d-abe1-19b1fcde88ae tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.188966 Sep 13 20:10:38.872519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 650/1188] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:38 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:39.457301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fbf21e12-9a2b-4a34-b845-06bebe24c125 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:39.459434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fbf21e12-9a2b-4a34-b845-06bebe24c125 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:39.466106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbf21e12-9a2b-4a34-b845-06bebe24c125 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:39.466701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbf21e12-9a2b-4a34-b845-06bebe24c125 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:39.467140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbf21e12-9a2b-4a34-b845-06bebe24c125 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:39.467828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbf21e12-9a2b-4a34-b845-06bebe24c125 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:39.468273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbf21e12-9a2b-4a34-b845-06bebe24c125 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:39.468694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbf21e12-9a2b-4a34-b845-06bebe24c125 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:39.499686 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fbf21e12-9a2b-4a34-b845-06bebe24c125 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048591 Sep 13 20:10:39.500229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 539/1189] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:39 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:39.896475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cbedd6b9-ee7b-47f9-a04d-26c5959dd600 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:39.897174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cbedd6b9-ee7b-47f9-a04d-26c5959dd600 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:39.905136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbedd6b9-ee7b-47f9-a04d-26c5959dd600 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:39.905692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbedd6b9-ee7b-47f9-a04d-26c5959dd600 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:39.906196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbedd6b9-ee7b-47f9-a04d-26c5959dd600 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:39.907033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbedd6b9-ee7b-47f9-a04d-26c5959dd600 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:39.907574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbedd6b9-ee7b-47f9-a04d-26c5959dd600 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:39.908073 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cbedd6b9-ee7b-47f9-a04d-26c5959dd600 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:40.046814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cbedd6b9-ee7b-47f9-a04d-26c5959dd600 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:40.055625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cbedd6b9-ee7b-47f9-a04d-26c5959dd600 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163633 Sep 13 20:10:40.056221 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 651/1190] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:39 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:40.514580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d6d0f5a8-9d45-4b9b-98e3-7a1bf3c33523 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:40.516757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d6d0f5a8-9d45-4b9b-98e3-7a1bf3c33523 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:40.523672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d6d0f5a8-9d45-4b9b-98e3-7a1bf3c33523 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:40.524151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d6d0f5a8-9d45-4b9b-98e3-7a1bf3c33523 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:40.524584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d6d0f5a8-9d45-4b9b-98e3-7a1bf3c33523 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:40.525280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d6d0f5a8-9d45-4b9b-98e3-7a1bf3c33523 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:40.525719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d6d0f5a8-9d45-4b9b-98e3-7a1bf3c33523 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:40.526160 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d6d0f5a8-9d45-4b9b-98e3-7a1bf3c33523 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:40.556328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d6d0f5a8-9d45-4b9b-98e3-7a1bf3c33523 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 Sep 13 20:10:40.556880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 540/1191] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:40 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:41.084101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c9c53e5f-a08c-49f4-8052-d2090bd2be07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:41.084648 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c9c53e5f-a08c-49f4-8052-d2090bd2be07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:41.091535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9c53e5f-a08c-49f4-8052-d2090bd2be07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:41.092021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9c53e5f-a08c-49f4-8052-d2090bd2be07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:41.092453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9c53e5f-a08c-49f4-8052-d2090bd2be07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:41.093143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9c53e5f-a08c-49f4-8052-d2090bd2be07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:41.093622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9c53e5f-a08c-49f4-8052-d2090bd2be07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:41.094042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9c53e5f-a08c-49f4-8052-d2090bd2be07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:41.230697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c9c53e5f-a08c-49f4-8052-d2090bd2be07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:41.241687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c9c53e5f-a08c-49f4-8052-d2090bd2be07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162588 Sep 13 20:10:41.242277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 652/1192] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:41 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:41.570222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-01473250-97cd-4bc5-aa93-828d01f1ac01 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:41.573075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-01473250-97cd-4bc5-aa93-828d01f1ac01 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:41.579569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01473250-97cd-4bc5-aa93-828d01f1ac01 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:41.580067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01473250-97cd-4bc5-aa93-828d01f1ac01 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:41.580494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01473250-97cd-4bc5-aa93-828d01f1ac01 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:41.581824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01473250-97cd-4bc5-aa93-828d01f1ac01 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:41.583071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01473250-97cd-4bc5-aa93-828d01f1ac01 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:41.583071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01473250-97cd-4bc5-aa93-828d01f1ac01 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:41.618056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-01473250-97cd-4bc5-aa93-828d01f1ac01 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052487 Sep 13 20:10:41.618673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 541/1193] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:41 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:42.265356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-25d865f7-e8cf-48ab-8d3c-9b8e2bf73592 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:42.265998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-25d865f7-e8cf-48ab-8d3c-9b8e2bf73592 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:42.273214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-25d865f7-e8cf-48ab-8d3c-9b8e2bf73592 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:42.273689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-25d865f7-e8cf-48ab-8d3c-9b8e2bf73592 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:42.274124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-25d865f7-e8cf-48ab-8d3c-9b8e2bf73592 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:42.274862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-25d865f7-e8cf-48ab-8d3c-9b8e2bf73592 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:42.275312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-25d865f7-e8cf-48ab-8d3c-9b8e2bf73592 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:42.275732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-25d865f7-e8cf-48ab-8d3c-9b8e2bf73592 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:42.411026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-25d865f7-e8cf-48ab-8d3c-9b8e2bf73592 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:42.424159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-25d865f7-e8cf-48ab-8d3c-9b8e2bf73592 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162440 Sep 13 20:10:42.424807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 653/1194] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:42 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:42.630614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d1e866b7-34f8-4a41-9daf-d7712308d19d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:42.632819 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d1e866b7-34f8-4a41-9daf-d7712308d19d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:42.639623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1e866b7-34f8-4a41-9daf-d7712308d19d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:42.640096 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1e866b7-34f8-4a41-9daf-d7712308d19d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:42.640527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1e866b7-34f8-4a41-9daf-d7712308d19d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:42.641227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1e866b7-34f8-4a41-9daf-d7712308d19d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:42.641672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1e866b7-34f8-4a41-9daf-d7712308d19d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:42.642309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1e866b7-34f8-4a41-9daf-d7712308d19d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:42.672663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d1e866b7-34f8-4a41-9daf-d7712308d19d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046082 Sep 13 20:10:42.673236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 542/1195] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:42 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:43.449062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a38e5f71-78f6-4535-a38d-0c1c41411b48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:43.449717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a38e5f71-78f6-4535-a38d-0c1c41411b48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:43.457638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a38e5f71-78f6-4535-a38d-0c1c41411b48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:43.458128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a38e5f71-78f6-4535-a38d-0c1c41411b48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:43.458589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a38e5f71-78f6-4535-a38d-0c1c41411b48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:43.459249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a38e5f71-78f6-4535-a38d-0c1c41411b48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:43.459728 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a38e5f71-78f6-4535-a38d-0c1c41411b48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:43.460147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a38e5f71-78f6-4535-a38d-0c1c41411b48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:43.482359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:43.603578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a38e5f71-78f6-4535-a38d-0c1c41411b48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:43.612090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a38e5f71-78f6-4535-a38d-0c1c41411b48 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167583 Sep 13 20:10:43.612655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 654/1196] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:43 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:43.685724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6c599691-3a26-43b6-9556-ea49fb34dd43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:43.687908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6c599691-3a26-43b6-9556-ea49fb34dd43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:43.694851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c599691-3a26-43b6-9556-ea49fb34dd43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:43.695332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c599691-3a26-43b6-9556-ea49fb34dd43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:43.695767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c599691-3a26-43b6-9556-ea49fb34dd43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:43.696469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c599691-3a26-43b6-9556-ea49fb34dd43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:43.696905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c599691-3a26-43b6-9556-ea49fb34dd43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:43.697326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c599691-3a26-43b6-9556-ea49fb34dd43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:43.724753 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:43.732341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6c599691-3a26-43b6-9556-ea49fb34dd43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050611 Sep 13 20:10:43.732975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 543/1197] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:43 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:44.641313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-113d6a45-4535-4f57-ad17-6ef9da1f6a63 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:44.642311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-113d6a45-4535-4f57-ad17-6ef9da1f6a63 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:44.649761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-113d6a45-4535-4f57-ad17-6ef9da1f6a63 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:44.650249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-113d6a45-4535-4f57-ad17-6ef9da1f6a63 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:44.650710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-113d6a45-4535-4f57-ad17-6ef9da1f6a63 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:44.651406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-113d6a45-4535-4f57-ad17-6ef9da1f6a63 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:44.651854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-113d6a45-4535-4f57-ad17-6ef9da1f6a63 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:44.652276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-113d6a45-4535-4f57-ad17-6ef9da1f6a63 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:44.747398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f6135d42-784a-4117-9756-f127d13268de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:44.750561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f6135d42-784a-4117-9756-f127d13268de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:44.760300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6135d42-784a-4117-9756-f127d13268de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:44.760936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6135d42-784a-4117-9756-f127d13268de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:44.761555 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6135d42-784a-4117-9756-f127d13268de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:44.762678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6135d42-784a-4117-9756-f127d13268de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:44.763348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6135d42-784a-4117-9756-f127d13268de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:44.763874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6135d42-784a-4117-9756-f127d13268de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:44.795969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f6135d42-784a-4117-9756-f127d13268de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054516 Sep 13 20:10:44.796554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 544/1198] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:44 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:10:44.803596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-113d6a45-4535-4f57-ad17-6ef9da1f6a63 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:44.812117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-113d6a45-4535-4f57-ad17-6ef9da1f6a63 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.177463 Sep 13 20:10:44.812688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 655/1199] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:44 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:45.812252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a99e1c3e-dfdb-4e3c-b762-631e194d5a56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:45.815139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a99e1c3e-dfdb-4e3c-b762-631e194d5a56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:45.822079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a99e1c3e-dfdb-4e3c-b762-631e194d5a56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:45.822610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a99e1c3e-dfdb-4e3c-b762-631e194d5a56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:45.823197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a99e1c3e-dfdb-4e3c-b762-631e194d5a56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:45.823755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a99e1c3e-dfdb-4e3c-b762-631e194d5a56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:45.824203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a99e1c3e-dfdb-4e3c-b762-631e194d5a56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:45.824627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a99e1c3e-dfdb-4e3c-b762-631e194d5a56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:45.836478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-622db074-58a7-4253-b700-f3c0e4591e10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:45.837098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-622db074-58a7-4253-b700-f3c0e4591e10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:45.843842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-622db074-58a7-4253-b700-f3c0e4591e10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:45.844316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-622db074-58a7-4253-b700-f3c0e4591e10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:45.844736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-622db074-58a7-4253-b700-f3c0e4591e10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:45.845422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-622db074-58a7-4253-b700-f3c0e4591e10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:45.845834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-622db074-58a7-4253-b700-f3c0e4591e10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:45.846253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-622db074-58a7-4253-b700-f3c0e4591e10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:45.856603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a99e1c3e-dfdb-4e3c-b762-631e194d5a56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050579 Sep 13 20:10:45.857176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 545/1200] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:45 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:45.982504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-622db074-58a7-4253-b700-f3c0e4591e10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:45.991267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-622db074-58a7-4253-b700-f3c0e4591e10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158834 Sep 13 20:10:45.991832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 656/1201] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:45 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:46.869585 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-eecf9486-5be5-40f8-b117-fd0bfd724be1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:46.871769 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-eecf9486-5be5-40f8-b117-fd0bfd724be1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:46.879003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eecf9486-5be5-40f8-b117-fd0bfd724be1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:46.879480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eecf9486-5be5-40f8-b117-fd0bfd724be1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:46.879901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eecf9486-5be5-40f8-b117-fd0bfd724be1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:46.880586 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eecf9486-5be5-40f8-b117-fd0bfd724be1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:46.881028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eecf9486-5be5-40f8-b117-fd0bfd724be1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:46.881433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eecf9486-5be5-40f8-b117-fd0bfd724be1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:46.922105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-eecf9486-5be5-40f8-b117-fd0bfd724be1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056232 Sep 13 20:10:46.923133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 546/1202] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:46 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:47.017866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c460d5b8-0839-48fc-933d-f61b5bdb74da tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:47.018715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c460d5b8-0839-48fc-933d-f61b5bdb74da tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:47.025682 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c460d5b8-0839-48fc-933d-f61b5bdb74da tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:47.026165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c460d5b8-0839-48fc-933d-f61b5bdb74da tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:47.026627 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c460d5b8-0839-48fc-933d-f61b5bdb74da tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:47.027301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c460d5b8-0839-48fc-933d-f61b5bdb74da tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:47.027746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c460d5b8-0839-48fc-933d-f61b5bdb74da tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:47.028161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c460d5b8-0839-48fc-933d-f61b5bdb74da tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:47.160655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c460d5b8-0839-48fc-933d-f61b5bdb74da tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:47.169649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c460d5b8-0839-48fc-933d-f61b5bdb74da tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.157679 Sep 13 20:10:47.170201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 657/1203] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:47 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:47.937626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fa8994f3-9f8e-4ca7-a6e7-21a5c2b9ea75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:47.941020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fa8994f3-9f8e-4ca7-a6e7-21a5c2b9ea75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:47.951041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa8994f3-9f8e-4ca7-a6e7-21a5c2b9ea75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:47.951711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa8994f3-9f8e-4ca7-a6e7-21a5c2b9ea75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:47.952392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa8994f3-9f8e-4ca7-a6e7-21a5c2b9ea75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:47.953498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa8994f3-9f8e-4ca7-a6e7-21a5c2b9ea75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:47.954169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa8994f3-9f8e-4ca7-a6e7-21a5c2b9ea75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:47.954821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa8994f3-9f8e-4ca7-a6e7-21a5c2b9ea75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:47.987165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fa8994f3-9f8e-4ca7-a6e7-21a5c2b9ea75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054594 Sep 13 20:10:47.987786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 547/1204] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:47 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:48.193708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a8741e95-27aa-4c8f-92ea-9105bb4ddf28 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:48.194242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a8741e95-27aa-4c8f-92ea-9105bb4ddf28 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:48.201047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a8741e95-27aa-4c8f-92ea-9105bb4ddf28 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:48.201534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a8741e95-27aa-4c8f-92ea-9105bb4ddf28 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:48.201967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a8741e95-27aa-4c8f-92ea-9105bb4ddf28 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:48.202698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a8741e95-27aa-4c8f-92ea-9105bb4ddf28 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:48.203134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a8741e95-27aa-4c8f-92ea-9105bb4ddf28 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:48.203557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a8741e95-27aa-4c8f-92ea-9105bb4ddf28 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:48.349576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a8741e95-27aa-4c8f-92ea-9105bb4ddf28 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:48.358616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a8741e95-27aa-4c8f-92ea-9105bb4ddf28 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.169191 Sep 13 20:10:48.359346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 658/1205] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:48 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:49.000888 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-36a2bb63-6b77-4259-babb-cf39e8547fd9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:49.003149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-36a2bb63-6b77-4259-babb-cf39e8547fd9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:49.010356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36a2bb63-6b77-4259-babb-cf39e8547fd9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:49.010874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36a2bb63-6b77-4259-babb-cf39e8547fd9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:49.011309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36a2bb63-6b77-4259-babb-cf39e8547fd9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:49.012002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36a2bb63-6b77-4259-babb-cf39e8547fd9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:49.012451 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36a2bb63-6b77-4259-babb-cf39e8547fd9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:49.012873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36a2bb63-6b77-4259-babb-cf39e8547fd9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:49.043161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-36a2bb63-6b77-4259-babb-cf39e8547fd9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046396 Sep 13 20:10:49.043712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 548/1206] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:48 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:49.383755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fc62e7c5-d58b-40d8-a0c2-afb50c295646 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:49.384494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fc62e7c5-d58b-40d8-a0c2-afb50c295646 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:49.393650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc62e7c5-d58b-40d8-a0c2-afb50c295646 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:49.394265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc62e7c5-d58b-40d8-a0c2-afb50c295646 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:49.394728 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc62e7c5-d58b-40d8-a0c2-afb50c295646 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:49.395480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc62e7c5-d58b-40d8-a0c2-afb50c295646 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:49.395927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc62e7c5-d58b-40d8-a0c2-afb50c295646 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:49.396339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fc62e7c5-d58b-40d8-a0c2-afb50c295646 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:49.532274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fc62e7c5-d58b-40d8-a0c2-afb50c295646 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:49.542147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fc62e7c5-d58b-40d8-a0c2-afb50c295646 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163454 Sep 13 20:10:49.542801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 659/1207] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:49 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:50.058773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d2bbfae8-23c5-4c3b-8215-071817ea0c76 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:50.061262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d2bbfae8-23c5-4c3b-8215-071817ea0c76 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:50.063617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:10:50.063823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:10:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments (ip 10.222.0.52) !!! Sep 13 20:10:50.065726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:10:50.065921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:10:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments (ip 10.222.0.52) !!! Sep 13 20:10:50.079677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2bbfae8-23c5-4c3b-8215-071817ea0c76 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:50.080255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2bbfae8-23c5-4c3b-8215-071817ea0c76 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:50.080774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2bbfae8-23c5-4c3b-8215-071817ea0c76 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:50.082166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2bbfae8-23c5-4c3b-8215-071817ea0c76 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:50.082660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2bbfae8-23c5-4c3b-8215-071817ea0c76 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:50.083086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2bbfae8-23c5-4c3b-8215-071817ea0c76 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:50.123256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d2bbfae8-23c5-4c3b-8215-071817ea0c76 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069208 Sep 13 20:10:50.123821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 549/1208] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:50 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:50.575829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-97a9e57a-e87b-4fe7-b229-6999549ed345 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:50.576542 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-97a9e57a-e87b-4fe7-b229-6999549ed345 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:50.586189 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97a9e57a-e87b-4fe7-b229-6999549ed345 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:50.586737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97a9e57a-e87b-4fe7-b229-6999549ed345 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:50.587210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97a9e57a-e87b-4fe7-b229-6999549ed345 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:50.587963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97a9e57a-e87b-4fe7-b229-6999549ed345 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:50.588551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97a9e57a-e87b-4fe7-b229-6999549ed345 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:50.589072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97a9e57a-e87b-4fe7-b229-6999549ed345 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:50.728614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-97a9e57a-e87b-4fe7-b229-6999549ed345 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:50.737329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-97a9e57a-e87b-4fe7-b229-6999549ed345 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166538 Sep 13 20:10:50.737941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 660/1209] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:50 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:51.137157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-50dfbb2b-87af-47be-9ff7-220f2ac0cef3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:51.149207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-50dfbb2b-87af-47be-9ff7-220f2ac0cef3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:51.153850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50dfbb2b-87af-47be-9ff7-220f2ac0cef3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:51.154343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50dfbb2b-87af-47be-9ff7-220f2ac0cef3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:51.154800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50dfbb2b-87af-47be-9ff7-220f2ac0cef3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:51.155479 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50dfbb2b-87af-47be-9ff7-220f2ac0cef3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:51.155959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50dfbb2b-87af-47be-9ff7-220f2ac0cef3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:51.156371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50dfbb2b-87af-47be-9ff7-220f2ac0cef3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:51.186326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-50dfbb2b-87af-47be-9ff7-220f2ac0cef3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053934 Sep 13 20:10:51.186923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 550/1210] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:51 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:51.761305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-48f6e99c-fdfd-4591-a895-db0ec74d3df1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:51.761877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-48f6e99c-fdfd-4591-a895-db0ec74d3df1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:51.764297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:51.770452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48f6e99c-fdfd-4591-a895-db0ec74d3df1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:51.770921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48f6e99c-fdfd-4591-a895-db0ec74d3df1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:51.771348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48f6e99c-fdfd-4591-a895-db0ec74d3df1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:51.772037 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48f6e99c-fdfd-4591-a895-db0ec74d3df1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:51.772487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48f6e99c-fdfd-4591-a895-db0ec74d3df1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:51.772904 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48f6e99c-fdfd-4591-a895-db0ec74d3df1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:51.906239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-48f6e99c-fdfd-4591-a895-db0ec74d3df1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:51.915927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-48f6e99c-fdfd-4591-a895-db0ec74d3df1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158537 Sep 13 20:10:51.916466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 661/1211] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:51 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:52.203936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8eb81951-98b6-48de-a282-af9f8ee00cbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:52.207440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8eb81951-98b6-48de-a282-af9f8ee00cbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:52.209775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=58 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:52.215683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8eb81951-98b6-48de-a282-af9f8ee00cbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:52.216171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8eb81951-98b6-48de-a282-af9f8ee00cbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:52.216607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8eb81951-98b6-48de-a282-af9f8ee00cbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:52.217302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8eb81951-98b6-48de-a282-af9f8ee00cbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:52.217753 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8eb81951-98b6-48de-a282-af9f8ee00cbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:52.218173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8eb81951-98b6-48de-a282-af9f8ee00cbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:52.248949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8eb81951-98b6-48de-a282-af9f8ee00cbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051924 Sep 13 20:10:52.249498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 551/1212] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:52 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:52.951409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-75cdded2-c883-4378-bd68-88b700b3423c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:52.952091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-75cdded2-c883-4378-bd68-88b700b3423c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:52.960848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75cdded2-c883-4378-bd68-88b700b3423c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:52.961329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75cdded2-c883-4378-bd68-88b700b3423c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:52.961765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75cdded2-c883-4378-bd68-88b700b3423c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:52.962491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75cdded2-c883-4378-bd68-88b700b3423c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:52.962944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75cdded2-c883-4378-bd68-88b700b3423c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:52.963366 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75cdded2-c883-4378-bd68-88b700b3423c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:53.107737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-75cdded2-c883-4378-bd68-88b700b3423c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:53.119251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-75cdded2-c883-4378-bd68-88b700b3423c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.170749 Sep 13 20:10:53.119251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 662/1213] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:52 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:53.262930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6758a160-48b7-4b13-8eeb-477a63d89cf5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:53.265119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6758a160-48b7-4b13-8eeb-477a63d89cf5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:53.272336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6758a160-48b7-4b13-8eeb-477a63d89cf5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:53.272837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6758a160-48b7-4b13-8eeb-477a63d89cf5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:53.273327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6758a160-48b7-4b13-8eeb-477a63d89cf5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:53.274138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6758a160-48b7-4b13-8eeb-477a63d89cf5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:53.274676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6758a160-48b7-4b13-8eeb-477a63d89cf5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:53.275185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6758a160-48b7-4b13-8eeb-477a63d89cf5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:53.307387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6758a160-48b7-4b13-8eeb-477a63d89cf5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048793 Sep 13 20:10:53.307886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 552/1214] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:53 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:54.140468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0b3c41e9-35c6-46d3-be58-a2a2b9d835b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:54.141017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0b3c41e9-35c6-46d3-be58-a2a2b9d835b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:54.147958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b3c41e9-35c6-46d3-be58-a2a2b9d835b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:54.148440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b3c41e9-35c6-46d3-be58-a2a2b9d835b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:54.148873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b3c41e9-35c6-46d3-be58-a2a2b9d835b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:54.149560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b3c41e9-35c6-46d3-be58-a2a2b9d835b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:54.150006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b3c41e9-35c6-46d3-be58-a2a2b9d835b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:54.150449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b3c41e9-35c6-46d3-be58-a2a2b9d835b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:54.286641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0b3c41e9-35c6-46d3-be58-a2a2b9d835b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:54.293562 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0b3c41e9-35c6-46d3-be58-a2a2b9d835b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.157172 Sep 13 20:10:54.294131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 663/1215] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:54 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:54.320636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e8d4d7a2-d53c-45b3-9159-498085c8216a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:54.322906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e8d4d7a2-d53c-45b3-9159-498085c8216a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:54.329602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8d4d7a2-d53c-45b3-9159-498085c8216a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:54.330077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8d4d7a2-d53c-45b3-9159-498085c8216a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:54.330537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8d4d7a2-d53c-45b3-9159-498085c8216a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:54.331231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8d4d7a2-d53c-45b3-9159-498085c8216a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:54.332025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8d4d7a2-d53c-45b3-9159-498085c8216a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:54.332461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8d4d7a2-d53c-45b3-9159-498085c8216a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:54.361754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e8d4d7a2-d53c-45b3-9159-498085c8216a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045157 Sep 13 20:10:54.362291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 553/1216] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:54 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:55.317523 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bf3a0092-b351-459f-b6b1-5f8a866c9e0d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:55.318100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bf3a0092-b351-459f-b6b1-5f8a866c9e0d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:55.325261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bf3a0092-b351-459f-b6b1-5f8a866c9e0d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:55.325740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bf3a0092-b351-459f-b6b1-5f8a866c9e0d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:55.326164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bf3a0092-b351-459f-b6b1-5f8a866c9e0d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:55.326897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bf3a0092-b351-459f-b6b1-5f8a866c9e0d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:55.327340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bf3a0092-b351-459f-b6b1-5f8a866c9e0d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:55.327760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bf3a0092-b351-459f-b6b1-5f8a866c9e0d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:55.377178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ce5ee782-55ec-4f05-92c5-bf3a83095853 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:55.379360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ce5ee782-55ec-4f05-92c5-bf3a83095853 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:55.385968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ce5ee782-55ec-4f05-92c5-bf3a83095853 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:55.386488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ce5ee782-55ec-4f05-92c5-bf3a83095853 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:55.386924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ce5ee782-55ec-4f05-92c5-bf3a83095853 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:55.387615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ce5ee782-55ec-4f05-92c5-bf3a83095853 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:55.388100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ce5ee782-55ec-4f05-92c5-bf3a83095853 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:55.388514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ce5ee782-55ec-4f05-92c5-bf3a83095853 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:55.420522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ce5ee782-55ec-4f05-92c5-bf3a83095853 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049636 Sep 13 20:10:55.421106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 554/1217] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:55 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:55.467551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bf3a0092-b351-459f-b6b1-5f8a866c9e0d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:55.477615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bf3a0092-b351-459f-b6b1-5f8a866c9e0d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164167 Sep 13 20:10:55.478175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 664/1218] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:55 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:56.436822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7a41de09-380f-497b-abb0-d31febf261d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:56.439827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7a41de09-380f-497b-abb0-d31febf261d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:56.447501 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a41de09-380f-497b-abb0-d31febf261d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:56.447982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a41de09-380f-497b-abb0-d31febf261d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:56.448411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a41de09-380f-497b-abb0-d31febf261d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:56.449093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a41de09-380f-497b-abb0-d31febf261d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:56.449537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a41de09-380f-497b-abb0-d31febf261d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:56.449957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a41de09-380f-497b-abb0-d31febf261d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:56.481440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7a41de09-380f-497b-abb0-d31febf261d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051257 Sep 13 20:10:56.481991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 555/1219] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:56 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:56.504315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-35c63992-bc68-497b-ade9-687208960c7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:56.504953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-35c63992-bc68-497b-ade9-687208960c7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:56.511843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35c63992-bc68-497b-ade9-687208960c7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:56.512333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35c63992-bc68-497b-ade9-687208960c7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:56.512755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35c63992-bc68-497b-ade9-687208960c7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:56.513441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35c63992-bc68-497b-ade9-687208960c7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:56.513895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35c63992-bc68-497b-ade9-687208960c7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:56.514311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35c63992-bc68-497b-ade9-687208960c7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:56.649074 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-35c63992-bc68-497b-ade9-687208960c7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:56.657968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-35c63992-bc68-497b-ade9-687208960c7a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.159888 Sep 13 20:10:56.658579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 665/1220] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:56 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:57.493626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ec48b4bb-4f23-4027-bf96-1dfe107e4d75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:57.495732 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ec48b4bb-4f23-4027-bf96-1dfe107e4d75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:57.502688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec48b4bb-4f23-4027-bf96-1dfe107e4d75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:57.503173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec48b4bb-4f23-4027-bf96-1dfe107e4d75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:57.503611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec48b4bb-4f23-4027-bf96-1dfe107e4d75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:57.504308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec48b4bb-4f23-4027-bf96-1dfe107e4d75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:57.504761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec48b4bb-4f23-4027-bf96-1dfe107e4d75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:57.505183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec48b4bb-4f23-4027-bf96-1dfe107e4d75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:57.535872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ec48b4bb-4f23-4027-bf96-1dfe107e4d75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 Sep 13 20:10:57.536417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 556/1221] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:57 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:57.681270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7921af55-360e-4c60-b5d3-7cd7c7fc7246 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:57.681852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7921af55-360e-4c60-b5d3-7cd7c7fc7246 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:57.688893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7921af55-360e-4c60-b5d3-7cd7c7fc7246 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:57.689371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7921af55-360e-4c60-b5d3-7cd7c7fc7246 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:57.689793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7921af55-360e-4c60-b5d3-7cd7c7fc7246 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:57.690514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7921af55-360e-4c60-b5d3-7cd7c7fc7246 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:57.690959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7921af55-360e-4c60-b5d3-7cd7c7fc7246 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:57.691370 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7921af55-360e-4c60-b5d3-7cd7c7fc7246 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:57.840578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7921af55-360e-4c60-b5d3-7cd7c7fc7246 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:57.849157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7921af55-360e-4c60-b5d3-7cd7c7fc7246 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.171880 Sep 13 20:10:57.849760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 666/1222] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:57 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:58.550743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-226eeb10-a5cc-4aca-b877-c20cf99500c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:58.553411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-226eeb10-a5cc-4aca-b877-c20cf99500c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:58.561981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-226eeb10-a5cc-4aca-b877-c20cf99500c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:58.562635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-226eeb10-a5cc-4aca-b877-c20cf99500c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:58.563174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-226eeb10-a5cc-4aca-b877-c20cf99500c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:58.564174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-226eeb10-a5cc-4aca-b877-c20cf99500c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:58.564822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-226eeb10-a5cc-4aca-b877-c20cf99500c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:58.565322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-226eeb10-a5cc-4aca-b877-c20cf99500c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:58.596563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-226eeb10-a5cc-4aca-b877-c20cf99500c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050836 Sep 13 20:10:58.597128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 557/1223] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:58 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:10:58.873100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-77f22120-4296-46ed-a0bb-554669e4460a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:58.873710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-77f22120-4296-46ed-a0bb-554669e4460a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:58.880776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77f22120-4296-46ed-a0bb-554669e4460a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:58.881262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77f22120-4296-46ed-a0bb-554669e4460a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:58.881693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77f22120-4296-46ed-a0bb-554669e4460a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:58.882410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77f22120-4296-46ed-a0bb-554669e4460a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:58.882867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77f22120-4296-46ed-a0bb-554669e4460a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:58.883291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-77f22120-4296-46ed-a0bb-554669e4460a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:59.019395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-77f22120-4296-46ed-a0bb-554669e4460a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:10:59.028625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-77f22120-4296-46ed-a0bb-554669e4460a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.159459 Sep 13 20:10:59.029204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 667/1224] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:10:58 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:10:59.609825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-56c86125-fdc9-4a5b-b77c-214305ced4ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:10:59.612004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-56c86125-fdc9-4a5b-b77c-214305ced4ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:10:59.618671 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-56c86125-fdc9-4a5b-b77c-214305ced4ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:59.619161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-56c86125-fdc9-4a5b-b77c-214305ced4ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:59.619596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-56c86125-fdc9-4a5b-b77c-214305ced4ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:59.620297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-56c86125-fdc9-4a5b-b77c-214305ced4ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:10:59.620742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-56c86125-fdc9-4a5b-b77c-214305ced4ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:10:59.621165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-56c86125-fdc9-4a5b-b77c-214305ced4ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:10:59.651761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-56c86125-fdc9-4a5b-b77c-214305ced4ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046106 Sep 13 20:10:59.652319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 558/1225] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:10:59 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:00.064412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-286dd401-9441-47cf-971e-aa9a7ff1911a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:00.065235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-286dd401-9441-47cf-971e-aa9a7ff1911a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:00.073205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-286dd401-9441-47cf-971e-aa9a7ff1911a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:00.073685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-286dd401-9441-47cf-971e-aa9a7ff1911a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:00.074120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-286dd401-9441-47cf-971e-aa9a7ff1911a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:00.074855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-286dd401-9441-47cf-971e-aa9a7ff1911a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:00.075304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-286dd401-9441-47cf-971e-aa9a7ff1911a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:00.075723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-286dd401-9441-47cf-971e-aa9a7ff1911a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:00.222135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-286dd401-9441-47cf-971e-aa9a7ff1911a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:00.231516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-286dd401-9441-47cf-971e-aa9a7ff1911a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.173601 Sep 13 20:11:00.232094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 668/1226] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:00 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:00.665117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0ae7d148-434c-4cae-bee4-04fe7cb225b5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:00.667372 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0ae7d148-434c-4cae-bee4-04fe7cb225b5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:00.674232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0ae7d148-434c-4cae-bee4-04fe7cb225b5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:00.674724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0ae7d148-434c-4cae-bee4-04fe7cb225b5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:00.675165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0ae7d148-434c-4cae-bee4-04fe7cb225b5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:00.675858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0ae7d148-434c-4cae-bee4-04fe7cb225b5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:00.676309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0ae7d148-434c-4cae-bee4-04fe7cb225b5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:00.676785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0ae7d148-434c-4cae-bee4-04fe7cb225b5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:00.709154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0ae7d148-434c-4cae-bee4-04fe7cb225b5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048053 Sep 13 20:11:00.709711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 559/1227] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:00 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:01.255889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-52340012-466a-4ec2-8784-00dc806d0f65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:01.256948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-52340012-466a-4ec2-8784-00dc806d0f65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:01.263944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52340012-466a-4ec2-8784-00dc806d0f65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:01.264426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52340012-466a-4ec2-8784-00dc806d0f65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:01.264857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52340012-466a-4ec2-8784-00dc806d0f65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:01.265550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52340012-466a-4ec2-8784-00dc806d0f65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:01.265999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52340012-466a-4ec2-8784-00dc806d0f65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:01.266422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-52340012-466a-4ec2-8784-00dc806d0f65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:01.400424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-52340012-466a-4ec2-8784-00dc806d0f65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:01.409117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-52340012-466a-4ec2-8784-00dc806d0f65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.157576 Sep 13 20:11:01.409695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 669/1228] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:01 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:01.722623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d3c01704-7012-4c2b-9ba4-50488823c434 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:01.725320 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d3c01704-7012-4c2b-9ba4-50488823c434 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:01.732307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3c01704-7012-4c2b-9ba4-50488823c434 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:01.732814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3c01704-7012-4c2b-9ba4-50488823c434 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:01.733245 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3c01704-7012-4c2b-9ba4-50488823c434 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:01.733927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3c01704-7012-4c2b-9ba4-50488823c434 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:01.734403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3c01704-7012-4c2b-9ba4-50488823c434 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:01.734816 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3c01704-7012-4c2b-9ba4-50488823c434 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:01.749244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:01.766477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d3c01704-7012-4c2b-9ba4-50488823c434 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048245 Sep 13 20:11:01.766977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 560/1229] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:02.435358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1ce18632-e3c1-4eee-99a4-7a0b5dc79033 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:02.436176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1ce18632-e3c1-4eee-99a4-7a0b5dc79033 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:02.449226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ce18632-e3c1-4eee-99a4-7a0b5dc79033 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:02.449715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ce18632-e3c1-4eee-99a4-7a0b5dc79033 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:02.450148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ce18632-e3c1-4eee-99a4-7a0b5dc79033 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:02.450926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ce18632-e3c1-4eee-99a4-7a0b5dc79033 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:02.451376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ce18632-e3c1-4eee-99a4-7a0b5dc79033 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:02.451795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1ce18632-e3c1-4eee-99a4-7a0b5dc79033 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:02.609824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1ce18632-e3c1-4eee-99a4-7a0b5dc79033 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:02.618998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1ce18632-e3c1-4eee-99a4-7a0b5dc79033 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.189093 Sep 13 20:11:02.619550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 670/1230] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:02 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:02.782005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9ed1726d-028a-49f3-af21-25ac0f4a5d2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:02.784870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9ed1726d-028a-49f3-af21-25ac0f4a5d2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:02.792982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ed1726d-028a-49f3-af21-25ac0f4a5d2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:02.793466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ed1726d-028a-49f3-af21-25ac0f4a5d2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:02.793901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ed1726d-028a-49f3-af21-25ac0f4a5d2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:02.794638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ed1726d-028a-49f3-af21-25ac0f4a5d2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:02.795087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ed1726d-028a-49f3-af21-25ac0f4a5d2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:02.795504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ed1726d-028a-49f3-af21-25ac0f4a5d2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:02.826566 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9ed1726d-028a-49f3-af21-25ac0f4a5d2c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050278 Sep 13 20:11:02.827110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 561/1231] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:02 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:03.642789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f7c627e3-a9a9-4a28-a568-169341dc22df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:03.643381 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f7c627e3-a9a9-4a28-a568-169341dc22df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:03.651467 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c627e3-a9a9-4a28-a568-169341dc22df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:03.652145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c627e3-a9a9-4a28-a568-169341dc22df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:03.652907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c627e3-a9a9-4a28-a568-169341dc22df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:03.653867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c627e3-a9a9-4a28-a568-169341dc22df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:03.654527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c627e3-a9a9-4a28-a568-169341dc22df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:03.654996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c627e3-a9a9-4a28-a568-169341dc22df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:03.659352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:03.794831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f7c627e3-a9a9-4a28-a568-169341dc22df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:03.807525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f7c627e3-a9a9-4a28-a568-169341dc22df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168406 Sep 13 20:11:03.808071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 671/1232] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:03 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:03.839468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d0c937bc-8545-4612-b2c2-76c214c5d498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:03.841573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d0c937bc-8545-4612-b2c2-76c214c5d498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:03.849117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0c937bc-8545-4612-b2c2-76c214c5d498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:03.849731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0c937bc-8545-4612-b2c2-76c214c5d498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:03.850202 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0c937bc-8545-4612-b2c2-76c214c5d498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:03.851479 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0c937bc-8545-4612-b2c2-76c214c5d498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:03.852053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0c937bc-8545-4612-b2c2-76c214c5d498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:03.852620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0c937bc-8545-4612-b2c2-76c214c5d498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:03.896844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d0c937bc-8545-4612-b2c2-76c214c5d498 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061304 Sep 13 20:11:03.897431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 562/1233] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:03 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:04.837426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f563811f-4d6b-466c-9252-adb92eb02045 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:04.838005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f563811f-4d6b-466c-9252-adb92eb02045 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:04.844860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f563811f-4d6b-466c-9252-adb92eb02045 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:04.845350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f563811f-4d6b-466c-9252-adb92eb02045 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:04.845783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f563811f-4d6b-466c-9252-adb92eb02045 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:04.846575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f563811f-4d6b-466c-9252-adb92eb02045 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:04.846972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f563811f-4d6b-466c-9252-adb92eb02045 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:04.847396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f563811f-4d6b-466c-9252-adb92eb02045 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:04.911872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-feaa7ddd-44b5-4813-920e-ab7433d5ee9f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:04.914117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-feaa7ddd-44b5-4813-920e-ab7433d5ee9f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:04.922774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-feaa7ddd-44b5-4813-920e-ab7433d5ee9f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:04.923366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-feaa7ddd-44b5-4813-920e-ab7433d5ee9f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:04.923814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-feaa7ddd-44b5-4813-920e-ab7433d5ee9f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:04.924706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-feaa7ddd-44b5-4813-920e-ab7433d5ee9f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:04.925436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-feaa7ddd-44b5-4813-920e-ab7433d5ee9f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:04.925975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-feaa7ddd-44b5-4813-920e-ab7433d5ee9f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:04.957559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-feaa7ddd-44b5-4813-920e-ab7433d5ee9f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049225 Sep 13 20:11:04.958111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 563/1234] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:04 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:04.992337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f563811f-4d6b-466c-9252-adb92eb02045 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:05.001234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f563811f-4d6b-466c-9252-adb92eb02045 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.170002 Sep 13 20:11:05.001801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 672/1235] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:04 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:05.971615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-748773eb-face-4c9f-b80d-b41ba88f14fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:05.974158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-748773eb-face-4c9f-b80d-b41ba88f14fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:05.981676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-748773eb-face-4c9f-b80d-b41ba88f14fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:05.982161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-748773eb-face-4c9f-b80d-b41ba88f14fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:05.982639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-748773eb-face-4c9f-b80d-b41ba88f14fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:05.983325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-748773eb-face-4c9f-b80d-b41ba88f14fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:05.983796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-748773eb-face-4c9f-b80d-b41ba88f14fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:05.984224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-748773eb-face-4c9f-b80d-b41ba88f14fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:06.014804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-748773eb-face-4c9f-b80d-b41ba88f14fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047853 Sep 13 20:11:06.015350 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 564/1236] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:05 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:06.026786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c15e08b9-bd49-4d9b-8da5-227d67a7a4a8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:06.027935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c15e08b9-bd49-4d9b-8da5-227d67a7a4a8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:06.038020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c15e08b9-bd49-4d9b-8da5-227d67a7a4a8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:06.038536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c15e08b9-bd49-4d9b-8da5-227d67a7a4a8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:06.038967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c15e08b9-bd49-4d9b-8da5-227d67a7a4a8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:06.039658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c15e08b9-bd49-4d9b-8da5-227d67a7a4a8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:06.040106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c15e08b9-bd49-4d9b-8da5-227d67a7a4a8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:06.040525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c15e08b9-bd49-4d9b-8da5-227d67a7a4a8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:06.174790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c15e08b9-bd49-4d9b-8da5-227d67a7a4a8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:06.183505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c15e08b9-bd49-4d9b-8da5-227d67a7a4a8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162776 Sep 13 20:11:06.184079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 673/1237] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:06 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:07.029430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9da84963-9234-4659-9d7e-42349327cc16 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:07.032110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9da84963-9234-4659-9d7e-42349327cc16 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:07.040142 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9da84963-9234-4659-9d7e-42349327cc16 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:07.040631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9da84963-9234-4659-9d7e-42349327cc16 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:07.041067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9da84963-9234-4659-9d7e-42349327cc16 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:07.041763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9da84963-9234-4659-9d7e-42349327cc16 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:07.042209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9da84963-9234-4659-9d7e-42349327cc16 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:07.042669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9da84963-9234-4659-9d7e-42349327cc16 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:07.072994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9da84963-9234-4659-9d7e-42349327cc16 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048650 Sep 13 20:11:07.073547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 565/1238] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:07.207406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a769c302-b657-4000-9b03-8cb6e54a954f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:07.207979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a769c302-b657-4000-9b03-8cb6e54a954f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:07.215102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a769c302-b657-4000-9b03-8cb6e54a954f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:07.215585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a769c302-b657-4000-9b03-8cb6e54a954f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:07.216011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a769c302-b657-4000-9b03-8cb6e54a954f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:07.216709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a769c302-b657-4000-9b03-8cb6e54a954f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:07.217155 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a769c302-b657-4000-9b03-8cb6e54a954f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:07.217578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a769c302-b657-4000-9b03-8cb6e54a954f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:07.359357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a769c302-b657-4000-9b03-8cb6e54a954f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:07.367966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a769c302-b657-4000-9b03-8cb6e54a954f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165224 Sep 13 20:11:07.368526 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 674/1239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:07 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:08.087106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2b6d7727-74a9-4257-aabc-9e81da0eda7a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:08.089267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2b6d7727-74a9-4257-aabc-9e81da0eda7a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:08.096091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b6d7727-74a9-4257-aabc-9e81da0eda7a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:08.096567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b6d7727-74a9-4257-aabc-9e81da0eda7a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:08.097035 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b6d7727-74a9-4257-aabc-9e81da0eda7a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:08.097708 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b6d7727-74a9-4257-aabc-9e81da0eda7a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:08.098147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b6d7727-74a9-4257-aabc-9e81da0eda7a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:08.098600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b6d7727-74a9-4257-aabc-9e81da0eda7a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:08.129272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2b6d7727-74a9-4257-aabc-9e81da0eda7a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047146 Sep 13 20:11:08.129751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 566/1240] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:08.391644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0a64c0e7-439b-4fb1-a6db-1036fa155335 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:08.392263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0a64c0e7-439b-4fb1-a6db-1036fa155335 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:08.398921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a64c0e7-439b-4fb1-a6db-1036fa155335 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:08.399397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a64c0e7-439b-4fb1-a6db-1036fa155335 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:08.399855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a64c0e7-439b-4fb1-a6db-1036fa155335 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:08.400544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a64c0e7-439b-4fb1-a6db-1036fa155335 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:08.400988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a64c0e7-439b-4fb1-a6db-1036fa155335 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:08.401440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a64c0e7-439b-4fb1-a6db-1036fa155335 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:08.533959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0a64c0e7-439b-4fb1-a6db-1036fa155335 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:08.542520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0a64c0e7-439b-4fb1-a6db-1036fa155335 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.154818 Sep 13 20:11:08.543092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 675/1241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:08 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:09.145020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0dd3b787-ba6c-4b69-b756-918280ccd851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:09.147839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0dd3b787-ba6c-4b69-b756-918280ccd851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:09.158966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0dd3b787-ba6c-4b69-b756-918280ccd851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:09.159612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0dd3b787-ba6c-4b69-b756-918280ccd851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:09.160160 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0dd3b787-ba6c-4b69-b756-918280ccd851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:09.161045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0dd3b787-ba6c-4b69-b756-918280ccd851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:09.161650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0dd3b787-ba6c-4b69-b756-918280ccd851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:09.162213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0dd3b787-ba6c-4b69-b756-918280ccd851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:09.194475 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0dd3b787-ba6c-4b69-b756-918280ccd851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055307 Sep 13 20:11:09.195043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 567/1242] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:09.567490 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e0c64364-ce87-4072-905d-462f1fbb4e15 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:09.568197 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e0c64364-ce87-4072-905d-462f1fbb4e15 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:09.575441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0c64364-ce87-4072-905d-462f1fbb4e15 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:09.576004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0c64364-ce87-4072-905d-462f1fbb4e15 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:09.576529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0c64364-ce87-4072-905d-462f1fbb4e15 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:09.577491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0c64364-ce87-4072-905d-462f1fbb4e15 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:09.578081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0c64364-ce87-4072-905d-462f1fbb4e15 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:09.578627 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0c64364-ce87-4072-905d-462f1fbb4e15 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:09.728229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e0c64364-ce87-4072-905d-462f1fbb4e15 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:09.736930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e0c64364-ce87-4072-905d-462f1fbb4e15 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.174436 Sep 13 20:11:09.737516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 676/1243] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:09 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:10.206844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1bc1673a-2bd7-4c51-9331-096ec63faead tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:10.209345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1bc1673a-2bd7-4c51-9331-096ec63faead tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:10.216367 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1bc1673a-2bd7-4c51-9331-096ec63faead tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:10.216844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1bc1673a-2bd7-4c51-9331-096ec63faead tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:10.217270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1bc1673a-2bd7-4c51-9331-096ec63faead tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:10.217954 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1bc1673a-2bd7-4c51-9331-096ec63faead tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:10.218417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1bc1673a-2bd7-4c51-9331-096ec63faead tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:10.218847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1bc1673a-2bd7-4c51-9331-096ec63faead tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:10.249188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1bc1673a-2bd7-4c51-9331-096ec63faead tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046350 Sep 13 20:11:10.249736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 568/1244] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:10 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:10.764580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6d415799-70fd-4742-8da5-a35732eeda64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:10.765392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6d415799-70fd-4742-8da5-a35732eeda64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:10.774257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d415799-70fd-4742-8da5-a35732eeda64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:10.774770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d415799-70fd-4742-8da5-a35732eeda64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:10.775297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d415799-70fd-4742-8da5-a35732eeda64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:10.775987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d415799-70fd-4742-8da5-a35732eeda64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:10.776432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d415799-70fd-4742-8da5-a35732eeda64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:10.776872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d415799-70fd-4742-8da5-a35732eeda64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:10.916216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6d415799-70fd-4742-8da5-a35732eeda64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:10.924519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6d415799-70fd-4742-8da5-a35732eeda64 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166202 Sep 13 20:11:10.925084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 677/1245] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:10 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:11.263691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-289c62b2-7765-4e91-82cd-c4bd2d877e6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:11.265827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-289c62b2-7765-4e91-82cd-c4bd2d877e6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:11.272682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-289c62b2-7765-4e91-82cd-c4bd2d877e6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:11.273223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-289c62b2-7765-4e91-82cd-c4bd2d877e6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:11.273575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-289c62b2-7765-4e91-82cd-c4bd2d877e6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:11.274485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-289c62b2-7765-4e91-82cd-c4bd2d877e6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:11.274698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-289c62b2-7765-4e91-82cd-c4bd2d877e6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:11.275132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-289c62b2-7765-4e91-82cd-c4bd2d877e6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:11.304981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-289c62b2-7765-4e91-82cd-c4bd2d877e6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045732 Sep 13 20:11:11.305528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 569/1246] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:11 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:11.948611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-176b676f-a61c-4b98-bf3e-b08b0c169298 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:11.949191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-176b676f-a61c-4b98-bf3e-b08b0c169298 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:11.956093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-176b676f-a61c-4b98-bf3e-b08b0c169298 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:11.956578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-176b676f-a61c-4b98-bf3e-b08b0c169298 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:11.957004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-176b676f-a61c-4b98-bf3e-b08b0c169298 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:11.958055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-176b676f-a61c-4b98-bf3e-b08b0c169298 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:11.958540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-176b676f-a61c-4b98-bf3e-b08b0c169298 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:11.958958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-176b676f-a61c-4b98-bf3e-b08b0c169298 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:12.097490 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-176b676f-a61c-4b98-bf3e-b08b0c169298 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:12.107867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-176b676f-a61c-4b98-bf3e-b08b0c169298 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163415 Sep 13 20:11:12.108440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 678/1247] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:11 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:12.322358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3ef34ff1-f553-4541-8241-d4d4d968bdaf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:12.328492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3ef34ff1-f553-4541-8241-d4d4d968bdaf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:12.338828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ef34ff1-f553-4541-8241-d4d4d968bdaf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:12.339314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ef34ff1-f553-4541-8241-d4d4d968bdaf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:12.339752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ef34ff1-f553-4541-8241-d4d4d968bdaf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:12.340456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ef34ff1-f553-4541-8241-d4d4d968bdaf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:12.340909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ef34ff1-f553-4541-8241-d4d4d968bdaf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:12.341331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ef34ff1-f553-4541-8241-d4d4d968bdaf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:12.372649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3ef34ff1-f553-4541-8241-d4d4d968bdaf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057046 Sep 13 20:11:12.373209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 570/1248] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:12 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:13.133932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-16b436dc-f8dd-4e9e-82c7-31666d3fba1a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:13.134573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-16b436dc-f8dd-4e9e-82c7-31666d3fba1a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:13.141265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16b436dc-f8dd-4e9e-82c7-31666d3fba1a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:13.141742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16b436dc-f8dd-4e9e-82c7-31666d3fba1a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:13.142169 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16b436dc-f8dd-4e9e-82c7-31666d3fba1a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:13.142893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16b436dc-f8dd-4e9e-82c7-31666d3fba1a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:13.143336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16b436dc-f8dd-4e9e-82c7-31666d3fba1a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:13.143747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16b436dc-f8dd-4e9e-82c7-31666d3fba1a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:13.279684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-16b436dc-f8dd-4e9e-82c7-31666d3fba1a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:13.288146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-16b436dc-f8dd-4e9e-82c7-31666d3fba1a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158958 Sep 13 20:11:13.288667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 679/1249] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:13 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:13.389821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-20c30c29-336b-4ef7-97c5-846ab317831d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:13.391911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-20c30c29-336b-4ef7-97c5-846ab317831d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:13.399118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20c30c29-336b-4ef7-97c5-846ab317831d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:13.399601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20c30c29-336b-4ef7-97c5-846ab317831d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:13.400033 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20c30c29-336b-4ef7-97c5-846ab317831d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:13.400725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20c30c29-336b-4ef7-97c5-846ab317831d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:13.401177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20c30c29-336b-4ef7-97c5-846ab317831d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:13.401596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20c30c29-336b-4ef7-97c5-846ab317831d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:13.432458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-20c30c29-336b-4ef7-97c5-846ab317831d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049464 Sep 13 20:11:13.433019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 571/1250] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:14.311430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a3918b6a-d989-4b3b-b02b-6c775ba386e3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:14.312067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a3918b6a-d989-4b3b-b02b-6c775ba386e3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:14.319555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3918b6a-d989-4b3b-b02b-6c775ba386e3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:14.320117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3918b6a-d989-4b3b-b02b-6c775ba386e3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:14.320740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3918b6a-d989-4b3b-b02b-6c775ba386e3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:14.321744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3918b6a-d989-4b3b-b02b-6c775ba386e3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:14.322296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3918b6a-d989-4b3b-b02b-6c775ba386e3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:14.322944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a3918b6a-d989-4b3b-b02b-6c775ba386e3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:14.445606 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-96d6069f-f01e-4b92-a3e4-b7cc0615d367 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:14.447945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-96d6069f-f01e-4b92-a3e4-b7cc0615d367 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:14.454612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96d6069f-f01e-4b92-a3e4-b7cc0615d367 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:14.455172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96d6069f-f01e-4b92-a3e4-b7cc0615d367 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:14.455678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96d6069f-f01e-4b92-a3e4-b7cc0615d367 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:14.456624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96d6069f-f01e-4b92-a3e4-b7cc0615d367 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:14.457135 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96d6069f-f01e-4b92-a3e4-b7cc0615d367 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:14.458006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96d6069f-f01e-4b92-a3e4-b7cc0615d367 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:14.459856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a3918b6a-d989-4b3b-b02b-6c775ba386e3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:14.469817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a3918b6a-d989-4b3b-b02b-6c775ba386e3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162364 Sep 13 20:11:14.470398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 680/1251] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:14 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:14.490213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-96d6069f-f01e-4b92-a3e4-b7cc0615d367 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048744 Sep 13 20:11:14.490797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 572/1252] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:14 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:11:15.495478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c44bf736-f3eb-4f47-9c52-bd5b3aab7580 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:15.496219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c44bf736-f3eb-4f47-9c52-bd5b3aab7580 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:15.502916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6aa25b5b-a51f-4321-a45a-aa593afa75de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:15.503485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c44bf736-f3eb-4f47-9c52-bd5b3aab7580 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:15.503972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c44bf736-f3eb-4f47-9c52-bd5b3aab7580 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:15.504400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c44bf736-f3eb-4f47-9c52-bd5b3aab7580 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:15.505090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c44bf736-f3eb-4f47-9c52-bd5b3aab7580 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:15.505235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6aa25b5b-a51f-4321-a45a-aa593afa75de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:15.505519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c44bf736-f3eb-4f47-9c52-bd5b3aab7580 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:15.505960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c44bf736-f3eb-4f47-9c52-bd5b3aab7580 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:15.511877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6aa25b5b-a51f-4321-a45a-aa593afa75de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:15.512354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6aa25b5b-a51f-4321-a45a-aa593afa75de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:15.512775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6aa25b5b-a51f-4321-a45a-aa593afa75de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:15.513468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6aa25b5b-a51f-4321-a45a-aa593afa75de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:15.513905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6aa25b5b-a51f-4321-a45a-aa593afa75de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:15.514322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6aa25b5b-a51f-4321-a45a-aa593afa75de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:15.544786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6aa25b5b-a51f-4321-a45a-aa593afa75de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045580 Sep 13 20:11:15.545545 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 573/1253] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:15.638399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c44bf736-f3eb-4f47-9c52-bd5b3aab7580 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:15.647049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c44bf736-f3eb-4f47-9c52-bd5b3aab7580 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.157001 Sep 13 20:11:15.647602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 681/1254] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:15 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:16.557619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9f868522-fa32-4092-a495-edc49c056d47 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:16.559817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9f868522-fa32-4092-a495-edc49c056d47 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:16.566766 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f868522-fa32-4092-a495-edc49c056d47 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:16.567258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f868522-fa32-4092-a495-edc49c056d47 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:16.567688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f868522-fa32-4092-a495-edc49c056d47 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:16.568380 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f868522-fa32-4092-a495-edc49c056d47 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:16.568822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f868522-fa32-4092-a495-edc49c056d47 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:16.569235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f868522-fa32-4092-a495-edc49c056d47 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:16.600806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9f868522-fa32-4092-a495-edc49c056d47 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047197 Sep 13 20:11:16.601385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 574/1255] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:16 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:16.672403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-67c8bdc3-1c34-4120-9e2b-4306ee5e03b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:16.672969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-67c8bdc3-1c34-4120-9e2b-4306ee5e03b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:16.679765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67c8bdc3-1c34-4120-9e2b-4306ee5e03b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:16.680253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67c8bdc3-1c34-4120-9e2b-4306ee5e03b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:16.680683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67c8bdc3-1c34-4120-9e2b-4306ee5e03b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:16.681374 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67c8bdc3-1c34-4120-9e2b-4306ee5e03b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:16.681823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67c8bdc3-1c34-4120-9e2b-4306ee5e03b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:16.682229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67c8bdc3-1c34-4120-9e2b-4306ee5e03b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:16.822661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-67c8bdc3-1c34-4120-9e2b-4306ee5e03b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:16.831253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-67c8bdc3-1c34-4120-9e2b-4306ee5e03b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163844 Sep 13 20:11:16.831817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 682/1256] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:16 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:17.613705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d21a8792-13d3-422f-b5b5-3d6e9a896a22 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:17.615886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d21a8792-13d3-422f-b5b5-3d6e9a896a22 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:17.622709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d21a8792-13d3-422f-b5b5-3d6e9a896a22 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:17.623318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d21a8792-13d3-422f-b5b5-3d6e9a896a22 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:17.623747 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d21a8792-13d3-422f-b5b5-3d6e9a896a22 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:17.624435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d21a8792-13d3-422f-b5b5-3d6e9a896a22 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:17.624860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d21a8792-13d3-422f-b5b5-3d6e9a896a22 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:17.625309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d21a8792-13d3-422f-b5b5-3d6e9a896a22 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:17.655775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d21a8792-13d3-422f-b5b5-3d6e9a896a22 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046149 Sep 13 20:11:17.656327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 575/1257] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:17 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:17.862931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-de7fd191-119c-4c0c-b1ef-37650fe21186 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:17.863498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-de7fd191-119c-4c0c-b1ef-37650fe21186 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:17.871506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de7fd191-119c-4c0c-b1ef-37650fe21186 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:17.871989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de7fd191-119c-4c0c-b1ef-37650fe21186 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:17.872419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de7fd191-119c-4c0c-b1ef-37650fe21186 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:17.873115 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de7fd191-119c-4c0c-b1ef-37650fe21186 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:17.873566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de7fd191-119c-4c0c-b1ef-37650fe21186 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:17.873992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de7fd191-119c-4c0c-b1ef-37650fe21186 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:18.021277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-de7fd191-119c-4c0c-b1ef-37650fe21186 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:18.029678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-de7fd191-119c-4c0c-b1ef-37650fe21186 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.170790 Sep 13 20:11:18.030272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 683/1258] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:17 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:18.668642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f98064a5-a50a-439f-b5ae-a372be954c56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:18.670925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f98064a5-a50a-439f-b5ae-a372be954c56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:18.677740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f98064a5-a50a-439f-b5ae-a372be954c56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:18.678213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f98064a5-a50a-439f-b5ae-a372be954c56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:18.678664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f98064a5-a50a-439f-b5ae-a372be954c56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:18.679348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f98064a5-a50a-439f-b5ae-a372be954c56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:18.679790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f98064a5-a50a-439f-b5ae-a372be954c56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:18.680204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f98064a5-a50a-439f-b5ae-a372be954c56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:18.722270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f98064a5-a50a-439f-b5ae-a372be954c56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057397 Sep 13 20:11:18.723222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 576/1259] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:19.053016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dfa8fabd-6c26-461d-92c2-31123515dbc6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:19.053614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dfa8fabd-6c26-461d-92c2-31123515dbc6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:19.060349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfa8fabd-6c26-461d-92c2-31123515dbc6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:19.060909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfa8fabd-6c26-461d-92c2-31123515dbc6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:19.061339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfa8fabd-6c26-461d-92c2-31123515dbc6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:19.062017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfa8fabd-6c26-461d-92c2-31123515dbc6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:19.062506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfa8fabd-6c26-461d-92c2-31123515dbc6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:19.062917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfa8fabd-6c26-461d-92c2-31123515dbc6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:19.202884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dfa8fabd-6c26-461d-92c2-31123515dbc6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:19.215218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dfa8fabd-6c26-461d-92c2-31123515dbc6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165709 Sep 13 20:11:19.216130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 684/1260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:19 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:19.737684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fa0c0208-8fb9-4058-b7af-a159a55e4a04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:19.739886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fa0c0208-8fb9-4058-b7af-a159a55e4a04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:19.747196 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa0c0208-8fb9-4058-b7af-a159a55e4a04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:19.747670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa0c0208-8fb9-4058-b7af-a159a55e4a04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:19.748267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa0c0208-8fb9-4058-b7af-a159a55e4a04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:19.748992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa0c0208-8fb9-4058-b7af-a159a55e4a04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:19.749424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa0c0208-8fb9-4058-b7af-a159a55e4a04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:19.749852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa0c0208-8fb9-4058-b7af-a159a55e4a04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:19.752805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:19.784244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fa0c0208-8fb9-4058-b7af-a159a55e4a04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050582 Sep 13 20:11:19.785179 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 577/1261] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:20.241551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-37cebafd-29a2-4da6-a38a-95f79ad4f496 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:20.242324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-37cebafd-29a2-4da6-a38a-95f79ad4f496 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:20.251303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37cebafd-29a2-4da6-a38a-95f79ad4f496 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:20.251904 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37cebafd-29a2-4da6-a38a-95f79ad4f496 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:20.252510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37cebafd-29a2-4da6-a38a-95f79ad4f496 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:20.253411 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37cebafd-29a2-4da6-a38a-95f79ad4f496 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:20.254011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37cebafd-29a2-4da6-a38a-95f79ad4f496 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:20.254607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37cebafd-29a2-4da6-a38a-95f79ad4f496 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:20.393848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-37cebafd-29a2-4da6-a38a-95f79ad4f496 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:20.406439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-37cebafd-29a2-4da6-a38a-95f79ad4f496 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.169768 Sep 13 20:11:20.407232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 685/1262] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:20 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:20.799574 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6e6b34d9-d463-4cbe-b526-9c39442b52fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:20.802404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6e6b34d9-d463-4cbe-b526-9c39442b52fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:20.811832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6e6b34d9-d463-4cbe-b526-9c39442b52fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:20.812303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6e6b34d9-d463-4cbe-b526-9c39442b52fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:20.812729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6e6b34d9-d463-4cbe-b526-9c39442b52fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:20.813412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6e6b34d9-d463-4cbe-b526-9c39442b52fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:20.813852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6e6b34d9-d463-4cbe-b526-9c39442b52fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:20.814266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6e6b34d9-d463-4cbe-b526-9c39442b52fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:20.846269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6e6b34d9-d463-4cbe-b526-9c39442b52fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052160 Sep 13 20:11:20.846875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 578/1263] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:21.430790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0b4219ec-33a4-4366-91dd-8d296463ec24 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:21.431380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0b4219ec-33a4-4366-91dd-8d296463ec24 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:21.438308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b4219ec-33a4-4366-91dd-8d296463ec24 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:21.438822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b4219ec-33a4-4366-91dd-8d296463ec24 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:21.439258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b4219ec-33a4-4366-91dd-8d296463ec24 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:21.439958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b4219ec-33a4-4366-91dd-8d296463ec24 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:21.440417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b4219ec-33a4-4366-91dd-8d296463ec24 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:21.440840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b4219ec-33a4-4366-91dd-8d296463ec24 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:21.579126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0b4219ec-33a4-4366-91dd-8d296463ec24 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:21.588352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0b4219ec-33a4-4366-91dd-8d296463ec24 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161750 Sep 13 20:11:21.588932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 686/1264] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:21 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:21.861989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e3bd4ad6-8add-4280-8cf8-a57387febd19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:21.864144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e3bd4ad6-8add-4280-8cf8-a57387febd19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:21.871096 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3bd4ad6-8add-4280-8cf8-a57387febd19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:21.871569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3bd4ad6-8add-4280-8cf8-a57387febd19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:21.872002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3bd4ad6-8add-4280-8cf8-a57387febd19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:21.872681 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3bd4ad6-8add-4280-8cf8-a57387febd19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:21.873120 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3bd4ad6-8add-4280-8cf8-a57387febd19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:21.873534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3bd4ad6-8add-4280-8cf8-a57387febd19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:21.905301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e3bd4ad6-8add-4280-8cf8-a57387febd19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047692 Sep 13 20:11:21.905860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 579/1265] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:21 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:22.614957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8f497b86-778c-4674-9438-4f5d0dde5439 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:22.615547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8f497b86-778c-4674-9438-4f5d0dde5439 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:22.617407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:22.623253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8f497b86-778c-4674-9438-4f5d0dde5439 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:22.623734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8f497b86-778c-4674-9438-4f5d0dde5439 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:22.624193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8f497b86-778c-4674-9438-4f5d0dde5439 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:22.624924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8f497b86-778c-4674-9438-4f5d0dde5439 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:22.625401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8f497b86-778c-4674-9438-4f5d0dde5439 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:22.625822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8f497b86-778c-4674-9438-4f5d0dde5439 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:22.766287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8f497b86-778c-4674-9438-4f5d0dde5439 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:22.768519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:22.775913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8f497b86-778c-4674-9438-4f5d0dde5439 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165456 Sep 13 20:11:22.776647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 687/1266] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:22 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:22.921596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-da135633-4102-4bad-99f5-72d6ae327a5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:22.924907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-da135633-4102-4bad-99f5-72d6ae327a5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:22.928392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=58 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:22.937296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da135633-4102-4bad-99f5-72d6ae327a5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:22.937777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da135633-4102-4bad-99f5-72d6ae327a5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:22.938208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da135633-4102-4bad-99f5-72d6ae327a5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:22.938934 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da135633-4102-4bad-99f5-72d6ae327a5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:22.939392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da135633-4102-4bad-99f5-72d6ae327a5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:22.939813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da135633-4102-4bad-99f5-72d6ae327a5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:22.971675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-da135633-4102-4bad-99f5-72d6ae327a5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056892 Sep 13 20:11:22.972273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 580/1267] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:23.800524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f27ea8e9-10b6-4061-bafd-980b717092ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:23.801170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f27ea8e9-10b6-4061-bafd-980b717092ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:23.807934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f27ea8e9-10b6-4061-bafd-980b717092ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:23.808413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f27ea8e9-10b6-4061-bafd-980b717092ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:23.808836 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f27ea8e9-10b6-4061-bafd-980b717092ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:23.809522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f27ea8e9-10b6-4061-bafd-980b717092ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:23.809966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f27ea8e9-10b6-4061-bafd-980b717092ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:23.810401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f27ea8e9-10b6-4061-bafd-980b717092ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:23.959783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f27ea8e9-10b6-4061-bafd-980b717092ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:23.968557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f27ea8e9-10b6-4061-bafd-980b717092ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.172187 Sep 13 20:11:23.969154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 688/1268] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:23 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:23.986757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7820307f-b30e-4b3f-b16b-61b29dd8b7be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:23.989046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7820307f-b30e-4b3f-b16b-61b29dd8b7be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:23.995663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7820307f-b30e-4b3f-b16b-61b29dd8b7be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:23.996144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7820307f-b30e-4b3f-b16b-61b29dd8b7be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:23.996567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7820307f-b30e-4b3f-b16b-61b29dd8b7be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:23.997248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7820307f-b30e-4b3f-b16b-61b29dd8b7be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:23.997717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7820307f-b30e-4b3f-b16b-61b29dd8b7be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:23.998127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7820307f-b30e-4b3f-b16b-61b29dd8b7be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:24.033155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7820307f-b30e-4b3f-b16b-61b29dd8b7be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051989 Sep 13 20:11:24.033954 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 581/1269] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:24.994090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-de3f6752-215a-4f18-9b0e-69a26bf9bbdc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:24.994717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-de3f6752-215a-4f18-9b0e-69a26bf9bbdc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:25.001335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de3f6752-215a-4f18-9b0e-69a26bf9bbdc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:25.001798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de3f6752-215a-4f18-9b0e-69a26bf9bbdc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:25.002213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de3f6752-215a-4f18-9b0e-69a26bf9bbdc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:25.002916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de3f6752-215a-4f18-9b0e-69a26bf9bbdc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:25.003352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de3f6752-215a-4f18-9b0e-69a26bf9bbdc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:25.003766 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de3f6752-215a-4f18-9b0e-69a26bf9bbdc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:25.052908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f4ae03e7-a062-4569-8bdc-6d39bfeaae0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:25.055575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f4ae03e7-a062-4569-8bdc-6d39bfeaae0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:25.062357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4ae03e7-a062-4569-8bdc-6d39bfeaae0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:25.062869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4ae03e7-a062-4569-8bdc-6d39bfeaae0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:25.063295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4ae03e7-a062-4569-8bdc-6d39bfeaae0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:25.064032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4ae03e7-a062-4569-8bdc-6d39bfeaae0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:25.064475 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4ae03e7-a062-4569-8bdc-6d39bfeaae0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:25.064890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4ae03e7-a062-4569-8bdc-6d39bfeaae0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:25.096244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f4ae03e7-a062-4569-8bdc-6d39bfeaae0e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047314 Sep 13 20:11:25.096849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 582/1270] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:25.138034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-de3f6752-215a-4f18-9b0e-69a26bf9bbdc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:25.146394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-de3f6752-215a-4f18-9b0e-69a26bf9bbdc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156183 Sep 13 20:11:25.146976 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 689/1271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:24 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:26.109262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f758a4ec-12b5-43fd-b92e-efa917243e9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:26.111449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f758a4ec-12b5-43fd-b92e-efa917243e9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:26.118157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f758a4ec-12b5-43fd-b92e-efa917243e9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:26.118670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f758a4ec-12b5-43fd-b92e-efa917243e9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:26.119094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f758a4ec-12b5-43fd-b92e-efa917243e9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:26.119774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f758a4ec-12b5-43fd-b92e-efa917243e9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:26.120211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f758a4ec-12b5-43fd-b92e-efa917243e9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:26.120630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f758a4ec-12b5-43fd-b92e-efa917243e9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:26.150095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f758a4ec-12b5-43fd-b92e-efa917243e9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045173 Sep 13 20:11:26.150665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 583/1272] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:26.169145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fb50fe87-84d4-4695-9688-93143fb4d381 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:26.169767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fb50fe87-84d4-4695-9688-93143fb4d381 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:26.176504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb50fe87-84d4-4695-9688-93143fb4d381 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:26.176994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb50fe87-84d4-4695-9688-93143fb4d381 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:26.177422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb50fe87-84d4-4695-9688-93143fb4d381 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:26.178114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb50fe87-84d4-4695-9688-93143fb4d381 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:26.178595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb50fe87-84d4-4695-9688-93143fb4d381 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:26.179015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb50fe87-84d4-4695-9688-93143fb4d381 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:26.310484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fb50fe87-84d4-4695-9688-93143fb4d381 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:26.319413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fb50fe87-84d4-4695-9688-93143fb4d381 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.154155 Sep 13 20:11:26.319982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 690/1273] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:26 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:27.166767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7f42745a-6115-45f0-a489-dd1171968243 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:27.170202 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7f42745a-6115-45f0-a489-dd1171968243 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:27.177963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f42745a-6115-45f0-a489-dd1171968243 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:27.178472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f42745a-6115-45f0-a489-dd1171968243 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:27.178899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f42745a-6115-45f0-a489-dd1171968243 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:27.179580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f42745a-6115-45f0-a489-dd1171968243 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:27.180022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f42745a-6115-45f0-a489-dd1171968243 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:27.180436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f42745a-6115-45f0-a489-dd1171968243 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:27.211956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7f42745a-6115-45f0-a489-dd1171968243 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051905 Sep 13 20:11:27.212545 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 584/1274] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:27 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:27.344246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d2d6aefb-555c-401a-9a9d-dbf600c460fd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:27.344862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d2d6aefb-555c-401a-9a9d-dbf600c460fd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:27.351868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2d6aefb-555c-401a-9a9d-dbf600c460fd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:27.352351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2d6aefb-555c-401a-9a9d-dbf600c460fd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:27.352782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2d6aefb-555c-401a-9a9d-dbf600c460fd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:27.353469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2d6aefb-555c-401a-9a9d-dbf600c460fd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:27.353922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2d6aefb-555c-401a-9a9d-dbf600c460fd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:27.354340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2d6aefb-555c-401a-9a9d-dbf600c460fd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:27.487853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d2d6aefb-555c-401a-9a9d-dbf600c460fd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:27.496420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d2d6aefb-555c-401a-9a9d-dbf600c460fd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156246 Sep 13 20:11:27.496996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 691/1275] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:27 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:28.228635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-94c53612-ce03-4267-981c-1bf79c4e016c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:28.230821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-94c53612-ce03-4267-981c-1bf79c4e016c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:28.237665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-94c53612-ce03-4267-981c-1bf79c4e016c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:28.238156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-94c53612-ce03-4267-981c-1bf79c4e016c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:28.238630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-94c53612-ce03-4267-981c-1bf79c4e016c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:28.240354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-94c53612-ce03-4267-981c-1bf79c4e016c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:28.240813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-94c53612-ce03-4267-981c-1bf79c4e016c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:28.241214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-94c53612-ce03-4267-981c-1bf79c4e016c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:28.272572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-94c53612-ce03-4267-981c-1bf79c4e016c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049628 Sep 13 20:11:28.273385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 585/1276] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:28.519828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-65a07080-c02d-4783-b44e-7166888a1994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:28.520432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-65a07080-c02d-4783-b44e-7166888a1994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:28.528603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-65a07080-c02d-4783-b44e-7166888a1994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:28.529083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-65a07080-c02d-4783-b44e-7166888a1994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:28.529517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-65a07080-c02d-4783-b44e-7166888a1994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:28.530206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-65a07080-c02d-4783-b44e-7166888a1994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:28.530685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-65a07080-c02d-4783-b44e-7166888a1994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:28.531106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-65a07080-c02d-4783-b44e-7166888a1994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:28.673681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-65a07080-c02d-4783-b44e-7166888a1994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:28.682190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-65a07080-c02d-4783-b44e-7166888a1994 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166290 Sep 13 20:11:28.682801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 692/1277] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:28 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:29.290636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6db1d599-1ac8-4923-9e3f-3f6655339b0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:29.294050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6db1d599-1ac8-4923-9e3f-3f6655339b0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:29.303523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6db1d599-1ac8-4923-9e3f-3f6655339b0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:29.304000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6db1d599-1ac8-4923-9e3f-3f6655339b0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:29.304424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6db1d599-1ac8-4923-9e3f-3f6655339b0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:29.305128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6db1d599-1ac8-4923-9e3f-3f6655339b0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:29.305577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6db1d599-1ac8-4923-9e3f-3f6655339b0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:29.305998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6db1d599-1ac8-4923-9e3f-3f6655339b0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:29.346084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6db1d599-1ac8-4923-9e3f-3f6655339b0c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062838 Sep 13 20:11:29.346687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 586/1278] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:29.707033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f2dc0629-68c3-4b28-8822-3acbf28ddd0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:29.707696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f2dc0629-68c3-4b28-8822-3acbf28ddd0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:29.715345 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2dc0629-68c3-4b28-8822-3acbf28ddd0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:29.715793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2dc0629-68c3-4b28-8822-3acbf28ddd0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:29.716248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2dc0629-68c3-4b28-8822-3acbf28ddd0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:29.716931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2dc0629-68c3-4b28-8822-3acbf28ddd0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:29.717370 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2dc0629-68c3-4b28-8822-3acbf28ddd0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:29.717784 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2dc0629-68c3-4b28-8822-3acbf28ddd0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:29.847570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f2dc0629-68c3-4b28-8822-3acbf28ddd0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:29.855880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f2dc0629-68c3-4b28-8822-3acbf28ddd0a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.154109 Sep 13 20:11:29.856443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 693/1279] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:29 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:30.362230 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0e5489f4-b24a-48d7-9771-8188c808f931 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:30.364474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0e5489f4-b24a-48d7-9771-8188c808f931 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:30.371388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0e5489f4-b24a-48d7-9771-8188c808f931 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:30.371870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0e5489f4-b24a-48d7-9771-8188c808f931 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:30.372305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0e5489f4-b24a-48d7-9771-8188c808f931 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:30.373003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0e5489f4-b24a-48d7-9771-8188c808f931 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:30.373456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0e5489f4-b24a-48d7-9771-8188c808f931 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:30.373876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0e5489f4-b24a-48d7-9771-8188c808f931 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:30.405524 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0e5489f4-b24a-48d7-9771-8188c808f931 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047414 Sep 13 20:11:30.406081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 587/1280] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:30 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:30.879178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a92a3f15-fb43-4120-b7b3-e807423b6c17 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:30.879777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a92a3f15-fb43-4120-b7b3-e807423b6c17 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:30.886617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a92a3f15-fb43-4120-b7b3-e807423b6c17 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:30.887091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a92a3f15-fb43-4120-b7b3-e807423b6c17 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:30.887510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a92a3f15-fb43-4120-b7b3-e807423b6c17 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:30.888181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a92a3f15-fb43-4120-b7b3-e807423b6c17 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:30.888622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a92a3f15-fb43-4120-b7b3-e807423b6c17 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:30.889039 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a92a3f15-fb43-4120-b7b3-e807423b6c17 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:31.027386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a92a3f15-fb43-4120-b7b3-e807423b6c17 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:31.036209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a92a3f15-fb43-4120-b7b3-e807423b6c17 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160987 Sep 13 20:11:31.036759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 694/1281] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:30 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:31.418660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0bad778c-c63e-45e9-a542-aab5e59cdbc0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:31.420889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0bad778c-c63e-45e9-a542-aab5e59cdbc0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:31.428900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0bad778c-c63e-45e9-a542-aab5e59cdbc0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:31.429431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0bad778c-c63e-45e9-a542-aab5e59cdbc0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:31.430056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0bad778c-c63e-45e9-a542-aab5e59cdbc0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:31.430787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0bad778c-c63e-45e9-a542-aab5e59cdbc0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:31.431234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0bad778c-c63e-45e9-a542-aab5e59cdbc0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:31.431649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0bad778c-c63e-45e9-a542-aab5e59cdbc0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:31.463557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0bad778c-c63e-45e9-a542-aab5e59cdbc0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049049 Sep 13 20:11:31.464121 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 588/1282] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:31 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:32.063396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-410e8460-53bc-49e9-88b7-543e42d1a64e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:32.064356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-410e8460-53bc-49e9-88b7-543e42d1a64e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:32.075444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-410e8460-53bc-49e9-88b7-543e42d1a64e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:32.076249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-410e8460-53bc-49e9-88b7-543e42d1a64e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:32.076962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-410e8460-53bc-49e9-88b7-543e42d1a64e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:32.078101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-410e8460-53bc-49e9-88b7-543e42d1a64e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:32.078881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-410e8460-53bc-49e9-88b7-543e42d1a64e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:32.079302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-410e8460-53bc-49e9-88b7-543e42d1a64e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:32.222273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-410e8460-53bc-49e9-88b7-543e42d1a64e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:32.230952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-410e8460-53bc-49e9-88b7-543e42d1a64e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.173981 Sep 13 20:11:32.231532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 695/1283] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:32 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:32.483116 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0c3cbb3e-eb56-440d-b000-852caa89e3f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:32.486632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0c3cbb3e-eb56-440d-b000-852caa89e3f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:32.497719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c3cbb3e-eb56-440d-b000-852caa89e3f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:32.498580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c3cbb3e-eb56-440d-b000-852caa89e3f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:32.499305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c3cbb3e-eb56-440d-b000-852caa89e3f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:32.500516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c3cbb3e-eb56-440d-b000-852caa89e3f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:32.500957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c3cbb3e-eb56-440d-b000-852caa89e3f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:32.501367 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c3cbb3e-eb56-440d-b000-852caa89e3f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:32.531092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0c3cbb3e-eb56-440d-b000-852caa89e3f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054693 Sep 13 20:11:32.531770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 589/1284] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:32 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:33.258066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b4b35243-9b61-48d4-be79-79f5a42dd8de tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:33.259115 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b4b35243-9b61-48d4-be79-79f5a42dd8de tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:33.269905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4b35243-9b61-48d4-be79-79f5a42dd8de tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:33.270768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4b35243-9b61-48d4-be79-79f5a42dd8de tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:33.271474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4b35243-9b61-48d4-be79-79f5a42dd8de tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:33.272595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4b35243-9b61-48d4-be79-79f5a42dd8de tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:33.273331 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4b35243-9b61-48d4-be79-79f5a42dd8de tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:33.274006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b4b35243-9b61-48d4-be79-79f5a42dd8de tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:33.413315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b4b35243-9b61-48d4-be79-79f5a42dd8de tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:33.422061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b4b35243-9b61-48d4-be79-79f5a42dd8de tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.170507 Sep 13 20:11:33.422645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 696/1285] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:33 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:33.549763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7b5777c7-214d-4cec-8a2a-fda509d305a3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:33.551898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7b5777c7-214d-4cec-8a2a-fda509d305a3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:33.558739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b5777c7-214d-4cec-8a2a-fda509d305a3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:33.559214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b5777c7-214d-4cec-8a2a-fda509d305a3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:33.559634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b5777c7-214d-4cec-8a2a-fda509d305a3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:33.560315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b5777c7-214d-4cec-8a2a-fda509d305a3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:33.560751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b5777c7-214d-4cec-8a2a-fda509d305a3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:33.561167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b5777c7-214d-4cec-8a2a-fda509d305a3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:33.592385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7b5777c7-214d-4cec-8a2a-fda509d305a3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047834 Sep 13 20:11:33.592947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 590/1286] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:33 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:34.449808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8379fe95-868b-413d-aa8c-b4d4e8cc1161 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:34.450790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8379fe95-868b-413d-aa8c-b4d4e8cc1161 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:34.459128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8379fe95-868b-413d-aa8c-b4d4e8cc1161 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:34.459608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8379fe95-868b-413d-aa8c-b4d4e8cc1161 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:34.460036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8379fe95-868b-413d-aa8c-b4d4e8cc1161 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:34.460723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8379fe95-868b-413d-aa8c-b4d4e8cc1161 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:34.461171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8379fe95-868b-413d-aa8c-b4d4e8cc1161 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:34.461588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8379fe95-868b-413d-aa8c-b4d4e8cc1161 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:34.596930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8379fe95-868b-413d-aa8c-b4d4e8cc1161 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:34.605084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7880e4c8-1875-46ad-b2ea-a81247ee744a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:34.605657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8379fe95-868b-413d-aa8c-b4d4e8cc1161 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162947 Sep 13 20:11:34.606259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 697/1287] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:34 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:34.607581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7880e4c8-1875-46ad-b2ea-a81247ee744a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:34.614200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7880e4c8-1875-46ad-b2ea-a81247ee744a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:34.614742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7880e4c8-1875-46ad-b2ea-a81247ee744a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:34.615182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7880e4c8-1875-46ad-b2ea-a81247ee744a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:34.615869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7880e4c8-1875-46ad-b2ea-a81247ee744a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:34.616316 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7880e4c8-1875-46ad-b2ea-a81247ee744a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:34.616737 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7880e4c8-1875-46ad-b2ea-a81247ee744a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:34.802198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7880e4c8-1875-46ad-b2ea-a81247ee744a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201287 Sep 13 20:11:34.802790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 591/1288] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:34 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:11:35.629143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a52cce63-e4fb-4985-8741-4aa3c6bc5557 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:35.629730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a52cce63-e4fb-4985-8741-4aa3c6bc5557 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:35.636614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a52cce63-e4fb-4985-8741-4aa3c6bc5557 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:35.637092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a52cce63-e4fb-4985-8741-4aa3c6bc5557 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:35.637521 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a52cce63-e4fb-4985-8741-4aa3c6bc5557 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:35.638206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a52cce63-e4fb-4985-8741-4aa3c6bc5557 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:35.638689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a52cce63-e4fb-4985-8741-4aa3c6bc5557 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:35.639105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a52cce63-e4fb-4985-8741-4aa3c6bc5557 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:35.774161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a52cce63-e4fb-4985-8741-4aa3c6bc5557 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:35.782819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a52cce63-e4fb-4985-8741-4aa3c6bc5557 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.157745 Sep 13 20:11:35.783363 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 698/1289] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:35 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:35.823529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-23c6b01a-1912-4bda-a7d1-99949ed15674 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:35.823529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-23c6b01a-1912-4bda-a7d1-99949ed15674 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:35.824297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23c6b01a-1912-4bda-a7d1-99949ed15674 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:35.824807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23c6b01a-1912-4bda-a7d1-99949ed15674 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:35.825240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23c6b01a-1912-4bda-a7d1-99949ed15674 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:35.825932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23c6b01a-1912-4bda-a7d1-99949ed15674 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:35.826396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23c6b01a-1912-4bda-a7d1-99949ed15674 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:35.826860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23c6b01a-1912-4bda-a7d1-99949ed15674 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:35.859158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-23c6b01a-1912-4bda-a7d1-99949ed15674 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047743 Sep 13 20:11:35.859622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 592/1290] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:35 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:36.815357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-446b5a71-eb2a-4972-a446-bc046dd0d8f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:36.816335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-446b5a71-eb2a-4972-a446-bc046dd0d8f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:36.827188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-446b5a71-eb2a-4972-a446-bc046dd0d8f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:36.827875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-446b5a71-eb2a-4972-a446-bc046dd0d8f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:36.828586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-446b5a71-eb2a-4972-a446-bc046dd0d8f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:36.829711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-446b5a71-eb2a-4972-a446-bc046dd0d8f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:36.830401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-446b5a71-eb2a-4972-a446-bc046dd0d8f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:36.830833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-446b5a71-eb2a-4972-a446-bc046dd0d8f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:36.872100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-762dc68d-7fd0-4c37-9dab-1d02c22602c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:36.875076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-762dc68d-7fd0-4c37-9dab-1d02c22602c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:36.882406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-762dc68d-7fd0-4c37-9dab-1d02c22602c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:36.882964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-762dc68d-7fd0-4c37-9dab-1d02c22602c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:36.883390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-762dc68d-7fd0-4c37-9dab-1d02c22602c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:36.884097 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-762dc68d-7fd0-4c37-9dab-1d02c22602c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:36.884543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-762dc68d-7fd0-4c37-9dab-1d02c22602c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:36.884969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-762dc68d-7fd0-4c37-9dab-1d02c22602c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:36.911651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:36.919326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-762dc68d-7fd0-4c37-9dab-1d02c22602c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051111 Sep 13 20:11:36.919905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 593/1291] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:36 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:37.158982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-446b5a71-eb2a-4972-a446-bc046dd0d8f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:37.167264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-446b5a71-eb2a-4972-a446-bc046dd0d8f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.358558 Sep 13 20:11:37.167848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 699/1292] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:36 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:37.936018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a32bf829-bba8-4c66-9955-1da1d8fb1885 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:37.939586 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a32bf829-bba8-4c66-9955-1da1d8fb1885 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:37.946942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a32bf829-bba8-4c66-9955-1da1d8fb1885 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:37.947446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a32bf829-bba8-4c66-9955-1da1d8fb1885 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:37.947905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a32bf829-bba8-4c66-9955-1da1d8fb1885 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:37.948664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a32bf829-bba8-4c66-9955-1da1d8fb1885 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:37.949138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a32bf829-bba8-4c66-9955-1da1d8fb1885 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:37.949584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a32bf829-bba8-4c66-9955-1da1d8fb1885 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:37.980637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a32bf829-bba8-4c66-9955-1da1d8fb1885 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051500 Sep 13 20:11:37.981171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 594/1293] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:37 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:38.194901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-47e30b8f-6146-471f-8e22-f4b56cb3873b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:38.195751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-47e30b8f-6146-471f-8e22-f4b56cb3873b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:38.206201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-47e30b8f-6146-471f-8e22-f4b56cb3873b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:38.206707 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-47e30b8f-6146-471f-8e22-f4b56cb3873b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:38.207133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-47e30b8f-6146-471f-8e22-f4b56cb3873b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:38.207817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-47e30b8f-6146-471f-8e22-f4b56cb3873b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:38.208261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-47e30b8f-6146-471f-8e22-f4b56cb3873b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:38.209042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-47e30b8f-6146-471f-8e22-f4b56cb3873b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:38.336308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-47e30b8f-6146-471f-8e22-f4b56cb3873b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:38.345055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-47e30b8f-6146-471f-8e22-f4b56cb3873b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156885 Sep 13 20:11:38.345635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 700/1294] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:38 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:38.997385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-54ca613b-c2de-4d50-8531-2d1d8d5644b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:39.000882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-54ca613b-c2de-4d50-8531-2d1d8d5644b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:39.011642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-54ca613b-c2de-4d50-8531-2d1d8d5644b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:39.012484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-54ca613b-c2de-4d50-8531-2d1d8d5644b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:39.013192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-54ca613b-c2de-4d50-8531-2d1d8d5644b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:39.014308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-54ca613b-c2de-4d50-8531-2d1d8d5644b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:39.015098 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-54ca613b-c2de-4d50-8531-2d1d8d5644b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:39.015787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-54ca613b-c2de-4d50-8531-2d1d8d5644b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:39.046247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-54ca613b-c2de-4d50-8531-2d1d8d5644b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055573 Sep 13 20:11:39.046828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 595/1295] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:38 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:39.369008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ba933529-02b6-4726-a174-2309a0331d9b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:39.369701 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ba933529-02b6-4726-a174-2309a0331d9b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:39.376283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba933529-02b6-4726-a174-2309a0331d9b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:39.376750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba933529-02b6-4726-a174-2309a0331d9b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:39.377189 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba933529-02b6-4726-a174-2309a0331d9b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:39.377870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba933529-02b6-4726-a174-2309a0331d9b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:39.378391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba933529-02b6-4726-a174-2309a0331d9b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:39.378806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba933529-02b6-4726-a174-2309a0331d9b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:39.517984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ba933529-02b6-4726-a174-2309a0331d9b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:39.526228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ba933529-02b6-4726-a174-2309a0331d9b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161176 Sep 13 20:11:39.526848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 701/1296] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:39 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:40.063044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f0a30aab-3f26-4f4c-b871-602879b91739 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:40.066433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f0a30aab-3f26-4f4c-b871-602879b91739 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:40.076315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f0a30aab-3f26-4f4c-b871-602879b91739 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:40.076949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f0a30aab-3f26-4f4c-b871-602879b91739 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:40.077571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f0a30aab-3f26-4f4c-b871-602879b91739 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:40.078573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f0a30aab-3f26-4f4c-b871-602879b91739 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:40.079201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f0a30aab-3f26-4f4c-b871-602879b91739 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:40.079703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f0a30aab-3f26-4f4c-b871-602879b91739 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:40.115730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f0a30aab-3f26-4f4c-b871-602879b91739 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059339 Sep 13 20:11:40.116204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 596/1297] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:40 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:40.555113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f395138f-9e76-42de-93f8-c2ad446f1756 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:40.555822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f395138f-9e76-42de-93f8-c2ad446f1756 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:40.562842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f395138f-9e76-42de-93f8-c2ad446f1756 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:40.563325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f395138f-9e76-42de-93f8-c2ad446f1756 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:40.563764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f395138f-9e76-42de-93f8-c2ad446f1756 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:40.564455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f395138f-9e76-42de-93f8-c2ad446f1756 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:40.564905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f395138f-9e76-42de-93f8-c2ad446f1756 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:40.565323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f395138f-9e76-42de-93f8-c2ad446f1756 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:40.694197 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f395138f-9e76-42de-93f8-c2ad446f1756 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:40.702964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f395138f-9e76-42de-93f8-c2ad446f1756 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.151988 Sep 13 20:11:40.703543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 702/1298] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:40 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:41.131263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-58228663-b2b1-4dae-a000-0570088aa80f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:41.134415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-58228663-b2b1-4dae-a000-0570088aa80f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:41.144620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58228663-b2b1-4dae-a000-0570088aa80f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:41.145104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58228663-b2b1-4dae-a000-0570088aa80f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:41.145542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58228663-b2b1-4dae-a000-0570088aa80f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:41.146229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58228663-b2b1-4dae-a000-0570088aa80f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:41.146711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58228663-b2b1-4dae-a000-0570088aa80f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:41.147130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58228663-b2b1-4dae-a000-0570088aa80f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:41.178767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-58228663-b2b1-4dae-a000-0570088aa80f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054057 Sep 13 20:11:41.179240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 597/1299] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:41 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:41.730348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d2e9ad7a-8a0c-4b0e-8f8f-a5e90a9b7b20 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:41.731288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d2e9ad7a-8a0c-4b0e-8f8f-a5e90a9b7b20 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:41.740666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2e9ad7a-8a0c-4b0e-8f8f-a5e90a9b7b20 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:41.741141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2e9ad7a-8a0c-4b0e-8f8f-a5e90a9b7b20 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:41.741570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2e9ad7a-8a0c-4b0e-8f8f-a5e90a9b7b20 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:41.742251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2e9ad7a-8a0c-4b0e-8f8f-a5e90a9b7b20 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:41.742730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2e9ad7a-8a0c-4b0e-8f8f-a5e90a9b7b20 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:41.743147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2e9ad7a-8a0c-4b0e-8f8f-a5e90a9b7b20 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:41.884063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d2e9ad7a-8a0c-4b0e-8f8f-a5e90a9b7b20 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:41.894043 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d2e9ad7a-8a0c-4b0e-8f8f-a5e90a9b7b20 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.169983 Sep 13 20:11:41.894634 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 703/1300] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:41 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:42.194414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f8356e2a-75f5-46af-89d3-8cd861ef58f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:42.197135 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f8356e2a-75f5-46af-89d3-8cd861ef58f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:42.205525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8356e2a-75f5-46af-89d3-8cd861ef58f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:42.206118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8356e2a-75f5-46af-89d3-8cd861ef58f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:42.206726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8356e2a-75f5-46af-89d3-8cd861ef58f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:42.207571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8356e2a-75f5-46af-89d3-8cd861ef58f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:42.208119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8356e2a-75f5-46af-89d3-8cd861ef58f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:42.208991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8356e2a-75f5-46af-89d3-8cd861ef58f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:42.240578 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f8356e2a-75f5-46af-89d3-8cd861ef58f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051796 Sep 13 20:11:42.241105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 598/1301] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:42 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:42.921591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ef9d3233-18a5-451e-aa7a-21d76e4fd01b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:42.922475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ef9d3233-18a5-451e-aa7a-21d76e4fd01b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:42.933677 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef9d3233-18a5-451e-aa7a-21d76e4fd01b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:42.934520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef9d3233-18a5-451e-aa7a-21d76e4fd01b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:42.935234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef9d3233-18a5-451e-aa7a-21d76e4fd01b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:42.936461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef9d3233-18a5-451e-aa7a-21d76e4fd01b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:42.937212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef9d3233-18a5-451e-aa7a-21d76e4fd01b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:42.937901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef9d3233-18a5-451e-aa7a-21d76e4fd01b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:42.954216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:43.077052 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ef9d3233-18a5-451e-aa7a-21d76e4fd01b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:43.086005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ef9d3233-18a5-451e-aa7a-21d76e4fd01b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.171189 Sep 13 20:11:43.086600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 704/1302] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:42 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:43.257542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-09454b55-c5d4-48ab-a8e0-2e5ddf119767 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:43.261085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-09454b55-c5d4-48ab-a8e0-2e5ddf119767 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:43.270988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09454b55-c5d4-48ab-a8e0-2e5ddf119767 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:43.271467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09454b55-c5d4-48ab-a8e0-2e5ddf119767 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:43.271905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09454b55-c5d4-48ab-a8e0-2e5ddf119767 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:43.272601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09454b55-c5d4-48ab-a8e0-2e5ddf119767 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:43.273050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09454b55-c5d4-48ab-a8e0-2e5ddf119767 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:43.273481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09454b55-c5d4-48ab-a8e0-2e5ddf119767 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:43.303837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-09454b55-c5d4-48ab-a8e0-2e5ddf119767 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053112 Sep 13 20:11:43.304393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 599/1303] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:43 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:44.113248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5f407723-a144-41d9-b24e-c3f2740d1060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:44.114440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5f407723-a144-41d9-b24e-c3f2740d1060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:44.120878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f407723-a144-41d9-b24e-c3f2740d1060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:44.121359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f407723-a144-41d9-b24e-c3f2740d1060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:44.121785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f407723-a144-41d9-b24e-c3f2740d1060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:44.122505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f407723-a144-41d9-b24e-c3f2740d1060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:44.122954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f407723-a144-41d9-b24e-c3f2740d1060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:44.123371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f407723-a144-41d9-b24e-c3f2740d1060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:44.254970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5f407723-a144-41d9-b24e-c3f2740d1060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:44.268321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5f407723-a144-41d9-b24e-c3f2740d1060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161235 Sep 13 20:11:44.269098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 705/1304] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:44 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:44.317295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bbc10285-dd2b-4836-8a06-5e541000b996 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:44.319497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bbc10285-dd2b-4836-8a06-5e541000b996 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:44.326004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bbc10285-dd2b-4836-8a06-5e541000b996 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:44.326509 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bbc10285-dd2b-4836-8a06-5e541000b996 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:44.326944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bbc10285-dd2b-4836-8a06-5e541000b996 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:44.327629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bbc10285-dd2b-4836-8a06-5e541000b996 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:44.328083 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bbc10285-dd2b-4836-8a06-5e541000b996 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:44.328496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bbc10285-dd2b-4836-8a06-5e541000b996 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:44.357912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bbc10285-dd2b-4836-8a06-5e541000b996 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Sep 13 20:11:44.358403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 600/1305] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:44 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:45.296444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b98e0d6d-f13a-43f8-b59f-de02f9b3cf93 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:45.296444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b98e0d6d-f13a-43f8-b59f-de02f9b3cf93 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:45.306967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b98e0d6d-f13a-43f8-b59f-de02f9b3cf93 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:45.307755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b98e0d6d-f13a-43f8-b59f-de02f9b3cf93 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:45.308478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b98e0d6d-f13a-43f8-b59f-de02f9b3cf93 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:45.309607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b98e0d6d-f13a-43f8-b59f-de02f9b3cf93 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:45.310353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b98e0d6d-f13a-43f8-b59f-de02f9b3cf93 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:45.311100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b98e0d6d-f13a-43f8-b59f-de02f9b3cf93 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:45.370578 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9bb967e2-518e-41a6-b1ee-0ab2ac2f4327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:45.372722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9bb967e2-518e-41a6-b1ee-0ab2ac2f4327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:45.379580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9bb967e2-518e-41a6-b1ee-0ab2ac2f4327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:45.380200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9bb967e2-518e-41a6-b1ee-0ab2ac2f4327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:45.380649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9bb967e2-518e-41a6-b1ee-0ab2ac2f4327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:45.381346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9bb967e2-518e-41a6-b1ee-0ab2ac2f4327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:45.381799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9bb967e2-518e-41a6-b1ee-0ab2ac2f4327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:45.382225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9bb967e2-518e-41a6-b1ee-0ab2ac2f4327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:45.412592 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9bb967e2-518e-41a6-b1ee-0ab2ac2f4327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046034 Sep 13 20:11:45.413160 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 601/1306] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:45 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:45.443980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b98e0d6d-f13a-43f8-b59f-de02f9b3cf93 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:45.455060 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b98e0d6d-f13a-43f8-b59f-de02f9b3cf93 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166040 Sep 13 20:11:45.455638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 706/1307] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:45 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:46.429617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-12c41845-b1c8-4eab-8c91-b4ab7bbf109f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:46.433228 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-12c41845-b1c8-4eab-8c91-b4ab7bbf109f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:46.444317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12c41845-b1c8-4eab-8c91-b4ab7bbf109f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:46.445114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12c41845-b1c8-4eab-8c91-b4ab7bbf109f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:46.445838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12c41845-b1c8-4eab-8c91-b4ab7bbf109f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:46.447065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12c41845-b1c8-4eab-8c91-b4ab7bbf109f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:46.447849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12c41845-b1c8-4eab-8c91-b4ab7bbf109f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:46.448560 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12c41845-b1c8-4eab-8c91-b4ab7bbf109f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:46.478820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-926a1304-6fb0-4205-877d-e2b3049099a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:46.479571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-926a1304-6fb0-4205-877d-e2b3049099a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:46.483638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-12c41845-b1c8-4eab-8c91-b4ab7bbf109f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060999 Sep 13 20:11:46.484401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 602/1308] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:46 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:46.486790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-926a1304-6fb0-4205-877d-e2b3049099a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:46.487279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-926a1304-6fb0-4205-877d-e2b3049099a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:46.487718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-926a1304-6fb0-4205-877d-e2b3049099a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:46.488412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-926a1304-6fb0-4205-877d-e2b3049099a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:46.489009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-926a1304-6fb0-4205-877d-e2b3049099a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:46.489429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-926a1304-6fb0-4205-877d-e2b3049099a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:46.627138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-926a1304-6fb0-4205-877d-e2b3049099a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:46.635842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-926a1304-6fb0-4205-877d-e2b3049099a0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160884 Sep 13 20:11:46.636369 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 707/1309] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:46 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:47.501356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7cc187c9-42ab-4200-82ee-a9cf7a0b4666 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:47.504830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7cc187c9-42ab-4200-82ee-a9cf7a0b4666 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:47.512251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cc187c9-42ab-4200-82ee-a9cf7a0b4666 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:47.512788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cc187c9-42ab-4200-82ee-a9cf7a0b4666 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:47.513267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cc187c9-42ab-4200-82ee-a9cf7a0b4666 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:47.514034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cc187c9-42ab-4200-82ee-a9cf7a0b4666 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:47.514568 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cc187c9-42ab-4200-82ee-a9cf7a0b4666 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:47.515042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7cc187c9-42ab-4200-82ee-a9cf7a0b4666 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:47.548812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7cc187c9-42ab-4200-82ee-a9cf7a0b4666 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054007 Sep 13 20:11:47.549286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 603/1310] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:47 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:47.662622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cfdcb0d9-8212-4757-9441-96f07580bbb3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:47.663334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cfdcb0d9-8212-4757-9441-96f07580bbb3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:47.671397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cfdcb0d9-8212-4757-9441-96f07580bbb3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:47.671954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cfdcb0d9-8212-4757-9441-96f07580bbb3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:47.672465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cfdcb0d9-8212-4757-9441-96f07580bbb3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:47.673271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cfdcb0d9-8212-4757-9441-96f07580bbb3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:47.673802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cfdcb0d9-8212-4757-9441-96f07580bbb3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:47.674297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cfdcb0d9-8212-4757-9441-96f07580bbb3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:47.821423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cfdcb0d9-8212-4757-9441-96f07580bbb3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:47.830002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cfdcb0d9-8212-4757-9441-96f07580bbb3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.173428 Sep 13 20:11:47.830604 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 708/1311] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:47 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:48.562183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-79df0c28-d94b-4358-a6d0-29559b3d54e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:48.564768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-79df0c28-d94b-4358-a6d0-29559b3d54e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:48.572387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79df0c28-d94b-4358-a6d0-29559b3d54e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:48.573353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79df0c28-d94b-4358-a6d0-29559b3d54e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:48.573353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79df0c28-d94b-4358-a6d0-29559b3d54e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:48.574147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79df0c28-d94b-4358-a6d0-29559b3d54e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:48.574682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79df0c28-d94b-4358-a6d0-29559b3d54e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:48.575156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79df0c28-d94b-4358-a6d0-29559b3d54e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:48.606139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-79df0c28-d94b-4358-a6d0-29559b3d54e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048475 Sep 13 20:11:48.606718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 604/1312] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:48 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:48.858070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-29dcad66-b8ea-4d4f-ba2b-47ff0db4537b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:48.859203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-29dcad66-b8ea-4d4f-ba2b-47ff0db4537b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:48.869852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29dcad66-b8ea-4d4f-ba2b-47ff0db4537b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:48.870674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29dcad66-b8ea-4d4f-ba2b-47ff0db4537b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:48.871404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29dcad66-b8ea-4d4f-ba2b-47ff0db4537b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:48.872517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29dcad66-b8ea-4d4f-ba2b-47ff0db4537b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:48.873249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29dcad66-b8ea-4d4f-ba2b-47ff0db4537b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:48.873936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-29dcad66-b8ea-4d4f-ba2b-47ff0db4537b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:49.005390 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-29dcad66-b8ea-4d4f-ba2b-47ff0db4537b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:49.014225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-29dcad66-b8ea-4d4f-ba2b-47ff0db4537b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162593 Sep 13 20:11:49.014836 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 709/1313] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:48 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:49.621084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-416bbfc1-67df-4164-a8d9-758027b346ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:49.624597 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-416bbfc1-67df-4164-a8d9-758027b346ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:49.636236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-416bbfc1-67df-4164-a8d9-758027b346ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:49.636993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-416bbfc1-67df-4164-a8d9-758027b346ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:49.637698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-416bbfc1-67df-4164-a8d9-758027b346ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:49.638901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-416bbfc1-67df-4164-a8d9-758027b346ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:49.639637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-416bbfc1-67df-4164-a8d9-758027b346ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:49.640310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-416bbfc1-67df-4164-a8d9-758027b346ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:49.678405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-416bbfc1-67df-4164-a8d9-758027b346ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063046 Sep 13 20:11:49.678985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 605/1314] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:49 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:50.041514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8b5c0ca2-5dc6-4191-ab04-cbd669266464 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:50.042502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8b5c0ca2-5dc6-4191-ab04-cbd669266464 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:50.053285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b5c0ca2-5dc6-4191-ab04-cbd669266464 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:50.053756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b5c0ca2-5dc6-4191-ab04-cbd669266464 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:50.054292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b5c0ca2-5dc6-4191-ab04-cbd669266464 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:50.054975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b5c0ca2-5dc6-4191-ab04-cbd669266464 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:50.055418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b5c0ca2-5dc6-4191-ab04-cbd669266464 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:50.055825 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b5c0ca2-5dc6-4191-ab04-cbd669266464 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:50.191812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8b5c0ca2-5dc6-4191-ab04-cbd669266464 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:50.200489 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8b5c0ca2-5dc6-4191-ab04-cbd669266464 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165385 Sep 13 20:11:50.201054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 710/1315] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:50 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:50.694986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0956fff9-fd22-4b22-8f1e-3e796da41736 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:50.698543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0956fff9-fd22-4b22-8f1e-3e796da41736 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:50.709819 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0956fff9-fd22-4b22-8f1e-3e796da41736 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:50.710297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0956fff9-fd22-4b22-8f1e-3e796da41736 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:50.710778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0956fff9-fd22-4b22-8f1e-3e796da41736 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:50.711468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0956fff9-fd22-4b22-8f1e-3e796da41736 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:50.711917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0956fff9-fd22-4b22-8f1e-3e796da41736 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:50.712338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0956fff9-fd22-4b22-8f1e-3e796da41736 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:50.742094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0956fff9-fd22-4b22-8f1e-3e796da41736 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053750 Sep 13 20:11:50.742594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 606/1316] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:50 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:51.223903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3bdd95f5-3106-4703-9d5e-0d7028d49ce9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:51.224538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3bdd95f5-3106-4703-9d5e-0d7028d49ce9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:51.231464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3bdd95f5-3106-4703-9d5e-0d7028d49ce9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:51.231946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3bdd95f5-3106-4703-9d5e-0d7028d49ce9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:51.232374 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3bdd95f5-3106-4703-9d5e-0d7028d49ce9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:51.233046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3bdd95f5-3106-4703-9d5e-0d7028d49ce9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:51.233516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3bdd95f5-3106-4703-9d5e-0d7028d49ce9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:51.233939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3bdd95f5-3106-4703-9d5e-0d7028d49ce9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:51.375669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3bdd95f5-3106-4703-9d5e-0d7028d49ce9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:51.384269 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3bdd95f5-3106-4703-9d5e-0d7028d49ce9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164256 Sep 13 20:11:51.385045 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 711/1317] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:51 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:51.761394 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4adaeedd-9800-4c7d-9731-1c863e88d705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:51.764925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4adaeedd-9800-4c7d-9731-1c863e88d705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:51.774528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4adaeedd-9800-4c7d-9731-1c863e88d705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:51.775014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4adaeedd-9800-4c7d-9731-1c863e88d705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:51.775448 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4adaeedd-9800-4c7d-9731-1c863e88d705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:51.776141 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4adaeedd-9800-4c7d-9731-1c863e88d705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:51.776588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4adaeedd-9800-4c7d-9731-1c863e88d705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:51.777011 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4adaeedd-9800-4c7d-9731-1c863e88d705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:51.806910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4adaeedd-9800-4c7d-9731-1c863e88d705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052298 Sep 13 20:11:51.807375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 607/1318] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:51 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:52.412904 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c96c1cd3-0857-430b-9021-144a7e841512 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:52.413847 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c96c1cd3-0857-430b-9021-144a7e841512 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:52.424924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c96c1cd3-0857-430b-9021-144a7e841512 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:52.425709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c96c1cd3-0857-430b-9021-144a7e841512 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:52.427096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c96c1cd3-0857-430b-9021-144a7e841512 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:52.428404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c96c1cd3-0857-430b-9021-144a7e841512 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:52.428868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c96c1cd3-0857-430b-9021-144a7e841512 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:52.429286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c96c1cd3-0857-430b-9021-144a7e841512 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:52.570626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c96c1cd3-0857-430b-9021-144a7e841512 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:52.577535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c96c1cd3-0857-430b-9021-144a7e841512 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.171180 Sep 13 20:11:52.578112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 712/1319] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:52 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:52.823713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8f727a12-31b3-4eca-8db3-56c5ef55eb6d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:52.827331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8f727a12-31b3-4eca-8db3-56c5ef55eb6d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:52.838910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f727a12-31b3-4eca-8db3-56c5ef55eb6d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:52.839712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f727a12-31b3-4eca-8db3-56c5ef55eb6d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:52.840441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f727a12-31b3-4eca-8db3-56c5ef55eb6d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:52.841676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f727a12-31b3-4eca-8db3-56c5ef55eb6d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:52.842439 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f727a12-31b3-4eca-8db3-56c5ef55eb6d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:52.843251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f727a12-31b3-4eca-8db3-56c5ef55eb6d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:52.875572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8f727a12-31b3-4eca-8db3-56c5ef55eb6d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058727 Sep 13 20:11:52.876119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 608/1320] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:52 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:53.601279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8e6cb3a2-f09e-4200-a2d9-92556c57f4c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:53.602003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8e6cb3a2-f09e-4200-a2d9-92556c57f4c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:53.604405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:53.610058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e6cb3a2-f09e-4200-a2d9-92556c57f4c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:53.610575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e6cb3a2-f09e-4200-a2d9-92556c57f4c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:53.611005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e6cb3a2-f09e-4200-a2d9-92556c57f4c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:53.611694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e6cb3a2-f09e-4200-a2d9-92556c57f4c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:53.612205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e6cb3a2-f09e-4200-a2d9-92556c57f4c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:53.612565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e6cb3a2-f09e-4200-a2d9-92556c57f4c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:53.744533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8e6cb3a2-f09e-4200-a2d9-92556c57f4c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:53.753083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8e6cb3a2-f09e-4200-a2d9-92556c57f4c8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155757 Sep 13 20:11:53.753624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 713/1321] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:53 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:53.893071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e8e0da80-2a30-4a25-bd64-740616ba6831 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:53.896531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e8e0da80-2a30-4a25-bd64-740616ba6831 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:53.899660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=58 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:53.905242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8e0da80-2a30-4a25-bd64-740616ba6831 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:53.905721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8e0da80-2a30-4a25-bd64-740616ba6831 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:53.906159 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8e0da80-2a30-4a25-bd64-740616ba6831 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:53.906885 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8e0da80-2a30-4a25-bd64-740616ba6831 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:53.907336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8e0da80-2a30-4a25-bd64-740616ba6831 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:53.907759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8e0da80-2a30-4a25-bd64-740616ba6831 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:53.938190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e8e0da80-2a30-4a25-bd64-740616ba6831 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051971 Sep 13 20:11:53.938789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 609/1322] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:53 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:54.776312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c383f9c4-a290-4bce-8682-9e0cf3a31fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:54.776916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c383f9c4-a290-4bce-8682-9e0cf3a31fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:54.783691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c383f9c4-a290-4bce-8682-9e0cf3a31fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:54.784164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c383f9c4-a290-4bce-8682-9e0cf3a31fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:54.784585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c383f9c4-a290-4bce-8682-9e0cf3a31fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:54.785266 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c383f9c4-a290-4bce-8682-9e0cf3a31fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:54.785701 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c383f9c4-a290-4bce-8682-9e0cf3a31fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:54.786130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c383f9c4-a290-4bce-8682-9e0cf3a31fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:54.919980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c383f9c4-a290-4bce-8682-9e0cf3a31fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:54.928507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c383f9c4-a290-4bce-8682-9e0cf3a31fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156014 Sep 13 20:11:54.929080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 714/1323] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:54 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:54.951028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-39a524d9-0a5a-45e0-a2e2-1f63c796c091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:54.953209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-39a524d9-0a5a-45e0-a2e2-1f63c796c091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:54.960341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39a524d9-0a5a-45e0-a2e2-1f63c796c091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:54.960813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39a524d9-0a5a-45e0-a2e2-1f63c796c091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:54.961241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39a524d9-0a5a-45e0-a2e2-1f63c796c091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:54.961915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39a524d9-0a5a-45e0-a2e2-1f63c796c091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:54.962350 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39a524d9-0a5a-45e0-a2e2-1f63c796c091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:54.962796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39a524d9-0a5a-45e0-a2e2-1f63c796c091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:54.976195 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:54.992723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-39a524d9-0a5a-45e0-a2e2-1f63c796c091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Sep 13 20:11:54.993271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 610/1324] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:54 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:55.955829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-225bf8d5-360e-4c8f-b2f9-907de7fe3709 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:55.956850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-225bf8d5-360e-4c8f-b2f9-907de7fe3709 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:55.965721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-225bf8d5-360e-4c8f-b2f9-907de7fe3709 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:55.966210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-225bf8d5-360e-4c8f-b2f9-907de7fe3709 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:55.966666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-225bf8d5-360e-4c8f-b2f9-907de7fe3709 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:55.967354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-225bf8d5-360e-4c8f-b2f9-907de7fe3709 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:55.967807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-225bf8d5-360e-4c8f-b2f9-907de7fe3709 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:55.968225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-225bf8d5-360e-4c8f-b2f9-907de7fe3709 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:56.008809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a7607614-544d-4405-b3d3-8ca4def72a3b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:56.011525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a7607614-544d-4405-b3d3-8ca4def72a3b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:56.018890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a7607614-544d-4405-b3d3-8ca4def72a3b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:56.019355 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a7607614-544d-4405-b3d3-8ca4def72a3b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:56.019795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a7607614-544d-4405-b3d3-8ca4def72a3b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:56.020492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a7607614-544d-4405-b3d3-8ca4def72a3b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:56.020943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a7607614-544d-4405-b3d3-8ca4def72a3b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:56.021364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a7607614-544d-4405-b3d3-8ca4def72a3b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:56.051960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a7607614-544d-4405-b3d3-8ca4def72a3b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049522 Sep 13 20:11:56.052759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 611/1325] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:56 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:56.104749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-225bf8d5-360e-4c8f-b2f9-907de7fe3709 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:56.112973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-225bf8d5-360e-4c8f-b2f9-907de7fe3709 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163728 Sep 13 20:11:56.113568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 715/1326] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:55 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:57.068992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-26ba8fbd-c2b2-497b-9907-4aa1b93303b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:57.072050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-26ba8fbd-c2b2-497b-9907-4aa1b93303b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:57.078886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26ba8fbd-c2b2-497b-9907-4aa1b93303b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:57.079371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26ba8fbd-c2b2-497b-9907-4aa1b93303b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:57.079800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26ba8fbd-c2b2-497b-9907-4aa1b93303b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:57.080494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26ba8fbd-c2b2-497b-9907-4aa1b93303b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:57.080952 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26ba8fbd-c2b2-497b-9907-4aa1b93303b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:57.081364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26ba8fbd-c2b2-497b-9907-4aa1b93303b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:57.112830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-26ba8fbd-c2b2-497b-9907-4aa1b93303b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050436 Sep 13 20:11:57.113381 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 612/1327] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:57 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:57.136613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-00386fdd-f081-4b39-a7a7-b5f282289624 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:57.137146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-00386fdd-f081-4b39-a7a7-b5f282289624 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:57.143797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00386fdd-f081-4b39-a7a7-b5f282289624 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:57.144272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00386fdd-f081-4b39-a7a7-b5f282289624 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:57.144697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00386fdd-f081-4b39-a7a7-b5f282289624 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:57.145372 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00386fdd-f081-4b39-a7a7-b5f282289624 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:57.145791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00386fdd-f081-4b39-a7a7-b5f282289624 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:57.146227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00386fdd-f081-4b39-a7a7-b5f282289624 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:57.281128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-00386fdd-f081-4b39-a7a7-b5f282289624 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:57.289823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-00386fdd-f081-4b39-a7a7-b5f282289624 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.157234 Sep 13 20:11:57.290396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 716/1328] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:57 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:11:58.131605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d42046ee-334d-4786-8937-651f4513a6cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:58.135247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d42046ee-334d-4786-8937-651f4513a6cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:58.145903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d42046ee-334d-4786-8937-651f4513a6cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:58.146735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d42046ee-334d-4786-8937-651f4513a6cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:58.147444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d42046ee-334d-4786-8937-651f4513a6cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:58.148575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d42046ee-334d-4786-8937-651f4513a6cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:58.149411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d42046ee-334d-4786-8937-651f4513a6cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:58.149826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d42046ee-334d-4786-8937-651f4513a6cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:58.179421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d42046ee-334d-4786-8937-651f4513a6cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054552 Sep 13 20:11:58.179972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 613/1329] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:58 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:58.318441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8d87ccd0-861b-43bd-b6b6-57b55d4dd02a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:58.320356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8d87ccd0-861b-43bd-b6b6-57b55d4dd02a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:58.331921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d87ccd0-861b-43bd-b6b6-57b55d4dd02a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:58.332662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d87ccd0-861b-43bd-b6b6-57b55d4dd02a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:58.333370 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d87ccd0-861b-43bd-b6b6-57b55d4dd02a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:58.334953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d87ccd0-861b-43bd-b6b6-57b55d4dd02a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:58.335689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d87ccd0-861b-43bd-b6b6-57b55d4dd02a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:58.336373 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d87ccd0-861b-43bd-b6b6-57b55d4dd02a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:58.483667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8d87ccd0-861b-43bd-b6b6-57b55d4dd02a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:58.494449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8d87ccd0-861b-43bd-b6b6-57b55d4dd02a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.182152 Sep 13 20:11:58.495272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 717/1330] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:58 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:11:59.196421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c35f767b-5ebb-4435-bcad-ca2a36c9cb4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:59.200020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c35f767b-5ebb-4435-bcad-ca2a36c9cb4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:59.211159 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c35f767b-5ebb-4435-bcad-ca2a36c9cb4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:59.211795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c35f767b-5ebb-4435-bcad-ca2a36c9cb4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:59.212193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c35f767b-5ebb-4435-bcad-ca2a36c9cb4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:59.212956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c35f767b-5ebb-4435-bcad-ca2a36c9cb4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:59.213488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c35f767b-5ebb-4435-bcad-ca2a36c9cb4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:59.213879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c35f767b-5ebb-4435-bcad-ca2a36c9cb4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:59.244842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c35f767b-5ebb-4435-bcad-ca2a36c9cb4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055119 Sep 13 20:11:59.245408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 614/1331] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:11:59 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:11:59.522042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0ecc216a-938d-4e8e-8105-0dbca945a78d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:11:59.523022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0ecc216a-938d-4e8e-8105-0dbca945a78d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:11:59.534164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ecc216a-938d-4e8e-8105-0dbca945a78d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:59.535007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ecc216a-938d-4e8e-8105-0dbca945a78d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:59.535695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ecc216a-938d-4e8e-8105-0dbca945a78d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:59.536851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ecc216a-938d-4e8e-8105-0dbca945a78d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:11:59.537630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ecc216a-938d-4e8e-8105-0dbca945a78d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:11:59.538576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ecc216a-938d-4e8e-8105-0dbca945a78d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:11:59.670405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0ecc216a-938d-4e8e-8105-0dbca945a78d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:11:59.679210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0ecc216a-938d-4e8e-8105-0dbca945a78d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163710 Sep 13 20:11:59.679772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 718/1332] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:11:59 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:00.261745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-269db8ac-10f1-473d-acfc-4cf623bd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:00.265260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-269db8ac-10f1-473d-acfc-4cf623bd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:00.275515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-269db8ac-10f1-473d-acfc-4cf623bd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:00.276308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-269db8ac-10f1-473d-acfc-4cf623bd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:00.277015 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-269db8ac-10f1-473d-acfc-4cf623bd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:00.278139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-269db8ac-10f1-473d-acfc-4cf623bd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:00.278932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-269db8ac-10f1-473d-acfc-4cf623bd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:00.279637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-269db8ac-10f1-473d-acfc-4cf623bd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:00.314255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-269db8ac-10f1-473d-acfc-4cf623bd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059502 Sep 13 20:12:00.314837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 615/1333] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:00 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:00.702153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1324016d-79c1-4433-b386-9facb70ba5e5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:00.702778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1324016d-79c1-4433-b386-9facb70ba5e5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:00.709742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1324016d-79c1-4433-b386-9facb70ba5e5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:00.710219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1324016d-79c1-4433-b386-9facb70ba5e5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:00.710728 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1324016d-79c1-4433-b386-9facb70ba5e5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:00.711411 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1324016d-79c1-4433-b386-9facb70ba5e5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:00.711915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1324016d-79c1-4433-b386-9facb70ba5e5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:00.712332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1324016d-79c1-4433-b386-9facb70ba5e5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:00.865742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1324016d-79c1-4433-b386-9facb70ba5e5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:00.875023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1324016d-79c1-4433-b386-9facb70ba5e5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.176742 Sep 13 20:12:00.875602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 719/1334] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:00 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:01.331543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-36950cac-5c52-42af-97d0-49692aa5762a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:01.335527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-36950cac-5c52-42af-97d0-49692aa5762a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:01.343091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36950cac-5c52-42af-97d0-49692aa5762a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:01.343575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36950cac-5c52-42af-97d0-49692aa5762a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:01.344008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36950cac-5c52-42af-97d0-49692aa5762a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:01.344702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36950cac-5c52-42af-97d0-49692aa5762a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:01.345154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36950cac-5c52-42af-97d0-49692aa5762a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:01.345582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-36950cac-5c52-42af-97d0-49692aa5762a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:01.375581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-36950cac-5c52-42af-97d0-49692aa5762a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050801 Sep 13 20:12:01.376121 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 616/1335] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:01.899278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-79fae40d-7e8a-4641-8a44-2ee0a3846e90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:01.899826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-79fae40d-7e8a-4641-8a44-2ee0a3846e90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:01.906816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79fae40d-7e8a-4641-8a44-2ee0a3846e90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:01.907289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79fae40d-7e8a-4641-8a44-2ee0a3846e90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:01.907718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79fae40d-7e8a-4641-8a44-2ee0a3846e90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:01.908410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79fae40d-7e8a-4641-8a44-2ee0a3846e90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:01.908854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79fae40d-7e8a-4641-8a44-2ee0a3846e90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:01.909273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79fae40d-7e8a-4641-8a44-2ee0a3846e90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:02.047078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-79fae40d-7e8a-4641-8a44-2ee0a3846e90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:02.055948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-79fae40d-7e8a-4641-8a44-2ee0a3846e90 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160750 Sep 13 20:12:02.056527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 720/1336] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:01 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:02.392109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7e3cb2f3-98b1-4400-a33a-15cfd793515b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:02.395580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7e3cb2f3-98b1-4400-a33a-15cfd793515b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:02.406279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e3cb2f3-98b1-4400-a33a-15cfd793515b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:02.407113 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e3cb2f3-98b1-4400-a33a-15cfd793515b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:02.407828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e3cb2f3-98b1-4400-a33a-15cfd793515b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:02.408944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e3cb2f3-98b1-4400-a33a-15cfd793515b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:02.409676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e3cb2f3-98b1-4400-a33a-15cfd793515b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:02.410410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e3cb2f3-98b1-4400-a33a-15cfd793515b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:02.442046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7e3cb2f3-98b1-4400-a33a-15cfd793515b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056637 Sep 13 20:12:02.442621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 617/1337] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:02 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:03.083731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d874adab-b4bf-4db0-82a7-4745bf3baaa0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:03.085078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d874adab-b4bf-4db0-82a7-4745bf3baaa0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:03.096292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d874adab-b4bf-4db0-82a7-4745bf3baaa0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:03.097053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d874adab-b4bf-4db0-82a7-4745bf3baaa0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:03.097816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d874adab-b4bf-4db0-82a7-4745bf3baaa0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:03.099008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d874adab-b4bf-4db0-82a7-4745bf3baaa0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:03.099768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d874adab-b4bf-4db0-82a7-4745bf3baaa0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:03.100472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d874adab-b4bf-4db0-82a7-4745bf3baaa0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:03.104191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:03.234329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d874adab-b4bf-4db0-82a7-4745bf3baaa0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:03.242993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d874adab-b4bf-4db0-82a7-4745bf3baaa0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166100 Sep 13 20:12:03.243573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 721/1338] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:03 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:03.458951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7b0e4179-f335-4451-a274-9554f20ad533 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:03.462944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7b0e4179-f335-4451-a274-9554f20ad533 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:03.469793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b0e4179-f335-4451-a274-9554f20ad533 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:03.470275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b0e4179-f335-4451-a274-9554f20ad533 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:03.470756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b0e4179-f335-4451-a274-9554f20ad533 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:03.471437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b0e4179-f335-4451-a274-9554f20ad533 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:03.471884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b0e4179-f335-4451-a274-9554f20ad533 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:03.472293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b0e4179-f335-4451-a274-9554f20ad533 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:03.501365 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7b0e4179-f335-4451-a274-9554f20ad533 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049180 Sep 13 20:12:03.501889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 618/1339] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:03 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:04.270626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-69a06bb9-9f3e-4c19-9007-fc7335005ba4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:04.271646 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-69a06bb9-9f3e-4c19-9007-fc7335005ba4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:04.280153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69a06bb9-9f3e-4c19-9007-fc7335005ba4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:04.280669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69a06bb9-9f3e-4c19-9007-fc7335005ba4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:04.281099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69a06bb9-9f3e-4c19-9007-fc7335005ba4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:04.281845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69a06bb9-9f3e-4c19-9007-fc7335005ba4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:04.282308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69a06bb9-9f3e-4c19-9007-fc7335005ba4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:04.282775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69a06bb9-9f3e-4c19-9007-fc7335005ba4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:04.423681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-69a06bb9-9f3e-4c19-9007-fc7335005ba4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:04.432285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-69a06bb9-9f3e-4c19-9007-fc7335005ba4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168627 Sep 13 20:12:04.432848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 722/1340] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:04 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:04.517995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8a515ccf-e04a-45d2-a41a-a7b456ffd248 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:04.521631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8a515ccf-e04a-45d2-a41a-a7b456ffd248 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:04.532325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a515ccf-e04a-45d2-a41a-a7b456ffd248 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:04.533108 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a515ccf-e04a-45d2-a41a-a7b456ffd248 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:04.533821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a515ccf-e04a-45d2-a41a-a7b456ffd248 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:04.534993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a515ccf-e04a-45d2-a41a-a7b456ffd248 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:04.535739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a515ccf-e04a-45d2-a41a-a7b456ffd248 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:04.536415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a515ccf-e04a-45d2-a41a-a7b456ffd248 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:04.568641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8a515ccf-e04a-45d2-a41a-a7b456ffd248 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057221 Sep 13 20:12:04.569181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 619/1341] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:04 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:05.455834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e070f8c2-724f-4f77-9ae3-ba9f8b4b23ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:05.456427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e070f8c2-724f-4f77-9ae3-ba9f8b4b23ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:05.463663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e070f8c2-724f-4f77-9ae3-ba9f8b4b23ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:05.464141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e070f8c2-724f-4f77-9ae3-ba9f8b4b23ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:05.464565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e070f8c2-724f-4f77-9ae3-ba9f8b4b23ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:05.465246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e070f8c2-724f-4f77-9ae3-ba9f8b4b23ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:05.465670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e070f8c2-724f-4f77-9ae3-ba9f8b4b23ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:05.466326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e070f8c2-724f-4f77-9ae3-ba9f8b4b23ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:05.581965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e529c6c5-0d9b-4ee4-bb2a-4a719cb8487f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:05.584857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e529c6c5-0d9b-4ee4-bb2a-4a719cb8487f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:05.591412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e529c6c5-0d9b-4ee4-bb2a-4a719cb8487f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:05.591892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e529c6c5-0d9b-4ee4-bb2a-4a719cb8487f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:05.592325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e529c6c5-0d9b-4ee4-bb2a-4a719cb8487f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:05.593050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e529c6c5-0d9b-4ee4-bb2a-4a719cb8487f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:05.593487 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e529c6c5-0d9b-4ee4-bb2a-4a719cb8487f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:05.594033 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e529c6c5-0d9b-4ee4-bb2a-4a719cb8487f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:05.598235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e070f8c2-724f-4f77-9ae3-ba9f8b4b23ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:05.606704 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e070f8c2-724f-4f77-9ae3-ba9f8b4b23ab tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.154827 Sep 13 20:12:05.607287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 723/1342] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:05 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:05.627977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e529c6c5-0d9b-4ee4-bb2a-4a719cb8487f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050420 Sep 13 20:12:05.628520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 620/1343] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:05 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:06.633308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f9e2baa1-3f47-4918-8590-99299d3dda27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:06.634408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f9e2baa1-3f47-4918-8590-99299d3dda27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:06.645205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-380b6be1-b74d-461a-8d7b-6c4665de63ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:06.645969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9e2baa1-3f47-4918-8590-99299d3dda27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:06.646171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9e2baa1-3f47-4918-8590-99299d3dda27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:06.646848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9e2baa1-3f47-4918-8590-99299d3dda27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:06.647974 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9e2baa1-3f47-4918-8590-99299d3dda27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:06.648705 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9e2baa1-3f47-4918-8590-99299d3dda27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:06.648950 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-380b6be1-b74d-461a-8d7b-6c4665de63ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:06.649602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f9e2baa1-3f47-4918-8590-99299d3dda27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:06.656238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-380b6be1-b74d-461a-8d7b-6c4665de63ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:06.656717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-380b6be1-b74d-461a-8d7b-6c4665de63ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:06.657146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-380b6be1-b74d-461a-8d7b-6c4665de63ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:06.657847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-380b6be1-b74d-461a-8d7b-6c4665de63ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:06.658295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-380b6be1-b74d-461a-8d7b-6c4665de63ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:06.658764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-380b6be1-b74d-461a-8d7b-6c4665de63ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:06.689384 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-380b6be1-b74d-461a-8d7b-6c4665de63ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050794 Sep 13 20:12:06.689967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 621/1344] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:06.785463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f9e2baa1-3f47-4918-8590-99299d3dda27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:06.794236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f9e2baa1-3f47-4918-8590-99299d3dda27 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167607 Sep 13 20:12:06.794846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 724/1345] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:06 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:07.705962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-82cb61c9-b545-4ac1-8760-acaee40b750a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:07.709911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-82cb61c9-b545-4ac1-8760-acaee40b750a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:07.720787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82cb61c9-b545-4ac1-8760-acaee40b750a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:07.721576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82cb61c9-b545-4ac1-8760-acaee40b750a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:07.722307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82cb61c9-b545-4ac1-8760-acaee40b750a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:07.723491 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82cb61c9-b545-4ac1-8760-acaee40b750a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:07.724297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82cb61c9-b545-4ac1-8760-acaee40b750a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:07.724913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82cb61c9-b545-4ac1-8760-acaee40b750a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:07.755887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-82cb61c9-b545-4ac1-8760-acaee40b750a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056760 Sep 13 20:12:07.756429 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 622/1346] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:07.822401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-408e7d81-6a98-483a-821c-6a92da6b8fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:07.822947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-408e7d81-6a98-483a-821c-6a92da6b8fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:07.830101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-408e7d81-6a98-483a-821c-6a92da6b8fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:07.830780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-408e7d81-6a98-483a-821c-6a92da6b8fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:07.831237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-408e7d81-6a98-483a-821c-6a92da6b8fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:07.831969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-408e7d81-6a98-483a-821c-6a92da6b8fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:07.832444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-408e7d81-6a98-483a-821c-6a92da6b8fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:07.832882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-408e7d81-6a98-483a-821c-6a92da6b8fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:07.968859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-408e7d81-6a98-483a-821c-6a92da6b8fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:07.977124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-408e7d81-6a98-483a-821c-6a92da6b8fe9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161340 Sep 13 20:12:07.977693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 725/1347] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:07 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:08.772964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-da746a13-8d9c-41d2-a7a7-e3494f7db11d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:08.776229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-da746a13-8d9c-41d2-a7a7-e3494f7db11d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:08.783334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da746a13-8d9c-41d2-a7a7-e3494f7db11d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:08.783819 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da746a13-8d9c-41d2-a7a7-e3494f7db11d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:08.784256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da746a13-8d9c-41d2-a7a7-e3494f7db11d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:08.784976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da746a13-8d9c-41d2-a7a7-e3494f7db11d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:08.785422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da746a13-8d9c-41d2-a7a7-e3494f7db11d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:08.785845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da746a13-8d9c-41d2-a7a7-e3494f7db11d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:08.815913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-da746a13-8d9c-41d2-a7a7-e3494f7db11d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049655 Sep 13 20:12:08.816456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 623/1348] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:09.004502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-26482135-f836-456c-8c5c-e6091fcef5fe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:09.005633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-26482135-f836-456c-8c5c-e6091fcef5fe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:09.014888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-26482135-f836-456c-8c5c-e6091fcef5fe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:09.015361 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-26482135-f836-456c-8c5c-e6091fcef5fe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:09.015788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-26482135-f836-456c-8c5c-e6091fcef5fe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:09.016464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-26482135-f836-456c-8c5c-e6091fcef5fe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:09.016905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-26482135-f836-456c-8c5c-e6091fcef5fe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:09.017314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-26482135-f836-456c-8c5c-e6091fcef5fe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:09.147607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-26482135-f836-456c-8c5c-e6091fcef5fe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:09.159486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-26482135-f836-456c-8c5c-e6091fcef5fe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161498 Sep 13 20:12:09.160166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 726/1349] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:08 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:09.832393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3f827cab-3fe0-4cc7-9e7c-3cbe75e3008d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:09.836193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3f827cab-3fe0-4cc7-9e7c-3cbe75e3008d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:09.846943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f827cab-3fe0-4cc7-9e7c-3cbe75e3008d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:09.847742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f827cab-3fe0-4cc7-9e7c-3cbe75e3008d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:09.848460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f827cab-3fe0-4cc7-9e7c-3cbe75e3008d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:09.849595 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f827cab-3fe0-4cc7-9e7c-3cbe75e3008d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:09.850329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f827cab-3fe0-4cc7-9e7c-3cbe75e3008d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:09.851070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f827cab-3fe0-4cc7-9e7c-3cbe75e3008d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:09.882389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3f827cab-3fe0-4cc7-9e7c-3cbe75e3008d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056786 Sep 13 20:12:09.882945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 624/1350] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:10.186889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6572c8bd-da73-49a2-9611-90d5e7a4b741 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:10.187789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6572c8bd-da73-49a2-9611-90d5e7a4b741 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:10.198817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6572c8bd-da73-49a2-9611-90d5e7a4b741 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:10.199607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6572c8bd-da73-49a2-9611-90d5e7a4b741 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:10.200320 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6572c8bd-da73-49a2-9611-90d5e7a4b741 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:10.201452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6572c8bd-da73-49a2-9611-90d5e7a4b741 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:10.202201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6572c8bd-da73-49a2-9611-90d5e7a4b741 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:10.202953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6572c8bd-da73-49a2-9611-90d5e7a4b741 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:10.344142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6572c8bd-da73-49a2-9611-90d5e7a4b741 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:10.357017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6572c8bd-da73-49a2-9611-90d5e7a4b741 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.176502 Sep 13 20:12:10.357785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 727/1351] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:10 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:10.895579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9bbf93d9-2c7f-456d-8a1c-15af1f5fc5be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:10.898105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9bbf93d9-2c7f-456d-8a1c-15af1f5fc5be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:10.904829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9bbf93d9-2c7f-456d-8a1c-15af1f5fc5be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:10.905282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9bbf93d9-2c7f-456d-8a1c-15af1f5fc5be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:10.905712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9bbf93d9-2c7f-456d-8a1c-15af1f5fc5be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:10.906429 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9bbf93d9-2c7f-456d-8a1c-15af1f5fc5be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:10.906879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9bbf93d9-2c7f-456d-8a1c-15af1f5fc5be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:10.907293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9bbf93d9-2c7f-456d-8a1c-15af1f5fc5be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:10.938279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9bbf93d9-2c7f-456d-8a1c-15af1f5fc5be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046953 Sep 13 20:12:10.938879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 625/1352] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:10 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:11.380526 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5b34cddf-0972-4e99-84c9-ba9cb7a34732 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:11.381143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5b34cddf-0972-4e99-84c9-ba9cb7a34732 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:11.387800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b34cddf-0972-4e99-84c9-ba9cb7a34732 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:11.388272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b34cddf-0972-4e99-84c9-ba9cb7a34732 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:11.388695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b34cddf-0972-4e99-84c9-ba9cb7a34732 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:11.389348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b34cddf-0972-4e99-84c9-ba9cb7a34732 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:11.389793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b34cddf-0972-4e99-84c9-ba9cb7a34732 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:11.390210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b34cddf-0972-4e99-84c9-ba9cb7a34732 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:11.525048 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5b34cddf-0972-4e99-84c9-ba9cb7a34732 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:11.537935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5b34cddf-0972-4e99-84c9-ba9cb7a34732 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160931 Sep 13 20:12:11.538486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 728/1353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:11 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:11.953555 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3e5356c4-d0d3-484e-9a36-984c101d100b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:11.956643 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3e5356c4-d0d3-484e-9a36-984c101d100b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:11.966427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e5356c4-d0d3-484e-9a36-984c101d100b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:11.967129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e5356c4-d0d3-484e-9a36-984c101d100b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:11.967741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e5356c4-d0d3-484e-9a36-984c101d100b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:11.968711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e5356c4-d0d3-484e-9a36-984c101d100b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:11.969351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e5356c4-d0d3-484e-9a36-984c101d100b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:11.969946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e5356c4-d0d3-484e-9a36-984c101d100b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:12.001982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3e5356c4-d0d3-484e-9a36-984c101d100b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054527 Sep 13 20:12:12.002550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 626/1354] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:11 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:12.561774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-174e21e1-0d88-4ecd-89c9-55b3d8bf1295 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:12.562429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-174e21e1-0d88-4ecd-89c9-55b3d8bf1295 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:12.569551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-174e21e1-0d88-4ecd-89c9-55b3d8bf1295 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:12.570034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-174e21e1-0d88-4ecd-89c9-55b3d8bf1295 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:12.570506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-174e21e1-0d88-4ecd-89c9-55b3d8bf1295 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:12.571198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-174e21e1-0d88-4ecd-89c9-55b3d8bf1295 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:12.571656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-174e21e1-0d88-4ecd-89c9-55b3d8bf1295 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:12.572081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-174e21e1-0d88-4ecd-89c9-55b3d8bf1295 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:12.712316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-174e21e1-0d88-4ecd-89c9-55b3d8bf1295 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:12.725036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-174e21e1-0d88-4ecd-89c9-55b3d8bf1295 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167073 Sep 13 20:12:12.725788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 729/1355] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:12 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:13.015124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-081339fb-3a87-4d54-bec3-63e380866857 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:13.017298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-081339fb-3a87-4d54-bec3-63e380866857 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:13.024034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-081339fb-3a87-4d54-bec3-63e380866857 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:13.024509 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-081339fb-3a87-4d54-bec3-63e380866857 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:13.024934 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-081339fb-3a87-4d54-bec3-63e380866857 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:13.025630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-081339fb-3a87-4d54-bec3-63e380866857 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:13.026074 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-081339fb-3a87-4d54-bec3-63e380866857 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:13.026520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-081339fb-3a87-4d54-bec3-63e380866857 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:13.028882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:13.057747 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-081339fb-3a87-4d54-bec3-63e380866857 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046595 Sep 13 20:12:13.058270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 627/1356] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:13.753697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-59a39899-a869-4d6e-85bc-59dba20b53cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:13.754699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-59a39899-a869-4d6e-85bc-59dba20b53cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:13.763096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59a39899-a869-4d6e-85bc-59dba20b53cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:13.763576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59a39899-a869-4d6e-85bc-59dba20b53cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:13.764001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59a39899-a869-4d6e-85bc-59dba20b53cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:13.764713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59a39899-a869-4d6e-85bc-59dba20b53cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:13.765158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59a39899-a869-4d6e-85bc-59dba20b53cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:13.765574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59a39899-a869-4d6e-85bc-59dba20b53cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:13.908897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-59a39899-a869-4d6e-85bc-59dba20b53cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:13.921488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-59a39899-a869-4d6e-85bc-59dba20b53cb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.174374 Sep 13 20:12:13.922257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 730/1357] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:13 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:14.075811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d4c1d381-a821-408d-a501-fd4fa0f4b4d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:14.078975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d4c1d381-a821-408d-a501-fd4fa0f4b4d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:14.089060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4c1d381-a821-408d-a501-fd4fa0f4b4d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:14.089539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4c1d381-a821-408d-a501-fd4fa0f4b4d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:14.089976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4c1d381-a821-408d-a501-fd4fa0f4b4d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:14.090668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4c1d381-a821-408d-a501-fd4fa0f4b4d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:14.091111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4c1d381-a821-408d-a501-fd4fa0f4b4d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:14.091530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4c1d381-a821-408d-a501-fd4fa0f4b4d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:14.121065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d4c1d381-a821-408d-a501-fd4fa0f4b4d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052052 Sep 13 20:12:14.121525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 628/1358] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:14 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:14.951842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9c852f42-694d-46f2-9bdf-4bf29157e2c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:14.952573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9c852f42-694d-46f2-9bdf-4bf29157e2c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:14.961804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c852f42-694d-46f2-9bdf-4bf29157e2c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:14.962443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c852f42-694d-46f2-9bdf-4bf29157e2c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:14.963049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c852f42-694d-46f2-9bdf-4bf29157e2c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:14.963959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c852f42-694d-46f2-9bdf-4bf29157e2c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:14.964546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c852f42-694d-46f2-9bdf-4bf29157e2c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:14.965102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c852f42-694d-46f2-9bdf-4bf29157e2c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:15.107751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9c852f42-694d-46f2-9bdf-4bf29157e2c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:15.116251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9c852f42-694d-46f2-9bdf-4bf29157e2c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.170251 Sep 13 20:12:15.116821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 731/1359] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:14 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:15.133300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-79ded0ce-e82c-4fe3-ab68-01bc43176946 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:15.135684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-79ded0ce-e82c-4fe3-ab68-01bc43176946 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:15.142806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79ded0ce-e82c-4fe3-ab68-01bc43176946 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:15.143277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79ded0ce-e82c-4fe3-ab68-01bc43176946 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:15.143711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79ded0ce-e82c-4fe3-ab68-01bc43176946 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:15.144410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79ded0ce-e82c-4fe3-ab68-01bc43176946 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:15.144867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79ded0ce-e82c-4fe3-ab68-01bc43176946 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:15.145296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79ded0ce-e82c-4fe3-ab68-01bc43176946 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:15.179124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-79ded0ce-e82c-4fe3-ab68-01bc43176946 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049400 Sep 13 20:12:15.179831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 629/1360] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:16.141445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a0b730f0-0c72-46db-aa32-0668f0b03ae9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:16.142279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a0b730f0-0c72-46db-aa32-0668f0b03ae9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:16.151188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0b730f0-0c72-46db-aa32-0668f0b03ae9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:16.151690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0b730f0-0c72-46db-aa32-0668f0b03ae9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:16.152112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0b730f0-0c72-46db-aa32-0668f0b03ae9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:16.152794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0b730f0-0c72-46db-aa32-0668f0b03ae9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:16.153237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0b730f0-0c72-46db-aa32-0668f0b03ae9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:16.153633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0b730f0-0c72-46db-aa32-0668f0b03ae9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:16.193378 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0c0ec1e4-a4e7-4f10-bc82-0d884096acb8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:16.195646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0c0ec1e4-a4e7-4f10-bc82-0d884096acb8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:16.202600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c0ec1e4-a4e7-4f10-bc82-0d884096acb8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:16.203126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c0ec1e4-a4e7-4f10-bc82-0d884096acb8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:16.203561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c0ec1e4-a4e7-4f10-bc82-0d884096acb8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:16.204267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c0ec1e4-a4e7-4f10-bc82-0d884096acb8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:16.204724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c0ec1e4-a4e7-4f10-bc82-0d884096acb8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:16.205127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0c0ec1e4-a4e7-4f10-bc82-0d884096acb8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:16.235850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0c0ec1e4-a4e7-4f10-bc82-0d884096acb8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046411 Sep 13 20:12:16.236790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 630/1361] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:16 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:16.287111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a0b730f0-0c72-46db-aa32-0668f0b03ae9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:16.295421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a0b730f0-0c72-46db-aa32-0668f0b03ae9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.159248 Sep 13 20:12:16.295983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 732/1362] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:16 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:17.251114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8a7e66f7-39a2-4702-b61c-497bc0781688 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:17.254568 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8a7e66f7-39a2-4702-b61c-497bc0781688 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:17.262899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a7e66f7-39a2-4702-b61c-497bc0781688 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:17.263379 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a7e66f7-39a2-4702-b61c-497bc0781688 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:17.263811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a7e66f7-39a2-4702-b61c-497bc0781688 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:17.264498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a7e66f7-39a2-4702-b61c-497bc0781688 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:17.264936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a7e66f7-39a2-4702-b61c-497bc0781688 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:17.265348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a7e66f7-39a2-4702-b61c-497bc0781688 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:17.295049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8a7e66f7-39a2-4702-b61c-497bc0781688 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050433 Sep 13 20:12:17.295590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 631/1363] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:17 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:17.324274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8e9fbb24-9f13-465d-95e1-c3000bdae14c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:17.324848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8e9fbb24-9f13-465d-95e1-c3000bdae14c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:17.331371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e9fbb24-9f13-465d-95e1-c3000bdae14c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:17.331845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e9fbb24-9f13-465d-95e1-c3000bdae14c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:17.332271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e9fbb24-9f13-465d-95e1-c3000bdae14c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:17.332946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e9fbb24-9f13-465d-95e1-c3000bdae14c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:17.333383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e9fbb24-9f13-465d-95e1-c3000bdae14c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:17.333791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e9fbb24-9f13-465d-95e1-c3000bdae14c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:17.464906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8e9fbb24-9f13-465d-95e1-c3000bdae14c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:17.473698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8e9fbb24-9f13-465d-95e1-c3000bdae14c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.154567 Sep 13 20:12:17.474262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 733/1364] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:17 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:18.307471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3a966b21-1b39-48c7-a6ba-ac5f9b500300 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:18.310665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3a966b21-1b39-48c7-a6ba-ac5f9b500300 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:18.318310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a966b21-1b39-48c7-a6ba-ac5f9b500300 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:18.318832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a966b21-1b39-48c7-a6ba-ac5f9b500300 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:18.319289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a966b21-1b39-48c7-a6ba-ac5f9b500300 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:18.320026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a966b21-1b39-48c7-a6ba-ac5f9b500300 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:18.320584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a966b21-1b39-48c7-a6ba-ac5f9b500300 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:18.321010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a966b21-1b39-48c7-a6ba-ac5f9b500300 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:18.352794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3a966b21-1b39-48c7-a6ba-ac5f9b500300 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049261 Sep 13 20:12:18.353385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 632/1365] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:18.501354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e81c2f72-9949-4b5b-9f8a-103e95f3c6f8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:18.502353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e81c2f72-9949-4b5b-9f8a-103e95f3c6f8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:18.513021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e81c2f72-9949-4b5b-9f8a-103e95f3c6f8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:18.513805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e81c2f72-9949-4b5b-9f8a-103e95f3c6f8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:18.514572 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e81c2f72-9949-4b5b-9f8a-103e95f3c6f8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:18.515711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e81c2f72-9949-4b5b-9f8a-103e95f3c6f8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:18.516479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e81c2f72-9949-4b5b-9f8a-103e95f3c6f8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:18.517160 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e81c2f72-9949-4b5b-9f8a-103e95f3c6f8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:18.656986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e81c2f72-9949-4b5b-9f8a-103e95f3c6f8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:18.665596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e81c2f72-9949-4b5b-9f8a-103e95f3c6f8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.170820 Sep 13 20:12:18.666236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 734/1366] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:18 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:19.365748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1c80da47-884d-4d22-8163-76e1dc7d09cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:19.367946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1c80da47-884d-4d22-8163-76e1dc7d09cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:19.374654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c80da47-884d-4d22-8163-76e1dc7d09cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:19.375125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c80da47-884d-4d22-8163-76e1dc7d09cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:19.375550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c80da47-884d-4d22-8163-76e1dc7d09cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:19.376217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c80da47-884d-4d22-8163-76e1dc7d09cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:19.376653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c80da47-884d-4d22-8163-76e1dc7d09cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:19.377061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1c80da47-884d-4d22-8163-76e1dc7d09cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:19.408355 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1c80da47-884d-4d22-8163-76e1dc7d09cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046983 Sep 13 20:12:19.408882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 633/1367] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:19.693343 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0e1538bf-ec69-40c4-b4b4-a1a6a2a83f80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:19.694341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0e1538bf-ec69-40c4-b4b4-a1a6a2a83f80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:19.702315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e1538bf-ec69-40c4-b4b4-a1a6a2a83f80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:19.702825 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e1538bf-ec69-40c4-b4b4-a1a6a2a83f80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:19.703256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e1538bf-ec69-40c4-b4b4-a1a6a2a83f80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:19.703939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e1538bf-ec69-40c4-b4b4-a1a6a2a83f80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:19.704384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e1538bf-ec69-40c4-b4b4-a1a6a2a83f80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:19.704797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e1538bf-ec69-40c4-b4b4-a1a6a2a83f80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:19.834394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0e1538bf-ec69-40c4-b4b4-a1a6a2a83f80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:19.843417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0e1538bf-ec69-40c4-b4b4-a1a6a2a83f80 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156653 Sep 13 20:12:19.843987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 735/1368] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:19 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:20.422161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b40c4e46-ee1e-448f-a8c1-a32ff6491c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:20.424118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b40c4e46-ee1e-448f-a8c1-a32ff6491c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:20.430869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b40c4e46-ee1e-448f-a8c1-a32ff6491c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:20.431357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b40c4e46-ee1e-448f-a8c1-a32ff6491c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:20.431789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b40c4e46-ee1e-448f-a8c1-a32ff6491c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:20.432465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b40c4e46-ee1e-448f-a8c1-a32ff6491c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:20.432910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b40c4e46-ee1e-448f-a8c1-a32ff6491c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:20.433338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b40c4e46-ee1e-448f-a8c1-a32ff6491c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:20.464284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b40c4e46-ee1e-448f-a8c1-a32ff6491c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046374 Sep 13 20:12:20.464822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 634/1369] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:20.870740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ec4ed28e-d29c-426b-a24f-0043de1f5a4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:20.871359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ec4ed28e-d29c-426b-a24f-0043de1f5a4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:20.878082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ec4ed28e-d29c-426b-a24f-0043de1f5a4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:20.878634 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ec4ed28e-d29c-426b-a24f-0043de1f5a4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:20.879131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ec4ed28e-d29c-426b-a24f-0043de1f5a4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:20.879858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ec4ed28e-d29c-426b-a24f-0043de1f5a4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:20.880424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ec4ed28e-d29c-426b-a24f-0043de1f5a4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:20.880963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ec4ed28e-d29c-426b-a24f-0043de1f5a4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:21.014682 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ec4ed28e-d29c-426b-a24f-0043de1f5a4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:21.022933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ec4ed28e-d29c-426b-a24f-0043de1f5a4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158486 Sep 13 20:12:21.023498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 736/1370] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:20 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:21.476374 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-17fe9503-e7dd-43af-acc6-6c20bb0abf9c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:21.479486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-17fe9503-e7dd-43af-acc6-6c20bb0abf9c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:21.486718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17fe9503-e7dd-43af-acc6-6c20bb0abf9c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:21.487199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17fe9503-e7dd-43af-acc6-6c20bb0abf9c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:21.487622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17fe9503-e7dd-43af-acc6-6c20bb0abf9c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:21.488391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17fe9503-e7dd-43af-acc6-6c20bb0abf9c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:21.488819 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17fe9503-e7dd-43af-acc6-6c20bb0abf9c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:21.489462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17fe9503-e7dd-43af-acc6-6c20bb0abf9c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:21.520472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-17fe9503-e7dd-43af-acc6-6c20bb0abf9c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048019 Sep 13 20:12:21.521035 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 635/1371] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:21 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:22.045313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f59ec114-eeb0-4233-884b-511fcf48ba53 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:22.045998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f59ec114-eeb0-4233-884b-511fcf48ba53 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:22.052672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f59ec114-eeb0-4233-884b-511fcf48ba53 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:22.053211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f59ec114-eeb0-4233-884b-511fcf48ba53 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:22.053706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f59ec114-eeb0-4233-884b-511fcf48ba53 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:22.054400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f59ec114-eeb0-4233-884b-511fcf48ba53 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:22.054867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f59ec114-eeb0-4233-884b-511fcf48ba53 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:22.055271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f59ec114-eeb0-4233-884b-511fcf48ba53 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:22.185429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f59ec114-eeb0-4233-884b-511fcf48ba53 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:22.187668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:22.194839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f59ec114-eeb0-4233-884b-511fcf48ba53 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.153337 Sep 13 20:12:22.195404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 737/1372] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:22 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:22.537044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-96a1c537-c36d-4275-a85a-8f928b14594b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:22.541036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-96a1c537-c36d-4275-a85a-8f928b14594b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:22.547956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96a1c537-c36d-4275-a85a-8f928b14594b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:22.548428 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96a1c537-c36d-4275-a85a-8f928b14594b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:22.548861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96a1c537-c36d-4275-a85a-8f928b14594b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:22.549556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96a1c537-c36d-4275-a85a-8f928b14594b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:22.550007 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96a1c537-c36d-4275-a85a-8f928b14594b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:22.550420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96a1c537-c36d-4275-a85a-8f928b14594b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:22.584364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-96a1c537-c36d-4275-a85a-8f928b14594b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053993 Sep 13 20:12:22.584919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 636/1373] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:23.220591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a730e211-07cd-41fd-84be-8e6008892376 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:23.221450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a730e211-07cd-41fd-84be-8e6008892376 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:23.230821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a730e211-07cd-41fd-84be-8e6008892376 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:23.231292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a730e211-07cd-41fd-84be-8e6008892376 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:23.231711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a730e211-07cd-41fd-84be-8e6008892376 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:23.232389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a730e211-07cd-41fd-84be-8e6008892376 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:23.232828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a730e211-07cd-41fd-84be-8e6008892376 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:23.233238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a730e211-07cd-41fd-84be-8e6008892376 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:23.362578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a730e211-07cd-41fd-84be-8e6008892376 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:23.370838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a730e211-07cd-41fd-84be-8e6008892376 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155834 Sep 13 20:12:23.371396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 738/1374] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:23 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:23.597580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-99e9097c-1b84-4c31-85c2-c9c3a3263ccd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:23.599890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-99e9097c-1b84-4c31-85c2-c9c3a3263ccd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:23.607167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-99e9097c-1b84-4c31-85c2-c9c3a3263ccd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:23.607662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-99e9097c-1b84-4c31-85c2-c9c3a3263ccd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:23.608104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-99e9097c-1b84-4c31-85c2-c9c3a3263ccd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:23.608778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-99e9097c-1b84-4c31-85c2-c9c3a3263ccd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:23.609290 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-99e9097c-1b84-4c31-85c2-c9c3a3263ccd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:23.609690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-99e9097c-1b84-4c31-85c2-c9c3a3263ccd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:23.641429 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-99e9097c-1b84-4c31-85c2-c9c3a3263ccd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048033 Sep 13 20:12:23.646360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 637/1375] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:24.398521 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2a27b996-5e10-4716-babb-adacc06ff055 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:24.399387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2a27b996-5e10-4716-babb-adacc06ff055 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:24.402747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:24.408298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a27b996-5e10-4716-babb-adacc06ff055 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:24.408791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a27b996-5e10-4716-babb-adacc06ff055 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:24.409208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a27b996-5e10-4716-babb-adacc06ff055 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:24.409923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a27b996-5e10-4716-babb-adacc06ff055 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:24.410385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a27b996-5e10-4716-babb-adacc06ff055 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:24.410801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a27b996-5e10-4716-babb-adacc06ff055 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:24.550910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2a27b996-5e10-4716-babb-adacc06ff055 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:24.559678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2a27b996-5e10-4716-babb-adacc06ff055 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168282 Sep 13 20:12:24.560249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 739/1376] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:24 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:24.663250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bedb896b-0519-4269-8d44-f27cb39b5027 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:24.666783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bedb896b-0519-4269-8d44-f27cb39b5027 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:24.670630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=58 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:24.679143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bedb896b-0519-4269-8d44-f27cb39b5027 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:24.679941 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bedb896b-0519-4269-8d44-f27cb39b5027 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:24.680626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bedb896b-0519-4269-8d44-f27cb39b5027 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:24.681813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bedb896b-0519-4269-8d44-f27cb39b5027 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:24.682599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bedb896b-0519-4269-8d44-f27cb39b5027 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:24.683203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bedb896b-0519-4269-8d44-f27cb39b5027 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:24.714504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bedb896b-0519-4269-8d44-f27cb39b5027 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057989 Sep 13 20:12:24.715030 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 638/1377] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:24 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:25.584138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3f051d2a-df88-4746-bd23-7825dd4dc5d5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:25.584757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3f051d2a-df88-4746-bd23-7825dd4dc5d5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:25.591993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3f051d2a-df88-4746-bd23-7825dd4dc5d5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:25.592477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3f051d2a-df88-4746-bd23-7825dd4dc5d5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:25.592911 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3f051d2a-df88-4746-bd23-7825dd4dc5d5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:25.593611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3f051d2a-df88-4746-bd23-7825dd4dc5d5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:25.594062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3f051d2a-df88-4746-bd23-7825dd4dc5d5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:25.594515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3f051d2a-df88-4746-bd23-7825dd4dc5d5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:25.726897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d27aa934-36e2-4e09-8fed-2f0bd88417a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:25.729132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d27aa934-36e2-4e09-8fed-2f0bd88417a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:25.729337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3f051d2a-df88-4746-bd23-7825dd4dc5d5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:25.736257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d27aa934-36e2-4e09-8fed-2f0bd88417a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:25.736595 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d27aa934-36e2-4e09-8fed-2f0bd88417a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:25.737101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d27aa934-36e2-4e09-8fed-2f0bd88417a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:25.737799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d27aa934-36e2-4e09-8fed-2f0bd88417a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:25.738244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d27aa934-36e2-4e09-8fed-2f0bd88417a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:25.738723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3f051d2a-df88-4746-bd23-7825dd4dc5d5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158450 Sep 13 20:12:25.738883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d27aa934-36e2-4e09-8fed-2f0bd88417a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:25.750429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 740/1378] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:25 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:25.768822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d27aa934-36e2-4e09-8fed-2f0bd88417a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Sep 13 20:12:25.769349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 639/1379] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:26.767037 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-38893232-25d3-42a8-85c0-6ae70781ae5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:26.768060 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-38893232-25d3-42a8-85c0-6ae70781ae5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:26.778843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-38893232-25d3-42a8-85c0-6ae70781ae5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:26.779314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-38893232-25d3-42a8-85c0-6ae70781ae5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:26.779748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-38893232-25d3-42a8-85c0-6ae70781ae5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:26.780429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-38893232-25d3-42a8-85c0-6ae70781ae5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:26.780878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-38893232-25d3-42a8-85c0-6ae70781ae5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:26.781295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-38893232-25d3-42a8-85c0-6ae70781ae5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:26.782933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e0856062-df07-477b-8f70-aaecc1498ca5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:26.785182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e0856062-df07-477b-8f70-aaecc1498ca5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:26.791507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0856062-df07-477b-8f70-aaecc1498ca5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:26.791989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0856062-df07-477b-8f70-aaecc1498ca5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:26.792428 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0856062-df07-477b-8f70-aaecc1498ca5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:26.793105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0856062-df07-477b-8f70-aaecc1498ca5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:26.793556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0856062-df07-477b-8f70-aaecc1498ca5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:26.793979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0856062-df07-477b-8f70-aaecc1498ca5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:26.827597 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e0856062-df07-477b-8f70-aaecc1498ca5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048942 Sep 13 20:12:26.828125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 640/1380] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:26.916098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-38893232-25d3-42a8-85c0-6ae70781ae5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:26.925697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-38893232-25d3-42a8-85c0-6ae70781ae5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165279 Sep 13 20:12:26.926280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 741/1381] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:26 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:27.844810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c8b2884d-fa65-45b5-9d7d-72ea9a2805f1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:27.848223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c8b2884d-fa65-45b5-9d7d-72ea9a2805f1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:27.858203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8b2884d-fa65-45b5-9d7d-72ea9a2805f1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:27.858712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8b2884d-fa65-45b5-9d7d-72ea9a2805f1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:27.859144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8b2884d-fa65-45b5-9d7d-72ea9a2805f1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:27.859835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8b2884d-fa65-45b5-9d7d-72ea9a2805f1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:27.860277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8b2884d-fa65-45b5-9d7d-72ea9a2805f1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:27.860697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8b2884d-fa65-45b5-9d7d-72ea9a2805f1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:27.890614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c8b2884d-fa65-45b5-9d7d-72ea9a2805f1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052652 Sep 13 20:12:27.891188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 641/1382] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:27 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:27.948624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c54f01ef-dd09-49ae-a094-ea7d4f04b18d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:27.949197 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c54f01ef-dd09-49ae-a094-ea7d4f04b18d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:27.955900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c54f01ef-dd09-49ae-a094-ea7d4f04b18d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:27.956365 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c54f01ef-dd09-49ae-a094-ea7d4f04b18d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:27.956824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c54f01ef-dd09-49ae-a094-ea7d4f04b18d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:27.957496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c54f01ef-dd09-49ae-a094-ea7d4f04b18d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:27.957931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c54f01ef-dd09-49ae-a094-ea7d4f04b18d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:27.958341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c54f01ef-dd09-49ae-a094-ea7d4f04b18d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:28.095224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c54f01ef-dd09-49ae-a094-ea7d4f04b18d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:28.103520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c54f01ef-dd09-49ae-a094-ea7d4f04b18d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158870 Sep 13 20:12:28.104080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 742/1383] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:27 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:28.908152 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8f021711-ff13-4270-80b1-2942fe8e14cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:28.911791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8f021711-ff13-4270-80b1-2942fe8e14cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:28.922799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f021711-ff13-4270-80b1-2942fe8e14cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:28.923621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f021711-ff13-4270-80b1-2942fe8e14cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:28.924330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f021711-ff13-4270-80b1-2942fe8e14cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:28.925480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f021711-ff13-4270-80b1-2942fe8e14cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:28.926236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f021711-ff13-4270-80b1-2942fe8e14cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:28.926988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f021711-ff13-4270-80b1-2942fe8e14cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:28.961452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8f021711-ff13-4270-80b1-2942fe8e14cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060175 Sep 13 20:12:28.962023 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 642/1384] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:29.129991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c4fd3f0c-67f0-474f-b2ee-a44d136f4606 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:29.131050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c4fd3f0c-67f0-474f-b2ee-a44d136f4606 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:29.140568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4fd3f0c-67f0-474f-b2ee-a44d136f4606 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:29.141040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4fd3f0c-67f0-474f-b2ee-a44d136f4606 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:29.141460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4fd3f0c-67f0-474f-b2ee-a44d136f4606 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:29.142137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4fd3f0c-67f0-474f-b2ee-a44d136f4606 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:29.142621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4fd3f0c-67f0-474f-b2ee-a44d136f4606 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:29.143054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c4fd3f0c-67f0-474f-b2ee-a44d136f4606 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:29.274805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c4fd3f0c-67f0-474f-b2ee-a44d136f4606 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:29.283775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c4fd3f0c-67f0-474f-b2ee-a44d136f4606 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160320 Sep 13 20:12:29.284380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 743/1385] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:29 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:29.978667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-74b13f3a-48e7-4bed-a10b-e876d8bcf594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:29.982226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-74b13f3a-48e7-4bed-a10b-e876d8bcf594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:29.988979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74b13f3a-48e7-4bed-a10b-e876d8bcf594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:29.989477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74b13f3a-48e7-4bed-a10b-e876d8bcf594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:29.989926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74b13f3a-48e7-4bed-a10b-e876d8bcf594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:29.990675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74b13f3a-48e7-4bed-a10b-e876d8bcf594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:29.991140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74b13f3a-48e7-4bed-a10b-e876d8bcf594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:29.991575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74b13f3a-48e7-4bed-a10b-e876d8bcf594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:30.017548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:30.024531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-74b13f3a-48e7-4bed-a10b-e876d8bcf594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052848 Sep 13 20:12:30.025098 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 643/1386] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:12:30.307693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-04f0d19c-4800-459a-af11-6e23d6ad8078 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:30.308472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-04f0d19c-4800-459a-af11-6e23d6ad8078 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:30.310935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:12:30.311103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:12:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c (ip 10.222.0.52) !!! Sep 13 20:12:30.317296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-04f0d19c-4800-459a-af11-6e23d6ad8078 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:30.317778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-04f0d19c-4800-459a-af11-6e23d6ad8078 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:30.318208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-04f0d19c-4800-459a-af11-6e23d6ad8078 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:30.318937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-04f0d19c-4800-459a-af11-6e23d6ad8078 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:30.319384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-04f0d19c-4800-459a-af11-6e23d6ad8078 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:30.319815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-04f0d19c-4800-459a-af11-6e23d6ad8078 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:30.460832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-04f0d19c-4800-459a-af11-6e23d6ad8078 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:30.469541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-04f0d19c-4800-459a-af11-6e23d6ad8078 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165777 Sep 13 20:12:30.470336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 744/1387] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:30 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:31.037531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bfc11c17-27a3-4723-9259-6b9f3913726e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:31.039664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bfc11c17-27a3-4723-9259-6b9f3913726e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:31.041977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:12:31.042150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:12:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments (ip 10.222.0.52) !!! Sep 13 20:12:31.049878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bfc11c17-27a3-4723-9259-6b9f3913726e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:31.050160 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bfc11c17-27a3-4723-9259-6b9f3913726e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:31.050633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bfc11c17-27a3-4723-9259-6b9f3913726e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:31.051459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bfc11c17-27a3-4723-9259-6b9f3913726e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:31.052262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bfc11c17-27a3-4723-9259-6b9f3913726e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:31.053044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bfc11c17-27a3-4723-9259-6b9f3913726e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:31.091609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bfc11c17-27a3-4723-9259-6b9f3913726e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058111 Sep 13 20:12:31.092183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 644/1388] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:31 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:31.497561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6e44ae1f-c252-424a-8938-518eabc943a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:31.498582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6e44ae1f-c252-424a-8938-518eabc943a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:31.509714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e44ae1f-c252-424a-8938-518eabc943a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:31.510573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e44ae1f-c252-424a-8938-518eabc943a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:31.511291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e44ae1f-c252-424a-8938-518eabc943a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:31.512430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e44ae1f-c252-424a-8938-518eabc943a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:31.513176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e44ae1f-c252-424a-8938-518eabc943a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:31.513941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e44ae1f-c252-424a-8938-518eabc943a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:31.645378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6e44ae1f-c252-424a-8938-518eabc943a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:31.653722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6e44ae1f-c252-424a-8938-518eabc943a5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162695 Sep 13 20:12:31.654313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 745/1389] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:31 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:32.108488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f612f2ac-f222-4e31-a4b2-1d4bc7d5c14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:32.112199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f612f2ac-f222-4e31-a4b2-1d4bc7d5c14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:32.122969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f612f2ac-f222-4e31-a4b2-1d4bc7d5c14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:32.123471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f612f2ac-f222-4e31-a4b2-1d4bc7d5c14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:32.123912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f612f2ac-f222-4e31-a4b2-1d4bc7d5c14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:32.124596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f612f2ac-f222-4e31-a4b2-1d4bc7d5c14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:32.125042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f612f2ac-f222-4e31-a4b2-1d4bc7d5c14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:32.125416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f612f2ac-f222-4e31-a4b2-1d4bc7d5c14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:32.155769 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f612f2ac-f222-4e31-a4b2-1d4bc7d5c14e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053985 Sep 13 20:12:32.156339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 645/1390] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:32 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:32.677588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-44804e8e-b800-4804-83a9-6e6984ce84ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:32.678212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-44804e8e-b800-4804-83a9-6e6984ce84ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:32.685510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44804e8e-b800-4804-83a9-6e6984ce84ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:32.685988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44804e8e-b800-4804-83a9-6e6984ce84ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:32.686419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44804e8e-b800-4804-83a9-6e6984ce84ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:32.687125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44804e8e-b800-4804-83a9-6e6984ce84ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:32.687566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44804e8e-b800-4804-83a9-6e6984ce84ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:32.687967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44804e8e-b800-4804-83a9-6e6984ce84ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:32.837392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-44804e8e-b800-4804-83a9-6e6984ce84ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:32.846243 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-44804e8e-b800-4804-83a9-6e6984ce84ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.172748 Sep 13 20:12:32.846854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 746/1391] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:32 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:33.169755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b57b1672-7a2b-4307-bfec-85df52113969 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:33.171930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b57b1672-7a2b-4307-bfec-85df52113969 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:33.179573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b57b1672-7a2b-4307-bfec-85df52113969 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:33.180063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b57b1672-7a2b-4307-bfec-85df52113969 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:33.180495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b57b1672-7a2b-4307-bfec-85df52113969 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:33.181197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b57b1672-7a2b-4307-bfec-85df52113969 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:33.181644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b57b1672-7a2b-4307-bfec-85df52113969 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:33.182063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b57b1672-7a2b-4307-bfec-85df52113969 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:33.215776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b57b1672-7a2b-4307-bfec-85df52113969 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050210 Sep 13 20:12:33.216329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 646/1392] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:33 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:33.874077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6c8ef28a-f438-4391-b503-528e493c4ce1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:33.875170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6c8ef28a-f438-4391-b503-528e493c4ce1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:33.886805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c8ef28a-f438-4391-b503-528e493c4ce1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:33.887612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c8ef28a-f438-4391-b503-528e493c4ce1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:33.888939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c8ef28a-f438-4391-b503-528e493c4ce1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:33.889651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c8ef28a-f438-4391-b503-528e493c4ce1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:33.890115 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c8ef28a-f438-4391-b503-528e493c4ce1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:33.890594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6c8ef28a-f438-4391-b503-528e493c4ce1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:34.030405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6c8ef28a-f438-4391-b503-528e493c4ce1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:34.038679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6c8ef28a-f438-4391-b503-528e493c4ce1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.171183 Sep 13 20:12:34.039245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 747/1393] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:33 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:34.232704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4229372c-ffc4-4730-863d-dab75fec1b17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:34.236256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4229372c-ffc4-4730-863d-dab75fec1b17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:34.247171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4229372c-ffc4-4730-863d-dab75fec1b17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:34.247995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4229372c-ffc4-4730-863d-dab75fec1b17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:34.248426 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4229372c-ffc4-4730-863d-dab75fec1b17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:34.249114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4229372c-ffc4-4730-863d-dab75fec1b17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:34.249568 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4229372c-ffc4-4730-863d-dab75fec1b17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:34.249991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4229372c-ffc4-4730-863d-dab75fec1b17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:34.280064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4229372c-ffc4-4730-863d-dab75fec1b17 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054075 Sep 13 20:12:34.280837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 647/1394] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:34 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:35.073326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dfb39542-5dff-4899-a8c3-268fbbd5ebcf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:35.074340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dfb39542-5dff-4899-a8c3-268fbbd5ebcf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:35.085821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfb39542-5dff-4899-a8c3-268fbbd5ebcf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:35.086647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfb39542-5dff-4899-a8c3-268fbbd5ebcf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:35.087391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfb39542-5dff-4899-a8c3-268fbbd5ebcf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:35.088525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfb39542-5dff-4899-a8c3-268fbbd5ebcf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:35.089271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfb39542-5dff-4899-a8c3-268fbbd5ebcf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:35.089972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfb39542-5dff-4899-a8c3-268fbbd5ebcf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:35.223947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dfb39542-5dff-4899-a8c3-268fbbd5ebcf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:35.232457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dfb39542-5dff-4899-a8c3-268fbbd5ebcf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165674 Sep 13 20:12:35.233030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 748/1395] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:35 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:35.292879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6758d6e9-6730-4ddb-9753-aeb7fbf65b29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:35.295154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6758d6e9-6730-4ddb-9753-aeb7fbf65b29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:35.302119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6758d6e9-6730-4ddb-9753-aeb7fbf65b29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:35.302617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6758d6e9-6730-4ddb-9753-aeb7fbf65b29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:35.303067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6758d6e9-6730-4ddb-9753-aeb7fbf65b29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:35.303781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6758d6e9-6730-4ddb-9753-aeb7fbf65b29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:35.304224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6758d6e9-6730-4ddb-9753-aeb7fbf65b29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:35.304639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6758d6e9-6730-4ddb-9753-aeb7fbf65b29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:35.337000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6758d6e9-6730-4ddb-9753-aeb7fbf65b29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047707 Sep 13 20:12:35.337429 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 648/1396] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:35 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:36.258552 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e2245cde-7a13-498a-bc21-d5c847d6b23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:36.259346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e2245cde-7a13-498a-bc21-d5c847d6b23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:36.268814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2245cde-7a13-498a-bc21-d5c847d6b23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:36.269310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2245cde-7a13-498a-bc21-d5c847d6b23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:36.269762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2245cde-7a13-498a-bc21-d5c847d6b23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:36.270814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2245cde-7a13-498a-bc21-d5c847d6b23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:36.271285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2245cde-7a13-498a-bc21-d5c847d6b23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:36.271744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2245cde-7a13-498a-bc21-d5c847d6b23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:36.350546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1e4f18a8-b162-417d-965a-27c508cc3936 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:36.353258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1e4f18a8-b162-417d-965a-27c508cc3936 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:36.359993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e4f18a8-b162-417d-965a-27c508cc3936 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:36.360468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e4f18a8-b162-417d-965a-27c508cc3936 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:36.361188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e4f18a8-b162-417d-965a-27c508cc3936 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:36.361565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e4f18a8-b162-417d-965a-27c508cc3936 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:36.362049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e4f18a8-b162-417d-965a-27c508cc3936 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:36.362599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e4f18a8-b162-417d-965a-27c508cc3936 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:36.396687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1e4f18a8-b162-417d-965a-27c508cc3936 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050826 Sep 13 20:12:36.397594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 649/1397] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:36 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:36.424297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e2245cde-7a13-498a-bc21-d5c847d6b23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:36.432693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e2245cde-7a13-498a-bc21-d5c847d6b23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.180139 Sep 13 20:12:36.433250 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 749/1398] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:36 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:37.413530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-938eb398-2be5-43d3-8b38-8f311bedb06e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:37.417044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-938eb398-2be5-43d3-8b38-8f311bedb06e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:37.425525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-938eb398-2be5-43d3-8b38-8f311bedb06e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:37.426001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-938eb398-2be5-43d3-8b38-8f311bedb06e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:37.426465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-938eb398-2be5-43d3-8b38-8f311bedb06e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:37.427145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-938eb398-2be5-43d3-8b38-8f311bedb06e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:37.427588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-938eb398-2be5-43d3-8b38-8f311bedb06e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:37.427997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-938eb398-2be5-43d3-8b38-8f311bedb06e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:37.456289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a2fbd271-c6f2-47c2-af66-50e48586b7e9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:37.456964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a2fbd271-c6f2-47c2-af66-50e48586b7e9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:37.457872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-938eb398-2be5-43d3-8b38-8f311bedb06e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051127 Sep 13 20:12:37.458625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 650/1399] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:37 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:37.464726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2fbd271-c6f2-47c2-af66-50e48586b7e9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:37.465270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2fbd271-c6f2-47c2-af66-50e48586b7e9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:37.465794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2fbd271-c6f2-47c2-af66-50e48586b7e9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:37.466593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2fbd271-c6f2-47c2-af66-50e48586b7e9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:37.467109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2fbd271-c6f2-47c2-af66-50e48586b7e9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:37.467599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2fbd271-c6f2-47c2-af66-50e48586b7e9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:37.598079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a2fbd271-c6f2-47c2-af66-50e48586b7e9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:37.606693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a2fbd271-c6f2-47c2-af66-50e48586b7e9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155267 Sep 13 20:12:37.607234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 750/1400] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:37 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:38.475242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2204617a-7e70-45d4-a3d7-d54a141ac9b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:38.478738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2204617a-7e70-45d4-a3d7-d54a141ac9b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:38.489573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2204617a-7e70-45d4-a3d7-d54a141ac9b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:38.490408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2204617a-7e70-45d4-a3d7-d54a141ac9b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:38.491127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2204617a-7e70-45d4-a3d7-d54a141ac9b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:38.492274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2204617a-7e70-45d4-a3d7-d54a141ac9b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:38.493029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2204617a-7e70-45d4-a3d7-d54a141ac9b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:38.493722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2204617a-7e70-45d4-a3d7-d54a141ac9b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:38.525861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2204617a-7e70-45d4-a3d7-d54a141ac9b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057396 Sep 13 20:12:38.526424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 651/1401] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:38 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:38.632517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0ad99e71-dcdd-4aba-824f-5ea4dbeb7e1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:38.633524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0ad99e71-dcdd-4aba-824f-5ea4dbeb7e1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:38.644279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ad99e71-dcdd-4aba-824f-5ea4dbeb7e1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:38.645078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ad99e71-dcdd-4aba-824f-5ea4dbeb7e1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:38.645776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ad99e71-dcdd-4aba-824f-5ea4dbeb7e1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:38.646973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ad99e71-dcdd-4aba-824f-5ea4dbeb7e1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:38.647704 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ad99e71-dcdd-4aba-824f-5ea4dbeb7e1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:38.648385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ad99e71-dcdd-4aba-824f-5ea4dbeb7e1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:38.783235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0ad99e71-dcdd-4aba-824f-5ea4dbeb7e1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:38.792102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0ad99e71-dcdd-4aba-824f-5ea4dbeb7e1e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166133 Sep 13 20:12:38.792674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 751/1402] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:38 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:39.542241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-da6faf2e-4b9c-487f-a90f-75a5ae80d3f5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:39.545858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-da6faf2e-4b9c-487f-a90f-75a5ae80d3f5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:39.552903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6faf2e-4b9c-487f-a90f-75a5ae80d3f5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:39.553382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6faf2e-4b9c-487f-a90f-75a5ae80d3f5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:39.553900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6faf2e-4b9c-487f-a90f-75a5ae80d3f5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:39.554650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6faf2e-4b9c-487f-a90f-75a5ae80d3f5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:39.555095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6faf2e-4b9c-487f-a90f-75a5ae80d3f5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:39.555513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da6faf2e-4b9c-487f-a90f-75a5ae80d3f5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:39.586303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-da6faf2e-4b9c-487f-a90f-75a5ae80d3f5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050436 Sep 13 20:12:39.587037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 652/1403] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:39 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:39.819293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d0eca5d5-d50e-4771-a613-88696f023b33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:39.820278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d0eca5d5-d50e-4771-a613-88696f023b33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:39.831103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0eca5d5-d50e-4771-a613-88696f023b33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:39.831888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0eca5d5-d50e-4771-a613-88696f023b33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:39.832598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0eca5d5-d50e-4771-a613-88696f023b33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:39.833707 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0eca5d5-d50e-4771-a613-88696f023b33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:39.834527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0eca5d5-d50e-4771-a613-88696f023b33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:39.835183 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0eca5d5-d50e-4771-a613-88696f023b33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:39.971681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d0eca5d5-d50e-4771-a613-88696f023b33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:39.984520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d0eca5d5-d50e-4771-a613-88696f023b33 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.171479 Sep 13 20:12:39.985274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 752/1404] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:39 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:40.599668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f1c180fd-6761-421f-a609-4d94bea12d82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:40.601977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f1c180fd-6761-421f-a609-4d94bea12d82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:40.609209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1c180fd-6761-421f-a609-4d94bea12d82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:40.609758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1c180fd-6761-421f-a609-4d94bea12d82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:40.610189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1c180fd-6761-421f-a609-4d94bea12d82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:40.611015 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1c180fd-6761-421f-a609-4d94bea12d82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:40.611482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1c180fd-6761-421f-a609-4d94bea12d82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:40.611920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1c180fd-6761-421f-a609-4d94bea12d82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:40.643306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f1c180fd-6761-421f-a609-4d94bea12d82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047926 Sep 13 20:12:40.643856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 653/1405] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:40 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:41.016771 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2a48fead-2834-4127-8f07-cd87221d7909 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:41.017447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2a48fead-2834-4127-8f07-cd87221d7909 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:41.025391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a48fead-2834-4127-8f07-cd87221d7909 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:41.025943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a48fead-2834-4127-8f07-cd87221d7909 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:41.026479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a48fead-2834-4127-8f07-cd87221d7909 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:41.027273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a48fead-2834-4127-8f07-cd87221d7909 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:41.027791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a48fead-2834-4127-8f07-cd87221d7909 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:41.028279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2a48fead-2834-4127-8f07-cd87221d7909 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:41.165115 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2a48fead-2834-4127-8f07-cd87221d7909 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:41.173402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2a48fead-2834-4127-8f07-cd87221d7909 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162955 Sep 13 20:12:41.173970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 753/1406] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:41 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:41.659617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7aca2ef4-6885-4405-a418-7d126d3c8b28 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:41.663253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7aca2ef4-6885-4405-a418-7d126d3c8b28 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:41.673373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7aca2ef4-6885-4405-a418-7d126d3c8b28 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:41.673850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7aca2ef4-6885-4405-a418-7d126d3c8b28 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:41.674278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7aca2ef4-6885-4405-a418-7d126d3c8b28 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:41.675013 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7aca2ef4-6885-4405-a418-7d126d3c8b28 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:41.675455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7aca2ef4-6885-4405-a418-7d126d3c8b28 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:41.675879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7aca2ef4-6885-4405-a418-7d126d3c8b28 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:41.705639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7aca2ef4-6885-4405-a418-7d126d3c8b28 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052736 Sep 13 20:12:41.706215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 654/1407] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:41 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:42.200821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c078e2e2-9e85-4038-b2da-c9e3034aaceb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:42.201875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c078e2e2-9e85-4038-b2da-c9e3034aaceb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:42.213224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c078e2e2-9e85-4038-b2da-c9e3034aaceb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:42.214013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c078e2e2-9e85-4038-b2da-c9e3034aaceb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:42.214792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c078e2e2-9e85-4038-b2da-c9e3034aaceb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:42.215929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c078e2e2-9e85-4038-b2da-c9e3034aaceb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:42.216686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c078e2e2-9e85-4038-b2da-c9e3034aaceb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:42.217384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c078e2e2-9e85-4038-b2da-c9e3034aaceb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:42.232792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:42.347832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c078e2e2-9e85-4038-b2da-c9e3034aaceb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:42.356337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c078e2e2-9e85-4038-b2da-c9e3034aaceb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162162 Sep 13 20:12:42.356907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 754/1408] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:42 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:42.721325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9ee5ba0b-4941-4add-9797-c961e3073f35 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:42.723520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9ee5ba0b-4941-4add-9797-c961e3073f35 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:42.730490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ee5ba0b-4941-4add-9797-c961e3073f35 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:42.730972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ee5ba0b-4941-4add-9797-c961e3073f35 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:42.731401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ee5ba0b-4941-4add-9797-c961e3073f35 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:42.732097 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ee5ba0b-4941-4add-9797-c961e3073f35 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:42.732544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ee5ba0b-4941-4add-9797-c961e3073f35 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:42.732963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ee5ba0b-4941-4add-9797-c961e3073f35 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:42.764200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9ee5ba0b-4941-4add-9797-c961e3073f35 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048210 Sep 13 20:12:42.764772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 655/1409] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:42 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:43.379962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-76350b4a-c82c-4419-a4b9-6eb2a799d2ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:43.380648 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-76350b4a-c82c-4419-a4b9-6eb2a799d2ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:43.387124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76350b4a-c82c-4419-a4b9-6eb2a799d2ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:43.387602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76350b4a-c82c-4419-a4b9-6eb2a799d2ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:43.388027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76350b4a-c82c-4419-a4b9-6eb2a799d2ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:43.388712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76350b4a-c82c-4419-a4b9-6eb2a799d2ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:43.389181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76350b4a-c82c-4419-a4b9-6eb2a799d2ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:43.389571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76350b4a-c82c-4419-a4b9-6eb2a799d2ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:43.528684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-76350b4a-c82c-4419-a4b9-6eb2a799d2ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:43.537075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-76350b4a-c82c-4419-a4b9-6eb2a799d2ec tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161294 Sep 13 20:12:43.537647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 755/1410] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:43 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:43.781680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-820643e4-21cf-4c16-b69f-c1054df7fdba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:43.785022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-820643e4-21cf-4c16-b69f-c1054df7fdba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:43.795873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-820643e4-21cf-4c16-b69f-c1054df7fdba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:43.796652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-820643e4-21cf-4c16-b69f-c1054df7fdba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:43.797257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-820643e4-21cf-4c16-b69f-c1054df7fdba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:43.797940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-820643e4-21cf-4c16-b69f-c1054df7fdba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:43.798402 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-820643e4-21cf-4c16-b69f-c1054df7fdba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:43.798840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-820643e4-21cf-4c16-b69f-c1054df7fdba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:43.830535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-820643e4-21cf-4c16-b69f-c1054df7fdba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055968 Sep 13 20:12:43.831143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 656/1411] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:43 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:44.568122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-82c82003-5e6a-494f-82ed-94513e738a04 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:44.568839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-82c82003-5e6a-494f-82ed-94513e738a04 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:44.577225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82c82003-5e6a-494f-82ed-94513e738a04 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:44.577840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82c82003-5e6a-494f-82ed-94513e738a04 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:44.578424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82c82003-5e6a-494f-82ed-94513e738a04 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:44.579147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82c82003-5e6a-494f-82ed-94513e738a04 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:44.579592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82c82003-5e6a-494f-82ed-94513e738a04 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:44.580006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82c82003-5e6a-494f-82ed-94513e738a04 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:44.714886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-82c82003-5e6a-494f-82ed-94513e738a04 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:44.723695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-82c82003-5e6a-494f-82ed-94513e738a04 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160477 Sep 13 20:12:44.724257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 756/1412] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:44 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:44.847891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2e5ea77a-d386-44ad-925b-c2df002ee30e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:44.851425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2e5ea77a-d386-44ad-925b-c2df002ee30e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:44.861073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e5ea77a-d386-44ad-925b-c2df002ee30e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:44.861550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e5ea77a-d386-44ad-925b-c2df002ee30e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:44.861999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e5ea77a-d386-44ad-925b-c2df002ee30e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:44.862697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e5ea77a-d386-44ad-925b-c2df002ee30e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:44.863136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e5ea77a-d386-44ad-925b-c2df002ee30e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:44.863549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e5ea77a-d386-44ad-925b-c2df002ee30e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:44.893868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2e5ea77a-d386-44ad-925b-c2df002ee30e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053449 Sep 13 20:12:44.894454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 657/1413] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:44 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:45.752630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2fec9316-0529-4675-8c22-a0b3d66f5534 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:45.753643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2fec9316-0529-4675-8c22-a0b3d66f5534 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:45.764664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fec9316-0529-4675-8c22-a0b3d66f5534 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:45.765448 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fec9316-0529-4675-8c22-a0b3d66f5534 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:45.766444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fec9316-0529-4675-8c22-a0b3d66f5534 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:45.767588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fec9316-0529-4675-8c22-a0b3d66f5534 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:45.768329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fec9316-0529-4675-8c22-a0b3d66f5534 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:45.769064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2fec9316-0529-4675-8c22-a0b3d66f5534 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:45.905835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2fec9316-0529-4675-8c22-a0b3d66f5534 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:45.907252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7f4d987a-8ade-43f5-8f2a-7da6c0196a63 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:45.909529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7f4d987a-8ade-43f5-8f2a-7da6c0196a63 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:45.914758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2fec9316-0529-4675-8c22-a0b3d66f5534 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168751 Sep 13 20:12:45.915339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 757/1414] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:45 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:45.916194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f4d987a-8ade-43f5-8f2a-7da6c0196a63 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:45.916691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f4d987a-8ade-43f5-8f2a-7da6c0196a63 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:45.917121 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f4d987a-8ade-43f5-8f2a-7da6c0196a63 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:45.917822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f4d987a-8ade-43f5-8f2a-7da6c0196a63 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:45.918239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f4d987a-8ade-43f5-8f2a-7da6c0196a63 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:45.920328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f4d987a-8ade-43f5-8f2a-7da6c0196a63 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:45.951504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7f4d987a-8ade-43f5-8f2a-7da6c0196a63 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048412 Sep 13 20:12:45.952040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 658/1415] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:45 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:46.942862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2337aa70-9a4b-42f9-9da6-0e15d6a700f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:46.943694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2337aa70-9a4b-42f9-9da6-0e15d6a700f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:46.954204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2337aa70-9a4b-42f9-9da6-0e15d6a700f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:46.954720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2337aa70-9a4b-42f9-9da6-0e15d6a700f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:46.955156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2337aa70-9a4b-42f9-9da6-0e15d6a700f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:46.955847 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2337aa70-9a4b-42f9-9da6-0e15d6a700f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:46.956293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2337aa70-9a4b-42f9-9da6-0e15d6a700f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:46.956714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2337aa70-9a4b-42f9-9da6-0e15d6a700f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:46.964375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-db93e182-9976-4c2b-a3da-9745adaa69a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:46.966621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-db93e182-9976-4c2b-a3da-9745adaa69a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:46.973378 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-db93e182-9976-4c2b-a3da-9745adaa69a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:46.973863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-db93e182-9976-4c2b-a3da-9745adaa69a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:46.974295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-db93e182-9976-4c2b-a3da-9745adaa69a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:46.975027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-db93e182-9976-4c2b-a3da-9745adaa69a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:46.975480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-db93e182-9976-4c2b-a3da-9745adaa69a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:46.975905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-db93e182-9976-4c2b-a3da-9745adaa69a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:47.006784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-db93e182-9976-4c2b-a3da-9745adaa69a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046681 Sep 13 20:12:47.007525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 659/1416] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:46 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:47.093689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2337aa70-9a4b-42f9-9da6-0e15d6a700f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:47.102168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2337aa70-9a4b-42f9-9da6-0e15d6a700f0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166033 Sep 13 20:12:47.102797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 758/1417] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:46 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:48.023589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-288c90ab-dc71-45aa-bb12-7e236fa1c73d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:48.027211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-288c90ab-dc71-45aa-bb12-7e236fa1c73d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:48.035839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-288c90ab-dc71-45aa-bb12-7e236fa1c73d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:48.036321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-288c90ab-dc71-45aa-bb12-7e236fa1c73d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:48.036752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-288c90ab-dc71-45aa-bb12-7e236fa1c73d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:48.037441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-288c90ab-dc71-45aa-bb12-7e236fa1c73d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:48.037891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-288c90ab-dc71-45aa-bb12-7e236fa1c73d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:48.038314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-288c90ab-dc71-45aa-bb12-7e236fa1c73d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:48.051988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:48.068949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-288c90ab-dc71-45aa-bb12-7e236fa1c73d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052096 Sep 13 20:12:48.069502 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 660/1418] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:48 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:48.127924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-00497be3-ed29-4f64-a088-d1dad7c3bd4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:48.128511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-00497be3-ed29-4f64-a088-d1dad7c3bd4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:48.135319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00497be3-ed29-4f64-a088-d1dad7c3bd4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:48.135794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00497be3-ed29-4f64-a088-d1dad7c3bd4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:48.136219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00497be3-ed29-4f64-a088-d1dad7c3bd4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:48.136927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00497be3-ed29-4f64-a088-d1dad7c3bd4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:48.137372 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00497be3-ed29-4f64-a088-d1dad7c3bd4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:48.137791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00497be3-ed29-4f64-a088-d1dad7c3bd4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:48.275473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-00497be3-ed29-4f64-a088-d1dad7c3bd4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:48.287589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-00497be3-ed29-4f64-a088-d1dad7c3bd4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163554 Sep 13 20:12:48.288348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 759/1419] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:48 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:49.086162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7a40015d-2352-4f38-a719-97623cf99061 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:49.090905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7a40015d-2352-4f38-a719-97623cf99061 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:49.102100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a40015d-2352-4f38-a719-97623cf99061 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:49.102963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a40015d-2352-4f38-a719-97623cf99061 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:49.103688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a40015d-2352-4f38-a719-97623cf99061 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:49.104808 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a40015d-2352-4f38-a719-97623cf99061 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:49.105570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a40015d-2352-4f38-a719-97623cf99061 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:49.106274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a40015d-2352-4f38-a719-97623cf99061 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:49.139349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7a40015d-2352-4f38-a719-97623cf99061 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060233 Sep 13 20:12:49.139914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 661/1420] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:49 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:49.316468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e0d96821-2361-43d7-880d-3f12e3c6d55b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:49.317969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e0d96821-2361-43d7-880d-3f12e3c6d55b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:49.328906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0d96821-2361-43d7-880d-3f12e3c6d55b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:49.329385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0d96821-2361-43d7-880d-3f12e3c6d55b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:49.329819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0d96821-2361-43d7-880d-3f12e3c6d55b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:49.330548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0d96821-2361-43d7-880d-3f12e3c6d55b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:49.330998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0d96821-2361-43d7-880d-3f12e3c6d55b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:49.331419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0d96821-2361-43d7-880d-3f12e3c6d55b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:49.462778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e0d96821-2361-43d7-880d-3f12e3c6d55b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:49.471485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e0d96821-2361-43d7-880d-3f12e3c6d55b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162131 Sep 13 20:12:49.472086 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 760/1421] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:49 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:50.156092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-edd5bbac-54e8-4f38-ae8e-df280c017015 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:50.158965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-edd5bbac-54e8-4f38-ae8e-df280c017015 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:50.166891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-edd5bbac-54e8-4f38-ae8e-df280c017015 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:50.167456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-edd5bbac-54e8-4f38-ae8e-df280c017015 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:50.168018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-edd5bbac-54e8-4f38-ae8e-df280c017015 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:50.168769 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-edd5bbac-54e8-4f38-ae8e-df280c017015 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:50.169294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-edd5bbac-54e8-4f38-ae8e-df280c017015 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:50.169789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-edd5bbac-54e8-4f38-ae8e-df280c017015 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:50.202955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-edd5bbac-54e8-4f38-ae8e-df280c017015 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053673 Sep 13 20:12:50.203516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 662/1422] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:50 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:50.499196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2c6c69dd-c54c-4035-8931-260c0941c7d8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:50.500143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2c6c69dd-c54c-4035-8931-260c0941c7d8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:50.511059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c6c69dd-c54c-4035-8931-260c0941c7d8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:50.511839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c6c69dd-c54c-4035-8931-260c0941c7d8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:50.512557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c6c69dd-c54c-4035-8931-260c0941c7d8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:50.513665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c6c69dd-c54c-4035-8931-260c0941c7d8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:50.514455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c6c69dd-c54c-4035-8931-260c0941c7d8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:50.515143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c6c69dd-c54c-4035-8931-260c0941c7d8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:50.651641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2c6c69dd-c54c-4035-8931-260c0941c7d8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:50.660232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2c6c69dd-c54c-4035-8931-260c0941c7d8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167519 Sep 13 20:12:50.660780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 761/1423] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:50 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:51.220273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0371240b-c5ea-4379-9d97-73a42f64c5d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:51.222695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0371240b-c5ea-4379-9d97-73a42f64c5d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:51.230190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0371240b-c5ea-4379-9d97-73a42f64c5d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:51.230763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0371240b-c5ea-4379-9d97-73a42f64c5d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:51.231273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0371240b-c5ea-4379-9d97-73a42f64c5d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:51.232039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0371240b-c5ea-4379-9d97-73a42f64c5d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:51.232537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0371240b-c5ea-4379-9d97-73a42f64c5d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:51.233005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0371240b-c5ea-4379-9d97-73a42f64c5d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:51.264435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0371240b-c5ea-4379-9d97-73a42f64c5d0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050889 Sep 13 20:12:51.265013 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 663/1424] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:51 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:51.686209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4290520e-5d29-4d60-9d95-e6f434c2e785 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:51.686893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4290520e-5d29-4d60-9d95-e6f434c2e785 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:51.694007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4290520e-5d29-4d60-9d95-e6f434c2e785 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:51.694517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4290520e-5d29-4d60-9d95-e6f434c2e785 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:51.694950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4290520e-5d29-4d60-9d95-e6f434c2e785 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:51.695652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4290520e-5d29-4d60-9d95-e6f434c2e785 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:51.696083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4290520e-5d29-4d60-9d95-e6f434c2e785 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:51.696525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4290520e-5d29-4d60-9d95-e6f434c2e785 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:51.827574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4290520e-5d29-4d60-9d95-e6f434c2e785 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:51.836406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4290520e-5d29-4d60-9d95-e6f434c2e785 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155769 Sep 13 20:12:51.836983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 762/1425] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:51 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:52.281519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cc3fe11e-5304-41f8-83f2-ec65d22dc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:52.285003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cc3fe11e-5304-41f8-83f2-ec65d22dc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:52.295781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cc3fe11e-5304-41f8-83f2-ec65d22dc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:52.296564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cc3fe11e-5304-41f8-83f2-ec65d22dc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:52.297278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cc3fe11e-5304-41f8-83f2-ec65d22dc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:52.298242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cc3fe11e-5304-41f8-83f2-ec65d22dc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:52.298717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cc3fe11e-5304-41f8-83f2-ec65d22dc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:52.299129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cc3fe11e-5304-41f8-83f2-ec65d22dc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:52.329298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cc3fe11e-5304-41f8-83f2-ec65d22dc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054395 Sep 13 20:12:52.329898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 664/1426] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:52 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:52.864090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-23e17c42-3f1d-4789-a276-eab5f59f2d9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:52.864955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-23e17c42-3f1d-4789-a276-eab5f59f2d9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:52.875696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23e17c42-3f1d-4789-a276-eab5f59f2d9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:52.876477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23e17c42-3f1d-4789-a276-eab5f59f2d9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:52.877167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23e17c42-3f1d-4789-a276-eab5f59f2d9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:52.878276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23e17c42-3f1d-4789-a276-eab5f59f2d9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:52.879060 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23e17c42-3f1d-4789-a276-eab5f59f2d9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:52.879747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23e17c42-3f1d-4789-a276-eab5f59f2d9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:53.020011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-23e17c42-3f1d-4789-a276-eab5f59f2d9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:53.028649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-23e17c42-3f1d-4789-a276-eab5f59f2d9c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.171292 Sep 13 20:12:53.029241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 763/1427] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:52 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:53.346564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5fcd3dee-394b-44b6-aa87-eb5e4037d392 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:53.348788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5fcd3dee-394b-44b6-aa87-eb5e4037d392 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:53.355863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5fcd3dee-394b-44b6-aa87-eb5e4037d392 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:53.356343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5fcd3dee-394b-44b6-aa87-eb5e4037d392 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:53.356777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5fcd3dee-394b-44b6-aa87-eb5e4037d392 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:53.357460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5fcd3dee-394b-44b6-aa87-eb5e4037d392 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:53.357907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5fcd3dee-394b-44b6-aa87-eb5e4037d392 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:53.358327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5fcd3dee-394b-44b6-aa87-eb5e4037d392 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:53.388738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5fcd3dee-394b-44b6-aa87-eb5e4037d392 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048610 Sep 13 20:12:53.389308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 665/1428] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:53 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:54.051321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1f440bff-fe66-41e3-8b2f-9ac5632e7501 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:54.051946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1f440bff-fe66-41e3-8b2f-9ac5632e7501 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:54.058844 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f440bff-fe66-41e3-8b2f-9ac5632e7501 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:54.059332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f440bff-fe66-41e3-8b2f-9ac5632e7501 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:54.059764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f440bff-fe66-41e3-8b2f-9ac5632e7501 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:54.061116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f440bff-fe66-41e3-8b2f-9ac5632e7501 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:54.061575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f440bff-fe66-41e3-8b2f-9ac5632e7501 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:54.061982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f440bff-fe66-41e3-8b2f-9ac5632e7501 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:54.192932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1f440bff-fe66-41e3-8b2f-9ac5632e7501 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:54.201478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1f440bff-fe66-41e3-8b2f-9ac5632e7501 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.154075 Sep 13 20:12:54.202063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 764/1429] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:54 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:54.405837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e1652a2a-590e-4044-b776-8b253316f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:54.409430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e1652a2a-590e-4044-b776-8b253316f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:54.420474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e1652a2a-590e-4044-b776-8b253316f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:54.421264 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e1652a2a-590e-4044-b776-8b253316f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:54.421979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e1652a2a-590e-4044-b776-8b253316f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:54.423161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e1652a2a-590e-4044-b776-8b253316f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:54.424174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e1652a2a-590e-4044-b776-8b253316f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:54.424749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e1652a2a-590e-4044-b776-8b253316f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:54.454830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e1652a2a-590e-4044-b776-8b253316f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055807 Sep 13 20:12:54.455483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 666/1430] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:54 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:55.225506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-da4e78a2-a936-4ddc-a198-12ee5d264abc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:55.226104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-da4e78a2-a936-4ddc-a198-12ee5d264abc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:55.228459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:55.233624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-da4e78a2-a936-4ddc-a198-12ee5d264abc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:55.234095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-da4e78a2-a936-4ddc-a198-12ee5d264abc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:55.234537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-da4e78a2-a936-4ddc-a198-12ee5d264abc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:55.235210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-da4e78a2-a936-4ddc-a198-12ee5d264abc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:55.235647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-da4e78a2-a936-4ddc-a198-12ee5d264abc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:55.236058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-da4e78a2-a936-4ddc-a198-12ee5d264abc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:55.373047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-da4e78a2-a936-4ddc-a198-12ee5d264abc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:55.381405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-da4e78a2-a936-4ddc-a198-12ee5d264abc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.159748 Sep 13 20:12:55.381966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 765/1431] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:55 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:55.472123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b2fe27e4-fc8c-4522-9157-9e83ee9c9db7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:55.474980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b2fe27e4-fc8c-4522-9157-9e83ee9c9db7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:55.477921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=58 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:55.485047 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b2fe27e4-fc8c-4522-9157-9e83ee9c9db7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:55.485689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b2fe27e4-fc8c-4522-9157-9e83ee9c9db7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:55.486397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b2fe27e4-fc8c-4522-9157-9e83ee9c9db7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:55.487315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b2fe27e4-fc8c-4522-9157-9e83ee9c9db7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:55.487915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b2fe27e4-fc8c-4522-9157-9e83ee9c9db7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:55.488492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b2fe27e4-fc8c-4522-9157-9e83ee9c9db7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:55.522518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b2fe27e4-fc8c-4522-9157-9e83ee9c9db7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057075 Sep 13 20:12:55.523237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 667/1432] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:55 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:56.408558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-69471fcb-8b91-4202-8d92-f6ec087a772b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:56.409170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-69471fcb-8b91-4202-8d92-f6ec087a772b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:56.417189 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69471fcb-8b91-4202-8d92-f6ec087a772b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:56.417782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69471fcb-8b91-4202-8d92-f6ec087a772b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:56.418263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69471fcb-8b91-4202-8d92-f6ec087a772b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:56.419119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69471fcb-8b91-4202-8d92-f6ec087a772b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:56.419649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69471fcb-8b91-4202-8d92-f6ec087a772b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:56.420145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69471fcb-8b91-4202-8d92-f6ec087a772b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:56.534678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3d1433d6-8c90-49d5-b2e5-3b47335b4893 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:56.536850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3d1433d6-8c90-49d5-b2e5-3b47335b4893 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:56.543724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3d1433d6-8c90-49d5-b2e5-3b47335b4893 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:56.544216 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3d1433d6-8c90-49d5-b2e5-3b47335b4893 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:56.544621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3d1433d6-8c90-49d5-b2e5-3b47335b4893 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:56.545358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3d1433d6-8c90-49d5-b2e5-3b47335b4893 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:56.545806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3d1433d6-8c90-49d5-b2e5-3b47335b4893 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:56.546226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3d1433d6-8c90-49d5-b2e5-3b47335b4893 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:56.555601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-69471fcb-8b91-4202-8d92-f6ec087a772b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:56.564839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-69471fcb-8b91-4202-8d92-f6ec087a772b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162982 Sep 13 20:12:56.566010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 766/1433] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:56 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:56.579029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3d1433d6-8c90-49d5-b2e5-3b47335b4893 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048317 Sep 13 20:12:56.579706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 668/1434] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:56 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:57.590662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-911dcc62-22cd-42f8-8eae-e987a67d860f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:57.591363 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-911dcc62-22cd-42f8-8eae-e987a67d860f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:57.593250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-38ec2e0b-0aba-47da-bd81-cec8b6d3e4c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:57.595804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-38ec2e0b-0aba-47da-bd81-cec8b6d3e4c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:57.599284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-911dcc62-22cd-42f8-8eae-e987a67d860f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:57.600147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-911dcc62-22cd-42f8-8eae-e987a67d860f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:57.600579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-911dcc62-22cd-42f8-8eae-e987a67d860f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:57.601291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-911dcc62-22cd-42f8-8eae-e987a67d860f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:57.601705 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-911dcc62-22cd-42f8-8eae-e987a67d860f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:57.602145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-911dcc62-22cd-42f8-8eae-e987a67d860f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:57.603026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-38ec2e0b-0aba-47da-bd81-cec8b6d3e4c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:57.603500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-38ec2e0b-0aba-47da-bd81-cec8b6d3e4c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:57.603932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-38ec2e0b-0aba-47da-bd81-cec8b6d3e4c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:57.604619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-38ec2e0b-0aba-47da-bd81-cec8b6d3e4c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:57.605065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-38ec2e0b-0aba-47da-bd81-cec8b6d3e4c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:57.605479 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-38ec2e0b-0aba-47da-bd81-cec8b6d3e4c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:57.635793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-38ec2e0b-0aba-47da-bd81-cec8b6d3e4c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047155 Sep 13 20:12:57.636319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 669/1435] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:57 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:12:57.735668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-911dcc62-22cd-42f8-8eae-e987a67d860f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:57.744219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-911dcc62-22cd-42f8-8eae-e987a67d860f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158608 Sep 13 20:12:57.744789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 767/1436] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:57 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:58.652619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e2d860f4-4bd4-4b0e-94f6-30c4407ca771 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:58.656183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e2d860f4-4bd4-4b0e-94f6-30c4407ca771 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:58.667244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2d860f4-4bd4-4b0e-94f6-30c4407ca771 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:58.668039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2d860f4-4bd4-4b0e-94f6-30c4407ca771 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:58.670404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2d860f4-4bd4-4b0e-94f6-30c4407ca771 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:58.671635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2d860f4-4bd4-4b0e-94f6-30c4407ca771 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:58.672419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2d860f4-4bd4-4b0e-94f6-30c4407ca771 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:58.673152 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2d860f4-4bd4-4b0e-94f6-30c4407ca771 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:58.704777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e2d860f4-4bd4-4b0e-94f6-30c4407ca771 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058821 Sep 13 20:12:58.705332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 670/1437] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:58 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:58.768899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2733632c-02dc-414a-878c-6c2df1a8e79b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:58.769524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2733632c-02dc-414a-878c-6c2df1a8e79b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:58.776710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2733632c-02dc-414a-878c-6c2df1a8e79b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:58.777185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2733632c-02dc-414a-878c-6c2df1a8e79b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:58.777619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2733632c-02dc-414a-878c-6c2df1a8e79b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:58.778312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2733632c-02dc-414a-878c-6c2df1a8e79b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:58.778795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2733632c-02dc-414a-878c-6c2df1a8e79b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:58.779214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2733632c-02dc-414a-878c-6c2df1a8e79b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:58.923723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2733632c-02dc-414a-878c-6c2df1a8e79b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:12:58.932290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2733632c-02dc-414a-878c-6c2df1a8e79b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167382 Sep 13 20:12:58.932879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 768/1438] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:58 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:12:59.722076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f1cfd653-45e4-415a-8b30-4c4175fe93d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:59.725635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f1cfd653-45e4-415a-8b30-4c4175fe93d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:59.736001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1cfd653-45e4-415a-8b30-4c4175fe93d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:59.736781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1cfd653-45e4-415a-8b30-4c4175fe93d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:59.737549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1cfd653-45e4-415a-8b30-4c4175fe93d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:59.738852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1cfd653-45e4-415a-8b30-4c4175fe93d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:59.739303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1cfd653-45e4-415a-8b30-4c4175fe93d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:59.739718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1cfd653-45e4-415a-8b30-4c4175fe93d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:59.769721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f1cfd653-45e4-415a-8b30-4c4175fe93d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054326 Sep 13 20:12:59.770283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 671/1439] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:12:59 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:12:59.959653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dd3910a4-b08f-4fc1-b59a-bc647b82921b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:12:59.960516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dd3910a4-b08f-4fc1-b59a-bc647b82921b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:12:59.971619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd3910a4-b08f-4fc1-b59a-bc647b82921b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:59.972414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd3910a4-b08f-4fc1-b59a-bc647b82921b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:59.973223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd3910a4-b08f-4fc1-b59a-bc647b82921b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:12:59.973915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd3910a4-b08f-4fc1-b59a-bc647b82921b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:12:59.974396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd3910a4-b08f-4fc1-b59a-bc647b82921b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:12:59.974814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd3910a4-b08f-4fc1-b59a-bc647b82921b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:00.114084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dd3910a4-b08f-4fc1-b59a-bc647b82921b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:00.122964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dd3910a4-b08f-4fc1-b59a-bc647b82921b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.170192 Sep 13 20:13:00.123536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 769/1440] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:12:59 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:00.784175 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e78c24cf-4c41-4d2f-87f7-ff813a2f663a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:00.790761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e78c24cf-4c41-4d2f-87f7-ff813a2f663a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:00.803814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e78c24cf-4c41-4d2f-87f7-ff813a2f663a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:00.804440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e78c24cf-4c41-4d2f-87f7-ff813a2f663a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:00.804726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e78c24cf-4c41-4d2f-87f7-ff813a2f663a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:00.805420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e78c24cf-4c41-4d2f-87f7-ff813a2f663a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:00.805868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e78c24cf-4c41-4d2f-87f7-ff813a2f663a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:00.806289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e78c24cf-4c41-4d2f-87f7-ff813a2f663a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:00.838844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e78c24cf-4c41-4d2f-87f7-ff813a2f663a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059338 Sep 13 20:13:00.839407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 672/1441] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:00 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:01.145955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7371c1cf-5c9c-45a2-85d1-a6809bf22456 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:01.146550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7371c1cf-5c9c-45a2-85d1-a6809bf22456 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:01.154400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7371c1cf-5c9c-45a2-85d1-a6809bf22456 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:01.154943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7371c1cf-5c9c-45a2-85d1-a6809bf22456 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:01.155373 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7371c1cf-5c9c-45a2-85d1-a6809bf22456 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:01.156061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7371c1cf-5c9c-45a2-85d1-a6809bf22456 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:01.156507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7371c1cf-5c9c-45a2-85d1-a6809bf22456 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:01.156982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7371c1cf-5c9c-45a2-85d1-a6809bf22456 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:01.290100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7371c1cf-5c9c-45a2-85d1-a6809bf22456 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:01.298407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7371c1cf-5c9c-45a2-85d1-a6809bf22456 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156509 Sep 13 20:13:01.299003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 770/1442] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:01 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:01.855838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-166317ec-a825-4e61-aa8a-5609e4446910 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:01.859260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-166317ec-a825-4e61-aa8a-5609e4446910 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:01.867879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-166317ec-a825-4e61-aa8a-5609e4446910 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:01.868298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-166317ec-a825-4e61-aa8a-5609e4446910 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:01.868740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-166317ec-a825-4e61-aa8a-5609e4446910 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:01.869420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-166317ec-a825-4e61-aa8a-5609e4446910 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:01.869867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-166317ec-a825-4e61-aa8a-5609e4446910 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:01.870295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-166317ec-a825-4e61-aa8a-5609e4446910 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:01.900294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-166317ec-a825-4e61-aa8a-5609e4446910 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051301 Sep 13 20:13:01.901203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 673/1443] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:02.325480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1dfbb0c7-3f8f-450b-a811-80f04316d435 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:02.326474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1dfbb0c7-3f8f-450b-a811-80f04316d435 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:02.337937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1dfbb0c7-3f8f-450b-a811-80f04316d435 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:02.338780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1dfbb0c7-3f8f-450b-a811-80f04316d435 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:02.339494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1dfbb0c7-3f8f-450b-a811-80f04316d435 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:02.340664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1dfbb0c7-3f8f-450b-a811-80f04316d435 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:02.341410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1dfbb0c7-3f8f-450b-a811-80f04316d435 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:02.342131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1dfbb0c7-3f8f-450b-a811-80f04316d435 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:02.346438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:02.475022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1dfbb0c7-3f8f-450b-a811-80f04316d435 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:02.483915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1dfbb0c7-3f8f-450b-a811-80f04316d435 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164919 Sep 13 20:13:02.484484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 771/1444] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:02 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:02.917594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-16e8959d-d54a-4a0f-80ed-e79f284ff1dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:02.920015 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-16e8959d-d54a-4a0f-80ed-e79f284ff1dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:02.929844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-16e8959d-d54a-4a0f-80ed-e79f284ff1dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:02.930578 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-16e8959d-d54a-4a0f-80ed-e79f284ff1dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:02.931147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-16e8959d-d54a-4a0f-80ed-e79f284ff1dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:02.932194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-16e8959d-d54a-4a0f-80ed-e79f284ff1dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:02.932899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-16e8959d-d54a-4a0f-80ed-e79f284ff1dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:02.933585 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-16e8959d-d54a-4a0f-80ed-e79f284ff1dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:02.966700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-16e8959d-d54a-4a0f-80ed-e79f284ff1dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056002 Sep 13 20:13:02.967273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 674/1445] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:02 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:03.518427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-33c45275-1dbb-4d36-b9f8-adaec83afee1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:03.519500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-33c45275-1dbb-4d36-b9f8-adaec83afee1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:03.527676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c45275-1dbb-4d36-b9f8-adaec83afee1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:03.528235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c45275-1dbb-4d36-b9f8-adaec83afee1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:03.528736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c45275-1dbb-4d36-b9f8-adaec83afee1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:03.529544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c45275-1dbb-4d36-b9f8-adaec83afee1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:03.530068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c45275-1dbb-4d36-b9f8-adaec83afee1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:03.530606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c45275-1dbb-4d36-b9f8-adaec83afee1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:03.664600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-33c45275-1dbb-4d36-b9f8-adaec83afee1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:03.672980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-33c45275-1dbb-4d36-b9f8-adaec83afee1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161116 Sep 13 20:13:03.673882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 772/1446] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:03 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:03.983695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-06a0b419-ba4e-4e45-bb3e-20decac7788d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:03.987624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-06a0b419-ba4e-4e45-bb3e-20decac7788d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:03.994866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06a0b419-ba4e-4e45-bb3e-20decac7788d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:03.995321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06a0b419-ba4e-4e45-bb3e-20decac7788d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:03.995725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06a0b419-ba4e-4e45-bb3e-20decac7788d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:03.996408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06a0b419-ba4e-4e45-bb3e-20decac7788d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:03.996846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06a0b419-ba4e-4e45-bb3e-20decac7788d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:03.997259 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06a0b419-ba4e-4e45-bb3e-20decac7788d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:04.026523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-06a0b419-ba4e-4e45-bb3e-20decac7788d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049689 Sep 13 20:13:04.027273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 675/1447] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:03 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:04.700538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dabd2d3a-d61b-410c-8245-4bf176091b65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:04.701511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dabd2d3a-d61b-410c-8245-4bf176091b65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:04.710830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dabd2d3a-d61b-410c-8245-4bf176091b65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:04.711688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dabd2d3a-d61b-410c-8245-4bf176091b65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:04.712119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dabd2d3a-d61b-410c-8245-4bf176091b65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:04.712808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dabd2d3a-d61b-410c-8245-4bf176091b65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:04.713251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dabd2d3a-d61b-410c-8245-4bf176091b65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:04.713668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dabd2d3a-d61b-410c-8245-4bf176091b65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:04.849567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dabd2d3a-d61b-410c-8245-4bf176091b65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:04.858099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dabd2d3a-d61b-410c-8245-4bf176091b65 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164036 Sep 13 20:13:04.858715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 773/1448] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:04 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:05.043674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0f5ceb18-45ac-4e0b-b220-4aa52fd7efaa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:05.047340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0f5ceb18-45ac-4e0b-b220-4aa52fd7efaa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:05.058253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f5ceb18-45ac-4e0b-b220-4aa52fd7efaa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:05.058963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f5ceb18-45ac-4e0b-b220-4aa52fd7efaa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:05.059723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f5ceb18-45ac-4e0b-b220-4aa52fd7efaa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:05.060879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f5ceb18-45ac-4e0b-b220-4aa52fd7efaa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:05.061647 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f5ceb18-45ac-4e0b-b220-4aa52fd7efaa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:05.062409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f5ceb18-45ac-4e0b-b220-4aa52fd7efaa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:05.101336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0f5ceb18-45ac-4e0b-b220-4aa52fd7efaa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064311 Sep 13 20:13:05.101914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 676/1449] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:05 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:05.881395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5f08a335-bce2-4b1e-94ea-8e3bdff03eb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:05.882022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5f08a335-bce2-4b1e-94ea-8e3bdff03eb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:05.888867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f08a335-bce2-4b1e-94ea-8e3bdff03eb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:05.889332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f08a335-bce2-4b1e-94ea-8e3bdff03eb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:05.889754 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f08a335-bce2-4b1e-94ea-8e3bdff03eb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:05.890460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f08a335-bce2-4b1e-94ea-8e3bdff03eb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:05.890907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f08a335-bce2-4b1e-94ea-8e3bdff03eb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:05.891314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5f08a335-bce2-4b1e-94ea-8e3bdff03eb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:06.024264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5f08a335-bce2-4b1e-94ea-8e3bdff03eb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:06.036510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5f08a335-bce2-4b1e-94ea-8e3bdff03eb2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.159021 Sep 13 20:13:06.037079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 774/1450] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:05 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:06.116300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-757a6179-4b54-4f84-8931-947c551b739d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:06.119299 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-757a6179-4b54-4f84-8931-947c551b739d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:06.128400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-757a6179-4b54-4f84-8931-947c551b739d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:06.129044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-757a6179-4b54-4f84-8931-947c551b739d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:06.129631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-757a6179-4b54-4f84-8931-947c551b739d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:06.130360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-757a6179-4b54-4f84-8931-947c551b739d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:06.130845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-757a6179-4b54-4f84-8931-947c551b739d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:06.131271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-757a6179-4b54-4f84-8931-947c551b739d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:06.133873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:06.162273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-757a6179-4b54-4f84-8931-947c551b739d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051440 Sep 13 20:13:06.162874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 677/1451] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:07.064162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-31e5190c-b424-4a74-af99-80c5231d9bd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:07.065148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-31e5190c-b424-4a74-af99-80c5231d9bd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:07.076118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31e5190c-b424-4a74-af99-80c5231d9bd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:07.076926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31e5190c-b424-4a74-af99-80c5231d9bd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:07.077643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31e5190c-b424-4a74-af99-80c5231d9bd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:07.078849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31e5190c-b424-4a74-af99-80c5231d9bd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:07.079605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31e5190c-b424-4a74-af99-80c5231d9bd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:07.080321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31e5190c-b424-4a74-af99-80c5231d9bd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:07.175087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fbfc502b-94f0-4c96-9124-538fd2f2edf9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:07.177329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fbfc502b-94f0-4c96-9124-538fd2f2edf9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:07.184338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbfc502b-94f0-4c96-9124-538fd2f2edf9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:07.184827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbfc502b-94f0-4c96-9124-538fd2f2edf9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:07.185277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbfc502b-94f0-4c96-9124-538fd2f2edf9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:07.185960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbfc502b-94f0-4c96-9124-538fd2f2edf9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:07.186401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbfc502b-94f0-4c96-9124-538fd2f2edf9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:07.186844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fbfc502b-94f0-4c96-9124-538fd2f2edf9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:07.218432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fbfc502b-94f0-4c96-9124-538fd2f2edf9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047348 Sep 13 20:13:07.219134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 678/1452] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:07.229059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-31e5190c-b424-4a74-af99-80c5231d9bd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:07.237311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-31e5190c-b424-4a74-af99-80c5231d9bd6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.179725 Sep 13 20:13:07.237937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 775/1453] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:07 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:08.235512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-850f175f-6229-4486-9d4e-52e52538c6e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:08.239029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-850f175f-6229-4486-9d4e-52e52538c6e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:08.249924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-850f175f-6229-4486-9d4e-52e52538c6e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:08.250782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-850f175f-6229-4486-9d4e-52e52538c6e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:08.251506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-850f175f-6229-4486-9d4e-52e52538c6e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:08.252638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-850f175f-6229-4486-9d4e-52e52538c6e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:08.253357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-850f175f-6229-4486-9d4e-52e52538c6e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:08.254097 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-850f175f-6229-4486-9d4e-52e52538c6e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:08.261207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4c41925f-a165-4344-824c-9e9451f6565d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:08.261968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4c41925f-a165-4344-824c-9e9451f6565d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:08.268874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c41925f-a165-4344-824c-9e9451f6565d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:08.269152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c41925f-a165-4344-824c-9e9451f6565d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:08.269532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c41925f-a165-4344-824c-9e9451f6565d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:08.270231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c41925f-a165-4344-824c-9e9451f6565d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:08.270940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c41925f-a165-4344-824c-9e9451f6565d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:08.271353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c41925f-a165-4344-824c-9e9451f6565d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:08.284770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-850f175f-6229-4486-9d4e-52e52538c6e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056113 Sep 13 20:13:08.285573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 679/1454] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:08.406678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4c41925f-a165-4344-824c-9e9451f6565d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:08.420060 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4c41925f-a165-4344-824c-9e9451f6565d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162597 Sep 13 20:13:08.420771 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 776/1455] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:08 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:09.300921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8648f567-1119-4ed6-b86d-a721ee8e2ca3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:09.303669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8648f567-1119-4ed6-b86d-a721ee8e2ca3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:09.310929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8648f567-1119-4ed6-b86d-a721ee8e2ca3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:09.311432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8648f567-1119-4ed6-b86d-a721ee8e2ca3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:09.311884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8648f567-1119-4ed6-b86d-a721ee8e2ca3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:09.312607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8648f567-1119-4ed6-b86d-a721ee8e2ca3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:09.313078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8648f567-1119-4ed6-b86d-a721ee8e2ca3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:09.313520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8648f567-1119-4ed6-b86d-a721ee8e2ca3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:09.345786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8648f567-1119-4ed6-b86d-a721ee8e2ca3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051339 Sep 13 20:13:09.346351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 680/1456] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:09.449869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1bdeba4a-74c8-41bd-b678-dd2de1c31722 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:09.450943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1bdeba4a-74c8-41bd-b678-dd2de1c31722 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:09.460473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bdeba4a-74c8-41bd-b678-dd2de1c31722 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:09.460948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bdeba4a-74c8-41bd-b678-dd2de1c31722 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:09.461770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bdeba4a-74c8-41bd-b678-dd2de1c31722 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:09.462489 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bdeba4a-74c8-41bd-b678-dd2de1c31722 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:09.462940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bdeba4a-74c8-41bd-b678-dd2de1c31722 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:09.463356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bdeba4a-74c8-41bd-b678-dd2de1c31722 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:09.593344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1bdeba4a-74c8-41bd-b678-dd2de1c31722 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:09.601792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1bdeba4a-74c8-41bd-b678-dd2de1c31722 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158529 Sep 13 20:13:09.602402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 777/1457] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:09 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:10.362651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ff635026-e367-4d06-99a2-068c816279cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:10.366064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ff635026-e367-4d06-99a2-068c816279cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:10.377037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff635026-e367-4d06-99a2-068c816279cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:10.377837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff635026-e367-4d06-99a2-068c816279cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:10.378634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff635026-e367-4d06-99a2-068c816279cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:10.379773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff635026-e367-4d06-99a2-068c816279cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:10.380677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff635026-e367-4d06-99a2-068c816279cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:10.381086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff635026-e367-4d06-99a2-068c816279cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:10.411393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ff635026-e367-4d06-99a2-068c816279cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055526 Sep 13 20:13:10.412002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 681/1458] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:10 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:10.629202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-03811cf2-6db4-4a2d-a057-b898a4052eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:10.630004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-03811cf2-6db4-4a2d-a057-b898a4052eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:10.641145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03811cf2-6db4-4a2d-a057-b898a4052eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:10.641928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03811cf2-6db4-4a2d-a057-b898a4052eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:10.642720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03811cf2-6db4-4a2d-a057-b898a4052eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:10.643856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03811cf2-6db4-4a2d-a057-b898a4052eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:10.644591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03811cf2-6db4-4a2d-a057-b898a4052eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:10.645292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03811cf2-6db4-4a2d-a057-b898a4052eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:10.788712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-03811cf2-6db4-4a2d-a057-b898a4052eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:10.797602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-03811cf2-6db4-4a2d-a057-b898a4052eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.175055 Sep 13 20:13:10.798407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 778/1459] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:10 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:11.424022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1e939ff3-74c1-4f4e-82a7-22518c6a15c5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:11.426087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1e939ff3-74c1-4f4e-82a7-22518c6a15c5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:11.432858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e939ff3-74c1-4f4e-82a7-22518c6a15c5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:11.433363 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e939ff3-74c1-4f4e-82a7-22518c6a15c5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:11.433806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e939ff3-74c1-4f4e-82a7-22518c6a15c5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:11.434526 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e939ff3-74c1-4f4e-82a7-22518c6a15c5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:11.434970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e939ff3-74c1-4f4e-82a7-22518c6a15c5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:11.435380 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e939ff3-74c1-4f4e-82a7-22518c6a15c5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:11.465903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1e939ff3-74c1-4f4e-82a7-22518c6a15c5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Sep 13 20:13:11.466189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 682/1460] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:11 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:11.825958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6be4a596-0fd0-4f50-b9f7-3cd898240583 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:11.827074 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6be4a596-0fd0-4f50-b9f7-3cd898240583 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:11.838419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6be4a596-0fd0-4f50-b9f7-3cd898240583 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:11.839218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6be4a596-0fd0-4f50-b9f7-3cd898240583 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:11.839947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6be4a596-0fd0-4f50-b9f7-3cd898240583 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:11.841083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6be4a596-0fd0-4f50-b9f7-3cd898240583 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:11.841831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6be4a596-0fd0-4f50-b9f7-3cd898240583 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:11.842596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6be4a596-0fd0-4f50-b9f7-3cd898240583 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:11.973960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6be4a596-0fd0-4f50-b9f7-3cd898240583 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:11.982931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6be4a596-0fd0-4f50-b9f7-3cd898240583 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163632 Sep 13 20:13:11.983515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 779/1461] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:11 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:12.480175 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b318ed7b-aba4-4f5d-a353-fce01755b7b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:12.482783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b318ed7b-aba4-4f5d-a353-fce01755b7b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:12.490733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b318ed7b-aba4-4f5d-a353-fce01755b7b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:12.491300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b318ed7b-aba4-4f5d-a353-fce01755b7b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:12.491811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b318ed7b-aba4-4f5d-a353-fce01755b7b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:12.492621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b318ed7b-aba4-4f5d-a353-fce01755b7b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:12.493149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b318ed7b-aba4-4f5d-a353-fce01755b7b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:12.493649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b318ed7b-aba4-4f5d-a353-fce01755b7b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:12.526392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b318ed7b-aba4-4f5d-a353-fce01755b7b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050904 Sep 13 20:13:12.527158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 683/1462] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:12 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:13.010419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a488f765-c85a-4c9f-b1e6-1e1c265ac6a6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:13.011525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a488f765-c85a-4c9f-b1e6-1e1c265ac6a6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:13.022177 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a488f765-c85a-4c9f-b1e6-1e1c265ac6a6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:13.022715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a488f765-c85a-4c9f-b1e6-1e1c265ac6a6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:13.023125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a488f765-c85a-4c9f-b1e6-1e1c265ac6a6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:13.023818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a488f765-c85a-4c9f-b1e6-1e1c265ac6a6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:13.024270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a488f765-c85a-4c9f-b1e6-1e1c265ac6a6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:13.024689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a488f765-c85a-4c9f-b1e6-1e1c265ac6a6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:13.172625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a488f765-c85a-4c9f-b1e6-1e1c265ac6a6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:13.181407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a488f765-c85a-4c9f-b1e6-1e1c265ac6a6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.177568 Sep 13 20:13:13.183129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 780/1463] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:13 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:13.542746 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6a4db2e7-dde0-4925-8865-45a91f2e83ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:13.546128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6a4db2e7-dde0-4925-8865-45a91f2e83ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:13.557096 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a4db2e7-dde0-4925-8865-45a91f2e83ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:13.557903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a4db2e7-dde0-4925-8865-45a91f2e83ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:13.558694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a4db2e7-dde0-4925-8865-45a91f2e83ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:13.559886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a4db2e7-dde0-4925-8865-45a91f2e83ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:13.560640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a4db2e7-dde0-4925-8865-45a91f2e83ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:13.561339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a4db2e7-dde0-4925-8865-45a91f2e83ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:13.598835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6a4db2e7-dde0-4925-8865-45a91f2e83ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063147 Sep 13 20:13:13.599424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 684/1464] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:14.209770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-93b76f8a-06eb-49a5-8184-1eb73aa1c85b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:14.210726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-93b76f8a-06eb-49a5-8184-1eb73aa1c85b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:14.221116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93b76f8a-06eb-49a5-8184-1eb73aa1c85b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:14.221909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93b76f8a-06eb-49a5-8184-1eb73aa1c85b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:14.222657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93b76f8a-06eb-49a5-8184-1eb73aa1c85b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:14.223775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93b76f8a-06eb-49a5-8184-1eb73aa1c85b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:14.224504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93b76f8a-06eb-49a5-8184-1eb73aa1c85b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:14.225116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93b76f8a-06eb-49a5-8184-1eb73aa1c85b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:14.378823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-93b76f8a-06eb-49a5-8184-1eb73aa1c85b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:14.378823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-93b76f8a-06eb-49a5-8184-1eb73aa1c85b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.174401 Sep 13 20:13:14.378823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 781/1465] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:14 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:14.611866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e9c19766-7037-4b62-8770-ddf7d624fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:14.614048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e9c19766-7037-4b62-8770-ddf7d624fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:14.620974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9c19766-7037-4b62-8770-ddf7d624fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:14.621489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9c19766-7037-4b62-8770-ddf7d624fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:14.621926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9c19766-7037-4b62-8770-ddf7d624fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:14.622653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9c19766-7037-4b62-8770-ddf7d624fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:14.623099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9c19766-7037-4b62-8770-ddf7d624fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:14.623518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9c19766-7037-4b62-8770-ddf7d624fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:14.653668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e9c19766-7037-4b62-8770-ddf7d624fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045893 Sep 13 20:13:14.654231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 685/1466] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:14 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:15.402030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e47b8d69-6d4e-436b-bec9-46c371b3d70a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:15.402625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e47b8d69-6d4e-436b-bec9-46c371b3d70a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:15.409876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e47b8d69-6d4e-436b-bec9-46c371b3d70a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:15.410358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e47b8d69-6d4e-436b-bec9-46c371b3d70a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:15.410813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e47b8d69-6d4e-436b-bec9-46c371b3d70a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:15.411518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e47b8d69-6d4e-436b-bec9-46c371b3d70a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:15.411954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e47b8d69-6d4e-436b-bec9-46c371b3d70a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:15.412355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e47b8d69-6d4e-436b-bec9-46c371b3d70a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:15.544130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e47b8d69-6d4e-436b-bec9-46c371b3d70a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:15.557156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e47b8d69-6d4e-436b-bec9-46c371b3d70a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.159616 Sep 13 20:13:15.557927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 782/1467] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:15 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:15.670568 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e4eadb90-c39a-480b-ab6b-bd0168524ad0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:15.674008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e4eadb90-c39a-480b-ab6b-bd0168524ad0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:15.684957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e4eadb90-c39a-480b-ab6b-bd0168524ad0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:15.685749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e4eadb90-c39a-480b-ab6b-bd0168524ad0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:15.686528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e4eadb90-c39a-480b-ab6b-bd0168524ad0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:15.687670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e4eadb90-c39a-480b-ab6b-bd0168524ad0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:15.688424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e4eadb90-c39a-480b-ab6b-bd0168524ad0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:15.689128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e4eadb90-c39a-480b-ab6b-bd0168524ad0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:15.722182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e4eadb90-c39a-480b-ab6b-bd0168524ad0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058324 Sep 13 20:13:15.722867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 686/1468] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:16.587068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a6676e52-7e28-42a3-b66e-f8016a3dfa4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:16.587677 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a6676e52-7e28-42a3-b66e-f8016a3dfa4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:16.597303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a6676e52-7e28-42a3-b66e-f8016a3dfa4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:16.597950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a6676e52-7e28-42a3-b66e-f8016a3dfa4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:16.598548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a6676e52-7e28-42a3-b66e-f8016a3dfa4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:16.599406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a6676e52-7e28-42a3-b66e-f8016a3dfa4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:16.599921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a6676e52-7e28-42a3-b66e-f8016a3dfa4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:16.600334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a6676e52-7e28-42a3-b66e-f8016a3dfa4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:16.735281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-964c3966-b0f3-475b-bcea-53ca4e8bfef4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:16.737473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a6676e52-7e28-42a3-b66e-f8016a3dfa4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:16.737686 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-964c3966-b0f3-475b-bcea-53ca4e8bfef4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:16.744198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-964c3966-b0f3-475b-bcea-53ca4e8bfef4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:16.753409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-964c3966-b0f3-475b-bcea-53ca4e8bfef4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:16.753409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-964c3966-b0f3-475b-bcea-53ca4e8bfef4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:16.753409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-964c3966-b0f3-475b-bcea-53ca4e8bfef4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:16.753888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a6676e52-7e28-42a3-b66e-f8016a3dfa4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165873 Sep 13 20:13:16.753990 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-964c3966-b0f3-475b-bcea-53ca4e8bfef4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:16.753990 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-964c3966-b0f3-475b-bcea-53ca4e8bfef4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:16.754254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 783/1469] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:16 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:16.779463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-964c3966-b0f3-475b-bcea-53ca4e8bfef4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048157 Sep 13 20:13:16.784151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 687/1470] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:16 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:17.773606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-34c85701-e949-4fbc-8b40-9819cc5ff7ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:17.774658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-34c85701-e949-4fbc-8b40-9819cc5ff7ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:17.785607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-34c85701-e949-4fbc-8b40-9819cc5ff7ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:17.786426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-34c85701-e949-4fbc-8b40-9819cc5ff7ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:17.787159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-34c85701-e949-4fbc-8b40-9819cc5ff7ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:17.788004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-34c85701-e949-4fbc-8b40-9819cc5ff7ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:17.788465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-34c85701-e949-4fbc-8b40-9819cc5ff7ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:17.788885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-34c85701-e949-4fbc-8b40-9819cc5ff7ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:17.792715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-58eb89dd-5c5e-4127-8e42-3808e125fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:17.794912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-58eb89dd-5c5e-4127-8e42-3808e125fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:17.801764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58eb89dd-5c5e-4127-8e42-3808e125fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:17.802245 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58eb89dd-5c5e-4127-8e42-3808e125fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:17.802736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58eb89dd-5c5e-4127-8e42-3808e125fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:17.803438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58eb89dd-5c5e-4127-8e42-3808e125fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:17.803891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58eb89dd-5c5e-4127-8e42-3808e125fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:17.804310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58eb89dd-5c5e-4127-8e42-3808e125fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:17.835704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-58eb89dd-5c5e-4127-8e42-3808e125fc9e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046949 Sep 13 20:13:17.836812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 688/1471] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:17 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:17.916582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-34c85701-e949-4fbc-8b40-9819cc5ff7ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:17.924786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-34c85701-e949-4fbc-8b40-9819cc5ff7ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.157562 Sep 13 20:13:17.925357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 784/1472] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:17 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:18.851181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d806fc32-7cb5-4b1f-9b26-913953c87433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:18.854018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d806fc32-7cb5-4b1f-9b26-913953c87433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:18.863095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d806fc32-7cb5-4b1f-9b26-913953c87433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:18.863749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d806fc32-7cb5-4b1f-9b26-913953c87433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:18.864371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d806fc32-7cb5-4b1f-9b26-913953c87433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:18.865302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d806fc32-7cb5-4b1f-9b26-913953c87433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:18.866215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d806fc32-7cb5-4b1f-9b26-913953c87433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:18.866835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d806fc32-7cb5-4b1f-9b26-913953c87433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:18.898640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d806fc32-7cb5-4b1f-9b26-913953c87433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052844 Sep 13 20:13:18.899236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 689/1473] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:18.955431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-18f179ef-b517-479d-86a5-bb6415e1c4c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:18.956064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-18f179ef-b517-479d-86a5-bb6415e1c4c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:18.963315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18f179ef-b517-479d-86a5-bb6415e1c4c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:18.963779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18f179ef-b517-479d-86a5-bb6415e1c4c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:18.964209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18f179ef-b517-479d-86a5-bb6415e1c4c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:18.964959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18f179ef-b517-479d-86a5-bb6415e1c4c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:18.965405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18f179ef-b517-479d-86a5-bb6415e1c4c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:18.965822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18f179ef-b517-479d-86a5-bb6415e1c4c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:19.097792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-18f179ef-b517-479d-86a5-bb6415e1c4c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:19.106267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-18f179ef-b517-479d-86a5-bb6415e1c4c7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.154608 Sep 13 20:13:19.106816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 785/1474] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:18 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:13:19.915910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f3fe712a-644e-474f-be96-782b0729222d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:19.917982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f3fe712a-644e-474f-be96-782b0729222d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:19.924731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3fe712a-644e-474f-be96-782b0729222d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:19.925209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3fe712a-644e-474f-be96-782b0729222d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:19.925630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3fe712a-644e-474f-be96-782b0729222d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:19.926312 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3fe712a-644e-474f-be96-782b0729222d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:19.926788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3fe712a-644e-474f-be96-782b0729222d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:19.927200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3fe712a-644e-474f-be96-782b0729222d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:19.957436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f3fe712a-644e-474f-be96-782b0729222d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047969 Sep 13 20:13:19.958028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 690/1475] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:20.136994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-aad018d6-40f1-4a4f-a870-1501df25a23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:20.138051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-aad018d6-40f1-4a4f-a870-1501df25a23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:20.148891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aad018d6-40f1-4a4f-a870-1501df25a23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:20.149834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aad018d6-40f1-4a4f-a870-1501df25a23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:20.150557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aad018d6-40f1-4a4f-a870-1501df25a23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:20.151697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aad018d6-40f1-4a4f-a870-1501df25a23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:20.152444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aad018d6-40f1-4a4f-a870-1501df25a23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:20.153143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aad018d6-40f1-4a4f-a870-1501df25a23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:20.290102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-aad018d6-40f1-4a4f-a870-1501df25a23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:20.298504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-aad018d6-40f1-4a4f-a870-1501df25a23a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168214 Sep 13 20:13:20.299077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 786/1476] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:20 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:20.975277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4450e54f-8536-40d6-83d1-11883d4c52ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:20.978685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4450e54f-8536-40d6-83d1-11883d4c52ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:20.985538 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4450e54f-8536-40d6-83d1-11883d4c52ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:20.986017 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4450e54f-8536-40d6-83d1-11883d4c52ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:20.986490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4450e54f-8536-40d6-83d1-11883d4c52ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:20.987180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4450e54f-8536-40d6-83d1-11883d4c52ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:20.987629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4450e54f-8536-40d6-83d1-11883d4c52ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:20.988053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4450e54f-8536-40d6-83d1-11883d4c52ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:21.021123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4450e54f-8536-40d6-83d1-11883d4c52ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053118 Sep 13 20:13:21.021694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 691/1477] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:21.325952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-30a4fb00-1899-401b-849c-2a25129353c4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:21.326887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-30a4fb00-1899-401b-849c-2a25129353c4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:21.337972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30a4fb00-1899-401b-849c-2a25129353c4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:21.338470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30a4fb00-1899-401b-849c-2a25129353c4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:21.338894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30a4fb00-1899-401b-849c-2a25129353c4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:21.339569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30a4fb00-1899-401b-849c-2a25129353c4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:21.340008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30a4fb00-1899-401b-849c-2a25129353c4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:21.340414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30a4fb00-1899-401b-849c-2a25129353c4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:21.476791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-30a4fb00-1899-401b-849c-2a25129353c4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:21.479170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:21.486323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-30a4fb00-1899-401b-849c-2a25129353c4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167000 Sep 13 20:13:21.486953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 787/1478] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:21 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:22.034282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1e8c0ce3-071d-4e4a-8eba-c95f014e271b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:22.036381 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1e8c0ce3-071d-4e4a-8eba-c95f014e271b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:22.043599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e8c0ce3-071d-4e4a-8eba-c95f014e271b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:22.044067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e8c0ce3-071d-4e4a-8eba-c95f014e271b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:22.044660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e8c0ce3-071d-4e4a-8eba-c95f014e271b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:22.045527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e8c0ce3-071d-4e4a-8eba-c95f014e271b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:22.045991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e8c0ce3-071d-4e4a-8eba-c95f014e271b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:22.046416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e8c0ce3-071d-4e4a-8eba-c95f014e271b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:22.079329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1e8c0ce3-071d-4e4a-8eba-c95f014e271b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049212 Sep 13 20:13:22.079909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 692/1479] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:22.510506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3f0f7b73-0bda-4938-8027-53775db2c846 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:22.511110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3f0f7b73-0bda-4938-8027-53775db2c846 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:22.520709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3f0f7b73-0bda-4938-8027-53775db2c846 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:22.521383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3f0f7b73-0bda-4938-8027-53775db2c846 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:22.522029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3f0f7b73-0bda-4938-8027-53775db2c846 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:22.524020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3f0f7b73-0bda-4938-8027-53775db2c846 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:22.524484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3f0f7b73-0bda-4938-8027-53775db2c846 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:22.524924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3f0f7b73-0bda-4938-8027-53775db2c846 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:22.667686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3f0f7b73-0bda-4938-8027-53775db2c846 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:22.676312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3f0f7b73-0bda-4938-8027-53775db2c846 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.170074 Sep 13 20:13:22.676864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 788/1480] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:22 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:23.097725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9e92c301-fe4b-4444-b577-f9653919026d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:23.101126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9e92c301-fe4b-4444-b577-f9653919026d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:23.108826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e92c301-fe4b-4444-b577-f9653919026d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:23.109330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e92c301-fe4b-4444-b577-f9653919026d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:23.109754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e92c301-fe4b-4444-b577-f9653919026d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:23.110485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e92c301-fe4b-4444-b577-f9653919026d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:23.110918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e92c301-fe4b-4444-b577-f9653919026d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:23.111329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e92c301-fe4b-4444-b577-f9653919026d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:23.135620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:23.142723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9e92c301-fe4b-4444-b577-f9653919026d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052324 Sep 13 20:13:23.143292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 693/1481] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:23.700960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-845ac871-dff7-4f53-b8bf-d4ab0595f490 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:23.701525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-845ac871-dff7-4f53-b8bf-d4ab0595f490 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:23.708398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-845ac871-dff7-4f53-b8bf-d4ab0595f490 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:23.708877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-845ac871-dff7-4f53-b8bf-d4ab0595f490 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:23.709303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-845ac871-dff7-4f53-b8bf-d4ab0595f490 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:23.709989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-845ac871-dff7-4f53-b8bf-d4ab0595f490 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:23.710471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-845ac871-dff7-4f53-b8bf-d4ab0595f490 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:23.710887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-845ac871-dff7-4f53-b8bf-d4ab0595f490 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:23.849403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-845ac871-dff7-4f53-b8bf-d4ab0595f490 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:23.858692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-845ac871-dff7-4f53-b8bf-d4ab0595f490 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162050 Sep 13 20:13:23.859267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 789/1482] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:23 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:24.156249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b483e067-6980-4e34-98d6-8be7e532989e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:24.158362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b483e067-6980-4e34-98d6-8be7e532989e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:24.165520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b483e067-6980-4e34-98d6-8be7e532989e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:24.166063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b483e067-6980-4e34-98d6-8be7e532989e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:24.166529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b483e067-6980-4e34-98d6-8be7e532989e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:24.167311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b483e067-6980-4e34-98d6-8be7e532989e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:24.167759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b483e067-6980-4e34-98d6-8be7e532989e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:24.168180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b483e067-6980-4e34-98d6-8be7e532989e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:24.201291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b483e067-6980-4e34-98d6-8be7e532989e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049078 Sep 13 20:13:24.201866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 694/1483] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:24 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:24.887078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9aaf7cf1-8d5b-4784-8a92-2f458b23adfe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:24.887917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9aaf7cf1-8d5b-4784-8a92-2f458b23adfe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:24.898897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9aaf7cf1-8d5b-4784-8a92-2f458b23adfe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:24.899669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9aaf7cf1-8d5b-4784-8a92-2f458b23adfe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:24.900440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9aaf7cf1-8d5b-4784-8a92-2f458b23adfe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:24.901120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9aaf7cf1-8d5b-4784-8a92-2f458b23adfe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:24.901563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9aaf7cf1-8d5b-4784-8a92-2f458b23adfe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:24.901972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9aaf7cf1-8d5b-4784-8a92-2f458b23adfe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:25.036143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9aaf7cf1-8d5b-4784-8a92-2f458b23adfe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:25.044720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9aaf7cf1-8d5b-4784-8a92-2f458b23adfe tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164233 Sep 13 20:13:25.045327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 790/1484] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:24 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:25.217254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b3bef5f9-1037-4387-85ea-751b40fd81e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:25.219958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b3bef5f9-1037-4387-85ea-751b40fd81e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:25.228284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b3bef5f9-1037-4387-85ea-751b40fd81e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:25.228879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b3bef5f9-1037-4387-85ea-751b40fd81e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:25.229415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b3bef5f9-1037-4387-85ea-751b40fd81e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:25.230273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b3bef5f9-1037-4387-85ea-751b40fd81e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:25.230875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b3bef5f9-1037-4387-85ea-751b40fd81e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:25.231400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b3bef5f9-1037-4387-85ea-751b40fd81e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:25.264937 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b3bef5f9-1037-4387-85ea-751b40fd81e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054062 Sep 13 20:13:25.265484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 695/1485] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:26.071586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-aeffeced-aa9a-46fb-a6dd-c57a00360c21 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:26.073003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-aeffeced-aa9a-46fb-a6dd-c57a00360c21 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:26.076811 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:26.086050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aeffeced-aa9a-46fb-a6dd-c57a00360c21 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:26.089713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aeffeced-aa9a-46fb-a6dd-c57a00360c21 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:26.089713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aeffeced-aa9a-46fb-a6dd-c57a00360c21 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:26.089713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aeffeced-aa9a-46fb-a6dd-c57a00360c21 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:26.089713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aeffeced-aa9a-46fb-a6dd-c57a00360c21 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:26.090103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aeffeced-aa9a-46fb-a6dd-c57a00360c21 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:26.219901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-aeffeced-aa9a-46fb-a6dd-c57a00360c21 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:26.232530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-aeffeced-aa9a-46fb-a6dd-c57a00360c21 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167322 Sep 13 20:13:26.233313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 791/1486] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:26 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:26.278229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7ce86c86-e685-4ab1-bfba-3c2614280dfc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:26.280445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7ce86c86-e685-4ab1-bfba-3c2614280dfc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:26.282790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=58 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:26.288205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7ce86c86-e685-4ab1-bfba-3c2614280dfc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:26.288678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7ce86c86-e685-4ab1-bfba-3c2614280dfc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:26.289110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7ce86c86-e685-4ab1-bfba-3c2614280dfc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:26.289792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7ce86c86-e685-4ab1-bfba-3c2614280dfc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:26.290238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7ce86c86-e685-4ab1-bfba-3c2614280dfc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:26.290681 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7ce86c86-e685-4ab1-bfba-3c2614280dfc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:26.321934 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7ce86c86-e685-4ab1-bfba-3c2614280dfc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047723 Sep 13 20:13:26.322719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 696/1487] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:27.260509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-11b1236e-6c9c-4679-9b47-82338dc9abc4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:27.261178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-11b1236e-6c9c-4679-9b47-82338dc9abc4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:27.267945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11b1236e-6c9c-4679-9b47-82338dc9abc4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:27.268416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11b1236e-6c9c-4679-9b47-82338dc9abc4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:27.268841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11b1236e-6c9c-4679-9b47-82338dc9abc4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:27.269511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11b1236e-6c9c-4679-9b47-82338dc9abc4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:27.269950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11b1236e-6c9c-4679-9b47-82338dc9abc4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:27.270362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11b1236e-6c9c-4679-9b47-82338dc9abc4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:27.334633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-97dd498f-98d5-4f63-aaf0-fde31eeb0d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:27.337146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-97dd498f-98d5-4f63-aaf0-fde31eeb0d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:27.344157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-97dd498f-98d5-4f63-aaf0-fde31eeb0d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:27.344630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-97dd498f-98d5-4f63-aaf0-fde31eeb0d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:27.345057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-97dd498f-98d5-4f63-aaf0-fde31eeb0d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:27.345746 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-97dd498f-98d5-4f63-aaf0-fde31eeb0d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:27.346195 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-97dd498f-98d5-4f63-aaf0-fde31eeb0d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:27.346649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-97dd498f-98d5-4f63-aaf0-fde31eeb0d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:27.377028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-97dd498f-98d5-4f63-aaf0-fde31eeb0d86 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046433 Sep 13 20:13:27.380703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 697/1488] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:27 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:27.412988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-11b1236e-6c9c-4679-9b47-82338dc9abc4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:27.421314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-11b1236e-6c9c-4679-9b47-82338dc9abc4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164683 Sep 13 20:13:27.421892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 792/1489] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:27 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:28.394081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-85b2a91a-2822-4d33-9bd4-de3972dbf680 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:28.397825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-85b2a91a-2822-4d33-9bd4-de3972dbf680 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:28.406309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-85b2a91a-2822-4d33-9bd4-de3972dbf680 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:28.406856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-85b2a91a-2822-4d33-9bd4-de3972dbf680 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:28.407321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-85b2a91a-2822-4d33-9bd4-de3972dbf680 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:28.408021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-85b2a91a-2822-4d33-9bd4-de3972dbf680 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:28.408471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-85b2a91a-2822-4d33-9bd4-de3972dbf680 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:28.408895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-85b2a91a-2822-4d33-9bd4-de3972dbf680 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:28.440445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-85b2a91a-2822-4d33-9bd4-de3972dbf680 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052966 Sep 13 20:13:28.440923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 698/1490] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:28.563380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c96f86bb-04ad-4b5c-b7e1-70e7952aa3e0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:28.563995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c96f86bb-04ad-4b5c-b7e1-70e7952aa3e0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:28.570154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c96f86bb-04ad-4b5c-b7e1-70e7952aa3e0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:28.570666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c96f86bb-04ad-4b5c-b7e1-70e7952aa3e0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:28.571093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c96f86bb-04ad-4b5c-b7e1-70e7952aa3e0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:28.571760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c96f86bb-04ad-4b5c-b7e1-70e7952aa3e0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:28.573012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c96f86bb-04ad-4b5c-b7e1-70e7952aa3e0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:28.573436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c96f86bb-04ad-4b5c-b7e1-70e7952aa3e0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:28.708672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c96f86bb-04ad-4b5c-b7e1-70e7952aa3e0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:28.717442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c96f86bb-04ad-4b5c-b7e1-70e7952aa3e0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.276884 Sep 13 20:13:28.718005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 793/1491] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:28 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:29.454344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b94fff05-2303-46ae-94a0-51d2eab14f0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:29.456603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b94fff05-2303-46ae-94a0-51d2eab14f0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:29.464371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b94fff05-2303-46ae-94a0-51d2eab14f0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:29.464861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b94fff05-2303-46ae-94a0-51d2eab14f0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:29.465297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b94fff05-2303-46ae-94a0-51d2eab14f0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:29.466037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b94fff05-2303-46ae-94a0-51d2eab14f0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:29.466523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b94fff05-2303-46ae-94a0-51d2eab14f0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:29.466948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b94fff05-2303-46ae-94a0-51d2eab14f0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:29.498213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b94fff05-2303-46ae-94a0-51d2eab14f0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048012 Sep 13 20:13:29.498811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 699/1492] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:29.744856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-aa654ffe-50ee-4dd8-afb4-dfbe88954f4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:29.745931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-aa654ffe-50ee-4dd8-afb4-dfbe88954f4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:29.753452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa654ffe-50ee-4dd8-afb4-dfbe88954f4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:29.753985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa654ffe-50ee-4dd8-afb4-dfbe88954f4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:29.754519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa654ffe-50ee-4dd8-afb4-dfbe88954f4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:29.755287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa654ffe-50ee-4dd8-afb4-dfbe88954f4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:29.755785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa654ffe-50ee-4dd8-afb4-dfbe88954f4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:29.756252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aa654ffe-50ee-4dd8-afb4-dfbe88954f4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:29.900445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-aa654ffe-50ee-4dd8-afb4-dfbe88954f4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:29.909145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-aa654ffe-50ee-4dd8-afb4-dfbe88954f4d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.170955 Sep 13 20:13:29.909725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 794/1493] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:29 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:30.511292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0b62a1bd-2a25-4083-896e-c6eacc9157b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:30.513763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0b62a1bd-2a25-4083-896e-c6eacc9157b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:30.523319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0b62a1bd-2a25-4083-896e-c6eacc9157b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:30.523859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0b62a1bd-2a25-4083-896e-c6eacc9157b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:30.524292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0b62a1bd-2a25-4083-896e-c6eacc9157b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:30.525091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0b62a1bd-2a25-4083-896e-c6eacc9157b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:30.525553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0b62a1bd-2a25-4083-896e-c6eacc9157b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:30.526034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0b62a1bd-2a25-4083-896e-c6eacc9157b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:30.557048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0b62a1bd-2a25-4083-896e-c6eacc9157b6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049737 Sep 13 20:13:30.557828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 700/1494] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:30 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:30.931860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-917b57e0-cb98-462c-9ca7-af576ed3652b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:30.932426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-917b57e0-cb98-462c-9ca7-af576ed3652b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:30.939094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-917b57e0-cb98-462c-9ca7-af576ed3652b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:30.939577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-917b57e0-cb98-462c-9ca7-af576ed3652b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:30.940006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-917b57e0-cb98-462c-9ca7-af576ed3652b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:30.940696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-917b57e0-cb98-462c-9ca7-af576ed3652b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:30.941140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-917b57e0-cb98-462c-9ca7-af576ed3652b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:30.941553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-917b57e0-cb98-462c-9ca7-af576ed3652b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:31.083176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-917b57e0-cb98-462c-9ca7-af576ed3652b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:31.092239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-917b57e0-cb98-462c-9ca7-af576ed3652b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164371 Sep 13 20:13:31.092794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 795/1495] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:30 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:31.573513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e3efcfd7-4b94-42e9-95fc-169363fef6f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:31.575889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e3efcfd7-4b94-42e9-95fc-169363fef6f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:31.582878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3efcfd7-4b94-42e9-95fc-169363fef6f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:31.583354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3efcfd7-4b94-42e9-95fc-169363fef6f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:31.583779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3efcfd7-4b94-42e9-95fc-169363fef6f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:31.584498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3efcfd7-4b94-42e9-95fc-169363fef6f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:31.584940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3efcfd7-4b94-42e9-95fc-169363fef6f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:31.585357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3efcfd7-4b94-42e9-95fc-169363fef6f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:31.615948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e3efcfd7-4b94-42e9-95fc-169363fef6f6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049072 Sep 13 20:13:31.616424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 701/1496] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:31 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:32.119782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d27a56f3-f68d-4dc5-aad4-7ab1ab7c982b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:32.120866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d27a56f3-f68d-4dc5-aad4-7ab1ab7c982b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:32.128787 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d27a56f3-f68d-4dc5-aad4-7ab1ab7c982b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:32.129359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d27a56f3-f68d-4dc5-aad4-7ab1ab7c982b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:32.129867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d27a56f3-f68d-4dc5-aad4-7ab1ab7c982b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:32.130756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d27a56f3-f68d-4dc5-aad4-7ab1ab7c982b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:32.131288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d27a56f3-f68d-4dc5-aad4-7ab1ab7c982b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:32.131780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d27a56f3-f68d-4dc5-aad4-7ab1ab7c982b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:32.269652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d27a56f3-f68d-4dc5-aad4-7ab1ab7c982b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:32.282429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d27a56f3-f68d-4dc5-aad4-7ab1ab7c982b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168885 Sep 13 20:13:32.283325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 796/1497] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:32 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:32.629262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b137169b-ffc4-4ff1-bede-73a4a4c5ff54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:32.631520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b137169b-ffc4-4ff1-bede-73a4a4c5ff54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:32.638409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b137169b-ffc4-4ff1-bede-73a4a4c5ff54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:32.638929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b137169b-ffc4-4ff1-bede-73a4a4c5ff54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:32.639364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b137169b-ffc4-4ff1-bede-73a4a4c5ff54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:32.640189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b137169b-ffc4-4ff1-bede-73a4a4c5ff54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:32.640466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b137169b-ffc4-4ff1-bede-73a4a4c5ff54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:32.640931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b137169b-ffc4-4ff1-bede-73a4a4c5ff54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:32.671143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b137169b-ffc4-4ff1-bede-73a4a4c5ff54 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045915 Sep 13 20:13:32.671686 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 702/1498] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:32 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:33.310274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-07439815-183d-4743-b9e3-f2bef23e1a1f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:33.311404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-07439815-183d-4743-b9e3-f2bef23e1a1f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:33.322467 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07439815-183d-4743-b9e3-f2bef23e1a1f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:33.323290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07439815-183d-4743-b9e3-f2bef23e1a1f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:33.324007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07439815-183d-4743-b9e3-f2bef23e1a1f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:33.325141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07439815-183d-4743-b9e3-f2bef23e1a1f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:33.325906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07439815-183d-4743-b9e3-f2bef23e1a1f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:33.326325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07439815-183d-4743-b9e3-f2bef23e1a1f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:33.464230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-07439815-183d-4743-b9e3-f2bef23e1a1f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:33.474203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-07439815-183d-4743-b9e3-f2bef23e1a1f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.170601 Sep 13 20:13:33.474831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 797/1499] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:33 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:33.688854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d36afe16-99eb-4475-9d14-afa2441b5a4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:33.691801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d36afe16-99eb-4475-9d14-afa2441b5a4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:33.700190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d36afe16-99eb-4475-9d14-afa2441b5a4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:33.700872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d36afe16-99eb-4475-9d14-afa2441b5a4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:33.701299 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d36afe16-99eb-4475-9d14-afa2441b5a4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:33.701982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d36afe16-99eb-4475-9d14-afa2441b5a4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:33.702452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d36afe16-99eb-4475-9d14-afa2441b5a4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:33.702864 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d36afe16-99eb-4475-9d14-afa2441b5a4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:33.732979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d36afe16-99eb-4475-9d14-afa2441b5a4d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050197 Sep 13 20:13:33.733518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 703/1500] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:33 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:34.501770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0657b825-6019-4559-a74b-eeb7ce32ae4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:34.502751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0657b825-6019-4559-a74b-eeb7ce32ae4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:34.505906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:13:34.506243 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:13:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c (ip 10.222.0.52) !!! Sep 13 20:13:34.515864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0657b825-6019-4559-a74b-eeb7ce32ae4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:34.516351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0657b825-6019-4559-a74b-eeb7ce32ae4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:34.516787 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0657b825-6019-4559-a74b-eeb7ce32ae4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:34.517480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0657b825-6019-4559-a74b-eeb7ce32ae4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:34.517924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0657b825-6019-4559-a74b-eeb7ce32ae4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:34.518339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0657b825-6019-4559-a74b-eeb7ce32ae4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:34.699973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0657b825-6019-4559-a74b-eeb7ce32ae4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:34.708681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0657b825-6019-4559-a74b-eeb7ce32ae4e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.213460 Sep 13 20:13:34.709279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 798/1501] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:34 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:34.745351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-73560cb2-4a72-4a36-83d6-e9ce086030c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:34.747552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-73560cb2-4a72-4a36-83d6-e9ce086030c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:34.754418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73560cb2-4a72-4a36-83d6-e9ce086030c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:34.754837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73560cb2-4a72-4a36-83d6-e9ce086030c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:34.755275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73560cb2-4a72-4a36-83d6-e9ce086030c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:34.755971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73560cb2-4a72-4a36-83d6-e9ce086030c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:34.756420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73560cb2-4a72-4a36-83d6-e9ce086030c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:34.756854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73560cb2-4a72-4a36-83d6-e9ce086030c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:34.787993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-73560cb2-4a72-4a36-83d6-e9ce086030c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046626 Sep 13 20:13:34.788546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 704/1502] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:34 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:35.731616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-83982091-f836-448f-b6b8-21cfb5cb6d0c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:35.732326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-83982091-f836-448f-b6b8-21cfb5cb6d0c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:35.739208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83982091-f836-448f-b6b8-21cfb5cb6d0c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:35.739694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83982091-f836-448f-b6b8-21cfb5cb6d0c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:35.740120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83982091-f836-448f-b6b8-21cfb5cb6d0c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:35.740800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83982091-f836-448f-b6b8-21cfb5cb6d0c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:35.741248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83982091-f836-448f-b6b8-21cfb5cb6d0c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:35.741660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-83982091-f836-448f-b6b8-21cfb5cb6d0c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:35.802913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9a38e8e0-b55f-4085-a449-0136fa1f0002 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:35.805132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9a38e8e0-b55f-4085-a449-0136fa1f0002 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:35.812357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a38e8e0-b55f-4085-a449-0136fa1f0002 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:35.812841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a38e8e0-b55f-4085-a449-0136fa1f0002 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:35.813265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a38e8e0-b55f-4085-a449-0136fa1f0002 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:35.813960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a38e8e0-b55f-4085-a449-0136fa1f0002 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:35.814405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a38e8e0-b55f-4085-a449-0136fa1f0002 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:35.814831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a38e8e0-b55f-4085-a449-0136fa1f0002 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:35.846551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9a38e8e0-b55f-4085-a449-0136fa1f0002 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048070 Sep 13 20:13:35.847520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 705/1503] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:35 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:36.079556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-83982091-f836-448f-b6b8-21cfb5cb6d0c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:36.088375 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-83982091-f836-448f-b6b8-21cfb5cb6d0c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.360579 Sep 13 20:13:36.088881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 799/1504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:35 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:36.860301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f236c22b-e9e7-42ef-b483-f002a662d9fc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:36.862505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f236c22b-e9e7-42ef-b483-f002a662d9fc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:36.869495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f236c22b-e9e7-42ef-b483-f002a662d9fc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:36.869969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f236c22b-e9e7-42ef-b483-f002a662d9fc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:36.870396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f236c22b-e9e7-42ef-b483-f002a662d9fc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:36.871095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f236c22b-e9e7-42ef-b483-f002a662d9fc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:36.871535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f236c22b-e9e7-42ef-b483-f002a662d9fc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:36.871947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f236c22b-e9e7-42ef-b483-f002a662d9fc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:36.902148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f236c22b-e9e7-42ef-b483-f002a662d9fc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045979 Sep 13 20:13:36.902733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 706/1505] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:36 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:37.111661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-10c4e8e3-224d-4bb7-9feb-9850855d54be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:37.112268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-10c4e8e3-224d-4bb7-9feb-9850855d54be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:37.119093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10c4e8e3-224d-4bb7-9feb-9850855d54be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:37.119585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10c4e8e3-224d-4bb7-9feb-9850855d54be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:37.120019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10c4e8e3-224d-4bb7-9feb-9850855d54be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:37.120706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10c4e8e3-224d-4bb7-9feb-9850855d54be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:37.121159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10c4e8e3-224d-4bb7-9feb-9850855d54be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:37.121580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10c4e8e3-224d-4bb7-9feb-9850855d54be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:37.254309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-10c4e8e3-224d-4bb7-9feb-9850855d54be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:37.263256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-10c4e8e3-224d-4bb7-9feb-9850855d54be tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155371 Sep 13 20:13:37.263861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 800/1506] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:37 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:37.917051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0de22d80-ab20-4082-b356-d666bbaf1806 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:37.920030 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0de22d80-ab20-4082-b356-d666bbaf1806 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:37.928831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0de22d80-ab20-4082-b356-d666bbaf1806 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:37.929476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0de22d80-ab20-4082-b356-d666bbaf1806 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:37.930089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0de22d80-ab20-4082-b356-d666bbaf1806 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:37.931019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0de22d80-ab20-4082-b356-d666bbaf1806 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:37.931620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0de22d80-ab20-4082-b356-d666bbaf1806 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:37.932189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0de22d80-ab20-4082-b356-d666bbaf1806 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:37.965531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0de22d80-ab20-4082-b356-d666bbaf1806 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053768 Sep 13 20:13:37.966123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 707/1507] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:37 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:38.290856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fe507931-e10b-4b32-b54d-7bc2c0755e5c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:38.291874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fe507931-e10b-4b32-b54d-7bc2c0755e5c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:38.299968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe507931-e10b-4b32-b54d-7bc2c0755e5c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:38.300473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe507931-e10b-4b32-b54d-7bc2c0755e5c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:38.300935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe507931-e10b-4b32-b54d-7bc2c0755e5c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:38.301658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe507931-e10b-4b32-b54d-7bc2c0755e5c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:38.302137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe507931-e10b-4b32-b54d-7bc2c0755e5c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:38.302626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe507931-e10b-4b32-b54d-7bc2c0755e5c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:38.437506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fe507931-e10b-4b32-b54d-7bc2c0755e5c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:38.450346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fe507931-e10b-4b32-b54d-7bc2c0755e5c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165757 Sep 13 20:13:38.451329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 801/1508] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:38 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:38.978110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c0a948cb-5db8-403a-a082-8da1c578a5b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:38.980319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c0a948cb-5db8-403a-a082-8da1c578a5b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:38.987347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c0a948cb-5db8-403a-a082-8da1c578a5b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:38.987819 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c0a948cb-5db8-403a-a082-8da1c578a5b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:38.990137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c0a948cb-5db8-403a-a082-8da1c578a5b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:38.990875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c0a948cb-5db8-403a-a082-8da1c578a5b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:38.991306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c0a948cb-5db8-403a-a082-8da1c578a5b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:38.991733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c0a948cb-5db8-403a-a082-8da1c578a5b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:39.029368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c0a948cb-5db8-403a-a082-8da1c578a5b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055191 Sep 13 20:13:39.030009 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 708/1509] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:38 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:39.478753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-108fb590-5b80-4060-bc9e-28014bca050f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:39.479803 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-108fb590-5b80-4060-bc9e-28014bca050f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:39.490788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-108fb590-5b80-4060-bc9e-28014bca050f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:39.491596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-108fb590-5b80-4060-bc9e-28014bca050f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:39.492313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-108fb590-5b80-4060-bc9e-28014bca050f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:39.493452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-108fb590-5b80-4060-bc9e-28014bca050f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:39.494207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-108fb590-5b80-4060-bc9e-28014bca050f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:39.494992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-108fb590-5b80-4060-bc9e-28014bca050f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:39.623617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-108fb590-5b80-4060-bc9e-28014bca050f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:39.632286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-108fb590-5b80-4060-bc9e-28014bca050f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160308 Sep 13 20:13:39.632878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 802/1510] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:39 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:40.043111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-26767e87-3743-4673-a2c3-98c8d04363d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:40.045373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-26767e87-3743-4673-a2c3-98c8d04363d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:40.052091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26767e87-3743-4673-a2c3-98c8d04363d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:40.052599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26767e87-3743-4673-a2c3-98c8d04363d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:40.053022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26767e87-3743-4673-a2c3-98c8d04363d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:40.053732 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26767e87-3743-4673-a2c3-98c8d04363d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:40.054140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26767e87-3743-4673-a2c3-98c8d04363d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:40.054594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26767e87-3743-4673-a2c3-98c8d04363d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:40.083344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-26767e87-3743-4673-a2c3-98c8d04363d6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Sep 13 20:13:40.083872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 709/1511] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:40 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:40.659841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3da08006-abda-4dcd-afa9-02968bece0d3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:40.660879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3da08006-abda-4dcd-afa9-02968bece0d3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:40.671187 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3da08006-abda-4dcd-afa9-02968bece0d3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:40.671664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3da08006-abda-4dcd-afa9-02968bece0d3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:40.672087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3da08006-abda-4dcd-afa9-02968bece0d3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:40.672776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3da08006-abda-4dcd-afa9-02968bece0d3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:40.673219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3da08006-abda-4dcd-afa9-02968bece0d3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:40.673604 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3da08006-abda-4dcd-afa9-02968bece0d3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:40.803714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3da08006-abda-4dcd-afa9-02968bece0d3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:40.811955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3da08006-abda-4dcd-afa9-02968bece0d3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158606 Sep 13 20:13:40.812529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 803/1512] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:40 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:41.098674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b6f0b45d-e45f-4e52-a00e-3a7af9cf7b08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:41.100894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b6f0b45d-e45f-4e52-a00e-3a7af9cf7b08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:41.107514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6f0b45d-e45f-4e52-a00e-3a7af9cf7b08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:41.107991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6f0b45d-e45f-4e52-a00e-3a7af9cf7b08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:41.108425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6f0b45d-e45f-4e52-a00e-3a7af9cf7b08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:41.109216 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6f0b45d-e45f-4e52-a00e-3a7af9cf7b08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:41.109650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6f0b45d-e45f-4e52-a00e-3a7af9cf7b08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:41.110083 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b6f0b45d-e45f-4e52-a00e-3a7af9cf7b08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:41.123798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:41.140311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b6f0b45d-e45f-4e52-a00e-3a7af9cf7b08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045686 Sep 13 20:13:41.140855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 710/1513] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:41 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:41.839629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e5998129-e117-44ec-8257-3657faa8d0f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:41.840630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e5998129-e117-44ec-8257-3657faa8d0f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:41.851764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5998129-e117-44ec-8257-3657faa8d0f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:41.852556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5998129-e117-44ec-8257-3657faa8d0f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:41.853273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5998129-e117-44ec-8257-3657faa8d0f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:41.854462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5998129-e117-44ec-8257-3657faa8d0f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:41.855196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5998129-e117-44ec-8257-3657faa8d0f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:41.855932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e5998129-e117-44ec-8257-3657faa8d0f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:41.871952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:41.988730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e5998129-e117-44ec-8257-3657faa8d0f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:41.997055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e5998129-e117-44ec-8257-3657faa8d0f4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164415 Sep 13 20:13:41.997625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 804/1514] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:41 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:42.153012 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-229778e7-bb12-4e55-bda1-fd6918b2c656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:42.155254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-229778e7-bb12-4e55-bda1-fd6918b2c656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:42.162181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-229778e7-bb12-4e55-bda1-fd6918b2c656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:42.162710 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-229778e7-bb12-4e55-bda1-fd6918b2c656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:42.163149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-229778e7-bb12-4e55-bda1-fd6918b2c656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:42.163846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-229778e7-bb12-4e55-bda1-fd6918b2c656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:42.164299 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-229778e7-bb12-4e55-bda1-fd6918b2c656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:42.164724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-229778e7-bb12-4e55-bda1-fd6918b2c656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:42.194402 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-229778e7-bb12-4e55-bda1-fd6918b2c656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Sep 13 20:13:42.194943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 711/1515] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:42 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:43.029637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3c696764-63cf-49c9-b470-7be9eaedd80e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:43.030615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3c696764-63cf-49c9-b470-7be9eaedd80e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:43.037657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c696764-63cf-49c9-b470-7be9eaedd80e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:43.038140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c696764-63cf-49c9-b470-7be9eaedd80e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:43.038617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c696764-63cf-49c9-b470-7be9eaedd80e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:43.039307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c696764-63cf-49c9-b470-7be9eaedd80e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:43.039755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c696764-63cf-49c9-b470-7be9eaedd80e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:43.040174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c696764-63cf-49c9-b470-7be9eaedd80e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:43.176954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3c696764-63cf-49c9-b470-7be9eaedd80e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:43.188326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3c696764-63cf-49c9-b470-7be9eaedd80e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.169467 Sep 13 20:13:43.190499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 805/1516] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:43 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:43.207064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f75727d4-c8bf-446e-9211-c7cab3b32126 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:43.209691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f75727d4-c8bf-446e-9211-c7cab3b32126 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:43.216744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f75727d4-c8bf-446e-9211-c7cab3b32126 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:43.217271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f75727d4-c8bf-446e-9211-c7cab3b32126 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:43.217807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f75727d4-c8bf-446e-9211-c7cab3b32126 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:43.218585 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f75727d4-c8bf-446e-9211-c7cab3b32126 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:43.219033 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f75727d4-c8bf-446e-9211-c7cab3b32126 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:43.219742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f75727d4-c8bf-446e-9211-c7cab3b32126 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:43.249924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f75727d4-c8bf-446e-9211-c7cab3b32126 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046778 Sep 13 20:13:43.250504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 712/1517] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:43 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:44.218778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-82cf63d9-94fa-4471-9332-a03a849e8a82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:44.219492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-82cf63d9-94fa-4471-9332-a03a849e8a82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:44.225962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82cf63d9-94fa-4471-9332-a03a849e8a82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:44.226475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82cf63d9-94fa-4471-9332-a03a849e8a82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:44.226879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82cf63d9-94fa-4471-9332-a03a849e8a82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:44.227594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82cf63d9-94fa-4471-9332-a03a849e8a82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:44.228028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82cf63d9-94fa-4471-9332-a03a849e8a82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:44.228468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82cf63d9-94fa-4471-9332-a03a849e8a82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:44.262683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f25846f1-7bb1-420f-8ab1-54f9149c6416 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:44.265268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f25846f1-7bb1-420f-8ab1-54f9149c6416 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:44.274890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f25846f1-7bb1-420f-8ab1-54f9149c6416 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:44.275472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f25846f1-7bb1-420f-8ab1-54f9149c6416 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:44.275985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f25846f1-7bb1-420f-8ab1-54f9149c6416 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:44.276851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f25846f1-7bb1-420f-8ab1-54f9149c6416 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:44.277366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f25846f1-7bb1-420f-8ab1-54f9149c6416 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:44.277882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f25846f1-7bb1-420f-8ab1-54f9149c6416 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:44.314740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f25846f1-7bb1-420f-8ab1-54f9149c6416 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056092 Sep 13 20:13:44.315387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 713/1518] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:44 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:44.358300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-82cf63d9-94fa-4471-9332-a03a849e8a82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:44.366603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-82cf63d9-94fa-4471-9332-a03a849e8a82 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.154947 Sep 13 20:13:44.367165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 806/1519] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:44 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:45.327239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-21938c37-18cd-4d61-9f69-12ee519008a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:45.329587 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-21938c37-18cd-4d61-9f69-12ee519008a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:45.336171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21938c37-18cd-4d61-9f69-12ee519008a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:45.337013 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21938c37-18cd-4d61-9f69-12ee519008a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:45.337442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21938c37-18cd-4d61-9f69-12ee519008a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:45.338343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21938c37-18cd-4d61-9f69-12ee519008a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:45.338826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21938c37-18cd-4d61-9f69-12ee519008a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:45.339239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21938c37-18cd-4d61-9f69-12ee519008a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:45.369388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-21938c37-18cd-4d61-9f69-12ee519008a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046087 Sep 13 20:13:45.369972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 714/1520] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:45 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:45.389233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-64f2e6f7-65a0-406e-adf9-2732b28845e7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:45.389851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-64f2e6f7-65a0-406e-adf9-2732b28845e7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:45.396579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64f2e6f7-65a0-406e-adf9-2732b28845e7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:45.397059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64f2e6f7-65a0-406e-adf9-2732b28845e7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:45.397490 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64f2e6f7-65a0-406e-adf9-2732b28845e7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:45.398175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64f2e6f7-65a0-406e-adf9-2732b28845e7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:45.398656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64f2e6f7-65a0-406e-adf9-2732b28845e7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:45.399074 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-64f2e6f7-65a0-406e-adf9-2732b28845e7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:45.529677 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-64f2e6f7-65a0-406e-adf9-2732b28845e7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:45.540493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-64f2e6f7-65a0-406e-adf9-2732b28845e7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155215 Sep 13 20:13:45.541066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 807/1521] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:45 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:46.381271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0969ff9b-5079-482a-9646-539f5a390a49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:46.383527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0969ff9b-5079-482a-9646-539f5a390a49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:46.390187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0969ff9b-5079-482a-9646-539f5a390a49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:46.390699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0969ff9b-5079-482a-9646-539f5a390a49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:46.391235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0969ff9b-5079-482a-9646-539f5a390a49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:46.391931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0969ff9b-5079-482a-9646-539f5a390a49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:46.392498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0969ff9b-5079-482a-9646-539f5a390a49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:46.392934 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0969ff9b-5079-482a-9646-539f5a390a49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:46.423105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0969ff9b-5079-482a-9646-539f5a390a49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045863 Sep 13 20:13:46.423669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 715/1522] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:46 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:46.566700 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0b7c8acb-0ac4-4112-b771-64f3687fe00f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:46.567364 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0b7c8acb-0ac4-4112-b771-64f3687fe00f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:46.574258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b7c8acb-0ac4-4112-b771-64f3687fe00f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:46.574770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b7c8acb-0ac4-4112-b771-64f3687fe00f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:46.575184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b7c8acb-0ac4-4112-b771-64f3687fe00f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:46.575887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b7c8acb-0ac4-4112-b771-64f3687fe00f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:46.576336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b7c8acb-0ac4-4112-b771-64f3687fe00f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:46.576751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0b7c8acb-0ac4-4112-b771-64f3687fe00f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:46.715078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0b7c8acb-0ac4-4112-b771-64f3687fe00f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:46.723756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0b7c8acb-0ac4-4112-b771-64f3687fe00f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162604 Sep 13 20:13:46.724311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 808/1523] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:46 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:47.440146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f3e0a679-584a-49f9-9b8b-a0795ae2e9af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:47.442318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f3e0a679-584a-49f9-9b8b-a0795ae2e9af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:47.448930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3e0a679-584a-49f9-9b8b-a0795ae2e9af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:47.449422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3e0a679-584a-49f9-9b8b-a0795ae2e9af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:47.449862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3e0a679-584a-49f9-9b8b-a0795ae2e9af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:47.450593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3e0a679-584a-49f9-9b8b-a0795ae2e9af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:47.451044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3e0a679-584a-49f9-9b8b-a0795ae2e9af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:47.451501 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3e0a679-584a-49f9-9b8b-a0795ae2e9af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:47.483325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f3e0a679-584a-49f9-9b8b-a0795ae2e9af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049862 Sep 13 20:13:47.483940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 716/1524] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:47 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:47.751565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8bca022d-640b-48ff-bb4b-ef5ac94ba7b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:47.752532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8bca022d-640b-48ff-bb4b-ef5ac94ba7b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:47.764192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bca022d-640b-48ff-bb4b-ef5ac94ba7b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:47.764926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bca022d-640b-48ff-bb4b-ef5ac94ba7b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:47.765728 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bca022d-640b-48ff-bb4b-ef5ac94ba7b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:47.766966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bca022d-640b-48ff-bb4b-ef5ac94ba7b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:47.767714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bca022d-640b-48ff-bb4b-ef5ac94ba7b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:47.768471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bca022d-640b-48ff-bb4b-ef5ac94ba7b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:47.899855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8bca022d-640b-48ff-bb4b-ef5ac94ba7b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:47.911889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8bca022d-640b-48ff-bb4b-ef5ac94ba7b7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166989 Sep 13 20:13:47.912466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 809/1525] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:47 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:48.499390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-87b10b3f-0d7b-402d-b47f-307918b5954c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:48.502930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-87b10b3f-0d7b-402d-b47f-307918b5954c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:48.513749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87b10b3f-0d7b-402d-b47f-307918b5954c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:48.514596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87b10b3f-0d7b-402d-b47f-307918b5954c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:48.515268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87b10b3f-0d7b-402d-b47f-307918b5954c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:48.516783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87b10b3f-0d7b-402d-b47f-307918b5954c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:48.517516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87b10b3f-0d7b-402d-b47f-307918b5954c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:48.518345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87b10b3f-0d7b-402d-b47f-307918b5954c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:48.556016 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-87b10b3f-0d7b-402d-b47f-307918b5954c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063140 Sep 13 20:13:48.557066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 717/1526] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:48 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:48.938255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-af286d92-2f35-46e6-8c80-d60947dfafbd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:48.938946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-af286d92-2f35-46e6-8c80-d60947dfafbd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:48.946512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af286d92-2f35-46e6-8c80-d60947dfafbd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:48.946994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af286d92-2f35-46e6-8c80-d60947dfafbd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:48.947421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af286d92-2f35-46e6-8c80-d60947dfafbd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:48.948112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af286d92-2f35-46e6-8c80-d60947dfafbd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:48.948557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af286d92-2f35-46e6-8c80-d60947dfafbd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:48.948978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af286d92-2f35-46e6-8c80-d60947dfafbd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:49.077533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-af286d92-2f35-46e6-8c80-d60947dfafbd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:49.086888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-af286d92-2f35-46e6-8c80-d60947dfafbd tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.154016 Sep 13 20:13:49.087471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 810/1527] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:48 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:49.570244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-080e68f6-5db4-42e2-aacd-822d5f6936ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:49.573313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-080e68f6-5db4-42e2-aacd-822d5f6936ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:49.580559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-080e68f6-5db4-42e2-aacd-822d5f6936ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:49.581078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-080e68f6-5db4-42e2-aacd-822d5f6936ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:49.581517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-080e68f6-5db4-42e2-aacd-822d5f6936ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:49.582231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-080e68f6-5db4-42e2-aacd-822d5f6936ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:49.582759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-080e68f6-5db4-42e2-aacd-822d5f6936ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:49.583187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-080e68f6-5db4-42e2-aacd-822d5f6936ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:49.615110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-080e68f6-5db4-42e2-aacd-822d5f6936ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048969 Sep 13 20:13:49.615870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 718/1528] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:49 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:50.113569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5c687685-eff5-47ce-8a87-7520eca39922 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:50.114184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5c687685-eff5-47ce-8a87-7520eca39922 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:50.121173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c687685-eff5-47ce-8a87-7520eca39922 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:50.121658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c687685-eff5-47ce-8a87-7520eca39922 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:50.122090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c687685-eff5-47ce-8a87-7520eca39922 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:50.122834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c687685-eff5-47ce-8a87-7520eca39922 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:50.123284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c687685-eff5-47ce-8a87-7520eca39922 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:50.123703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c687685-eff5-47ce-8a87-7520eca39922 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:50.254885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5c687685-eff5-47ce-8a87-7520eca39922 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:50.263698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5c687685-eff5-47ce-8a87-7520eca39922 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155865 Sep 13 20:13:50.264245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 811/1529] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:50 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:50.635105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f73ed826-d8d8-40d8-94b7-9f18ce9c84a1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:50.638893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f73ed826-d8d8-40d8-94b7-9f18ce9c84a1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:50.655942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f73ed826-d8d8-40d8-94b7-9f18ce9c84a1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:50.656429 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f73ed826-d8d8-40d8-94b7-9f18ce9c84a1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:50.656855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f73ed826-d8d8-40d8-94b7-9f18ce9c84a1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:50.657525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f73ed826-d8d8-40d8-94b7-9f18ce9c84a1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:50.657984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f73ed826-d8d8-40d8-94b7-9f18ce9c84a1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:50.658395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f73ed826-d8d8-40d8-94b7-9f18ce9c84a1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:50.698028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f73ed826-d8d8-40d8-94b7-9f18ce9c84a1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070081 Sep 13 20:13:50.698667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 719/1530] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:50 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:51.290969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0a1b3898-782e-4e9c-a058-4a34e4258005 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:51.291833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0a1b3898-782e-4e9c-a058-4a34e4258005 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:51.301744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a1b3898-782e-4e9c-a058-4a34e4258005 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:51.302226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a1b3898-782e-4e9c-a058-4a34e4258005 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:51.302687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a1b3898-782e-4e9c-a058-4a34e4258005 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:51.303380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a1b3898-782e-4e9c-a058-4a34e4258005 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:51.303827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a1b3898-782e-4e9c-a058-4a34e4258005 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:51.304246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0a1b3898-782e-4e9c-a058-4a34e4258005 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:51.443684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0a1b3898-782e-4e9c-a058-4a34e4258005 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:51.452353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0a1b3898-782e-4e9c-a058-4a34e4258005 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168086 Sep 13 20:13:51.452935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 812/1531] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:51 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:51.715051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9cb6fc35-796b-4328-a538-bf1d1de81a55 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:51.718731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9cb6fc35-796b-4328-a538-bf1d1de81a55 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:51.726407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9cb6fc35-796b-4328-a538-bf1d1de81a55 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:51.726924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9cb6fc35-796b-4328-a538-bf1d1de81a55 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:51.727356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9cb6fc35-796b-4328-a538-bf1d1de81a55 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:51.728034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9cb6fc35-796b-4328-a538-bf1d1de81a55 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:51.728490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9cb6fc35-796b-4328-a538-bf1d1de81a55 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:51.728918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9cb6fc35-796b-4328-a538-bf1d1de81a55 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:51.759561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9cb6fc35-796b-4328-a538-bf1d1de81a55 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051602 Sep 13 20:13:51.760218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 720/1532] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:51 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:52.478637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7f934a94-40a5-4495-b2cd-49409ec1e7ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:52.479250 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7f934a94-40a5-4495-b2cd-49409ec1e7ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:52.487104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f934a94-40a5-4495-b2cd-49409ec1e7ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:52.487656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f934a94-40a5-4495-b2cd-49409ec1e7ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:52.488152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f934a94-40a5-4495-b2cd-49409ec1e7ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:52.488945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f934a94-40a5-4495-b2cd-49409ec1e7ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:52.489464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f934a94-40a5-4495-b2cd-49409ec1e7ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:52.489952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7f934a94-40a5-4495-b2cd-49409ec1e7ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:52.624267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7f934a94-40a5-4495-b2cd-49409ec1e7ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:52.638942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7f934a94-40a5-4495-b2cd-49409ec1e7ff tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164759 Sep 13 20:13:52.639533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 813/1533] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:52 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:52.776367 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-736fcc51-0079-419f-a31e-ff5f3b9acc48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:52.779960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-736fcc51-0079-419f-a31e-ff5f3b9acc48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:52.792033 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-736fcc51-0079-419f-a31e-ff5f3b9acc48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:52.792841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-736fcc51-0079-419f-a31e-ff5f3b9acc48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:52.793596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-736fcc51-0079-419f-a31e-ff5f3b9acc48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:52.794800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-736fcc51-0079-419f-a31e-ff5f3b9acc48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:52.795550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-736fcc51-0079-419f-a31e-ff5f3b9acc48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:52.796370 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-736fcc51-0079-419f-a31e-ff5f3b9acc48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:52.829199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-736fcc51-0079-419f-a31e-ff5f3b9acc48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059374 Sep 13 20:13:52.829940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 721/1534] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:52 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:53.666511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4f0ee31f-27f3-400b-b71f-6d8635c0a311 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:53.667303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4f0ee31f-27f3-400b-b71f-6d8635c0a311 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:53.676985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f0ee31f-27f3-400b-b71f-6d8635c0a311 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:53.677471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f0ee31f-27f3-400b-b71f-6d8635c0a311 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:53.677898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f0ee31f-27f3-400b-b71f-6d8635c0a311 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:53.678627 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f0ee31f-27f3-400b-b71f-6d8635c0a311 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:53.679081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f0ee31f-27f3-400b-b71f-6d8635c0a311 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:53.679502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f0ee31f-27f3-400b-b71f-6d8635c0a311 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:53.813495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4f0ee31f-27f3-400b-b71f-6d8635c0a311 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:53.822132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4f0ee31f-27f3-400b-b71f-6d8635c0a311 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162257 Sep 13 20:13:53.822723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 814/1535] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:53 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:53.843949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-50c8a1be-24aa-4c95-9035-a1c9d4d89830 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:53.846130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-50c8a1be-24aa-4c95-9035-a1c9d4d89830 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:53.853242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50c8a1be-24aa-4c95-9035-a1c9d4d89830 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:53.853727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50c8a1be-24aa-4c95-9035-a1c9d4d89830 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:53.854161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50c8a1be-24aa-4c95-9035-a1c9d4d89830 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:53.854927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50c8a1be-24aa-4c95-9035-a1c9d4d89830 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:53.855375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50c8a1be-24aa-4c95-9035-a1c9d4d89830 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:53.855801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50c8a1be-24aa-4c95-9035-a1c9d4d89830 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:53.886986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-50c8a1be-24aa-4c95-9035-a1c9d4d89830 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047100 Sep 13 20:13:53.889651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 722/1536] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:53 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:54.846228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-71f52efc-2433-4a7b-ae36-02e31c46c16b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:54.846895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-71f52efc-2433-4a7b-ae36-02e31c46c16b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:54.852995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-71f52efc-2433-4a7b-ae36-02e31c46c16b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:54.853473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-71f52efc-2433-4a7b-ae36-02e31c46c16b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:54.853976 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-71f52efc-2433-4a7b-ae36-02e31c46c16b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:54.854624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-71f52efc-2433-4a7b-ae36-02e31c46c16b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:54.855075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-71f52efc-2433-4a7b-ae36-02e31c46c16b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:54.855495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-71f52efc-2433-4a7b-ae36-02e31c46c16b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:54.899436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4e59d839-c588-44cb-bc3d-7675f1517303 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:54.902845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4e59d839-c588-44cb-bc3d-7675f1517303 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:54.909508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4e59d839-c588-44cb-bc3d-7675f1517303 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:54.910346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4e59d839-c588-44cb-bc3d-7675f1517303 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:54.911724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4e59d839-c588-44cb-bc3d-7675f1517303 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:54.912727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4e59d839-c588-44cb-bc3d-7675f1517303 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:54.913422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4e59d839-c588-44cb-bc3d-7675f1517303 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:54.914104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4e59d839-c588-44cb-bc3d-7675f1517303 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:54.968818 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4e59d839-c588-44cb-bc3d-7675f1517303 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073286 Sep 13 20:13:54.971156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 723/1537] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:54 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:13:54.999890 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-71f52efc-2433-4a7b-ae36-02e31c46c16b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:55.008355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-71f52efc-2433-4a7b-ae36-02e31c46c16b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166998 Sep 13 20:13:55.009239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 815/1538] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:54 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:55.984636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-054b9191-e48c-492f-aee1-e12bf4904594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:55.987884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-054b9191-e48c-492f-aee1-e12bf4904594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:55.994743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-054b9191-e48c-492f-aee1-e12bf4904594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:55.995225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-054b9191-e48c-492f-aee1-e12bf4904594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:55.995655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-054b9191-e48c-492f-aee1-e12bf4904594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:55.996342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-054b9191-e48c-492f-aee1-e12bf4904594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:55.996786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-054b9191-e48c-492f-aee1-e12bf4904594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:55.997269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-054b9191-e48c-492f-aee1-e12bf4904594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:56.029251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-054b9191-e48c-492f-aee1-e12bf4904594 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051172 Sep 13 20:13:56.029986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 724/1539] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:55 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:56.031503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d4305f0a-c2cf-44ad-a743-fbc49e5c4357 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:56.032118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d4305f0a-c2cf-44ad-a743-fbc49e5c4357 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:56.038952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4305f0a-c2cf-44ad-a743-fbc49e5c4357 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:56.039428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4305f0a-c2cf-44ad-a743-fbc49e5c4357 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:56.039852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4305f0a-c2cf-44ad-a743-fbc49e5c4357 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:56.040674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4305f0a-c2cf-44ad-a743-fbc49e5c4357 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:56.040980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4305f0a-c2cf-44ad-a743-fbc49e5c4357 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:56.041396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4305f0a-c2cf-44ad-a743-fbc49e5c4357 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:56.174266 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d4305f0a-c2cf-44ad-a743-fbc49e5c4357 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:56.182804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d4305f0a-c2cf-44ad-a743-fbc49e5c4357 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155225 Sep 13 20:13:56.183383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 816/1540] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:56 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:13:57.045997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4f8a5548-e3e1-48cb-a5a9-acf9ac743e56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:57.049380 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4f8a5548-e3e1-48cb-a5a9-acf9ac743e56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:57.053029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=58 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:57.062070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f8a5548-e3e1-48cb-a5a9-acf9ac743e56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:57.062918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f8a5548-e3e1-48cb-a5a9-acf9ac743e56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:57.063645 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f8a5548-e3e1-48cb-a5a9-acf9ac743e56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:57.064781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f8a5548-e3e1-48cb-a5a9-acf9ac743e56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:57.065533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f8a5548-e3e1-48cb-a5a9-acf9ac743e56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:57.065951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f8a5548-e3e1-48cb-a5a9-acf9ac743e56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:57.097126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4f8a5548-e3e1-48cb-a5a9-acf9ac743e56 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057825 Sep 13 20:13:57.097811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 725/1541] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:57 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:57.208978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1d32d09d-1f46-499e-b484-c044b165da12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:57.210018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1d32d09d-1f46-499e-b484-c044b165da12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:57.214037 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:57.222256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d32d09d-1f46-499e-b484-c044b165da12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:57.222755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d32d09d-1f46-499e-b484-c044b165da12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:57.223176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d32d09d-1f46-499e-b484-c044b165da12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:57.223848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d32d09d-1f46-499e-b484-c044b165da12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:57.224303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d32d09d-1f46-499e-b484-c044b165da12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:57.224736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d32d09d-1f46-499e-b484-c044b165da12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:57.362907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1d32d09d-1f46-499e-b484-c044b165da12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:57.371317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1d32d09d-1f46-499e-b484-c044b165da12 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168802 Sep 13 20:13:57.371882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 817/1542] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:57 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:58.113726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ab0e2d3a-855b-47fd-91e6-34c1315b209b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:58.116374 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ab0e2d3a-855b-47fd-91e6-34c1315b209b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:58.124666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab0e2d3a-855b-47fd-91e6-34c1315b209b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:58.125260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab0e2d3a-855b-47fd-91e6-34c1315b209b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:58.125796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab0e2d3a-855b-47fd-91e6-34c1315b209b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:58.126701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab0e2d3a-855b-47fd-91e6-34c1315b209b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:58.127253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab0e2d3a-855b-47fd-91e6-34c1315b209b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:58.127773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab0e2d3a-855b-47fd-91e6-34c1315b209b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:58.161123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ab0e2d3a-855b-47fd-91e6-34c1315b209b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053782 Sep 13 20:13:58.161724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 726/1543] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:58 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:58.397859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-514a47e4-fd0a-469b-865c-fbe3c003dc2b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:58.398786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-514a47e4-fd0a-469b-865c-fbe3c003dc2b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:58.409590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-514a47e4-fd0a-469b-865c-fbe3c003dc2b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:58.410123 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-514a47e4-fd0a-469b-865c-fbe3c003dc2b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:58.410612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-514a47e4-fd0a-469b-865c-fbe3c003dc2b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:58.411342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-514a47e4-fd0a-469b-865c-fbe3c003dc2b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:58.411789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-514a47e4-fd0a-469b-865c-fbe3c003dc2b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:58.412208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-514a47e4-fd0a-469b-865c-fbe3c003dc2b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:58.543258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-514a47e4-fd0a-469b-865c-fbe3c003dc2b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:58.555091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-514a47e4-fd0a-469b-865c-fbe3c003dc2b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163681 Sep 13 20:13:58.555805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 818/1544] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:58 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:59.178001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a2c7aff6-e54d-4323-801f-82977e882bd7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:59.181518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a2c7aff6-e54d-4323-801f-82977e882bd7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:59.192053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a2c7aff6-e54d-4323-801f-82977e882bd7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:59.192536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a2c7aff6-e54d-4323-801f-82977e882bd7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:59.192973 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a2c7aff6-e54d-4323-801f-82977e882bd7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:59.193687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a2c7aff6-e54d-4323-801f-82977e882bd7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:59.194140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a2c7aff6-e54d-4323-801f-82977e882bd7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:59.194601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a2c7aff6-e54d-4323-801f-82977e882bd7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:59.197163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:59.232922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a2c7aff6-e54d-4323-801f-82977e882bd7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061629 Sep 13 20:13:59.233563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 727/1545] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:13:59 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:13:59.581462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8bd578a7-1f75-4455-bf70-5e70c3a9bc6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:59.582077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8bd578a7-1f75-4455-bf70-5e70c3a9bc6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:59.589303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bd578a7-1f75-4455-bf70-5e70c3a9bc6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:59.589760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bd578a7-1f75-4455-bf70-5e70c3a9bc6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:59.590208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bd578a7-1f75-4455-bf70-5e70c3a9bc6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:59.590921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bd578a7-1f75-4455-bf70-5e70c3a9bc6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:59.591365 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bd578a7-1f75-4455-bf70-5e70c3a9bc6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:59.591781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bd578a7-1f75-4455-bf70-5e70c3a9bc6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:59.724152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8bd578a7-1f75-4455-bf70-5e70c3a9bc6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:59.732481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8bd578a7-1f75-4455-bf70-5e70c3a9bc6a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155109 Sep 13 20:13:59.733090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 819/1546] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:59 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:00.249592 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2ddbe865-1e09-4f0d-b15b-589a95a44d70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:00.253146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2ddbe865-1e09-4f0d-b15b-589a95a44d70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:00.263672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ddbe865-1e09-4f0d-b15b-589a95a44d70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:00.264515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ddbe865-1e09-4f0d-b15b-589a95a44d70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:00.265252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ddbe865-1e09-4f0d-b15b-589a95a44d70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:00.266444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ddbe865-1e09-4f0d-b15b-589a95a44d70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:00.267250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ddbe865-1e09-4f0d-b15b-589a95a44d70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:00.268024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ddbe865-1e09-4f0d-b15b-589a95a44d70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:00.299372 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2ddbe865-1e09-4f0d-b15b-589a95a44d70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056480 Sep 13 20:14:00.299973 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 728/1547] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:00 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:00.759729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e393f71c-2939-4e80-9b59-fa9e9272eaf8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:00.760726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e393f71c-2939-4e80-9b59-fa9e9272eaf8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:00.771633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e393f71c-2939-4e80-9b59-fa9e9272eaf8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:00.772418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e393f71c-2939-4e80-9b59-fa9e9272eaf8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:00.773126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e393f71c-2939-4e80-9b59-fa9e9272eaf8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:00.774309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e393f71c-2939-4e80-9b59-fa9e9272eaf8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:00.775101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e393f71c-2939-4e80-9b59-fa9e9272eaf8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:00.775794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e393f71c-2939-4e80-9b59-fa9e9272eaf8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:00.919689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e393f71c-2939-4e80-9b59-fa9e9272eaf8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:00.928236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e393f71c-2939-4e80-9b59-fa9e9272eaf8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.175119 Sep 13 20:14:00.928823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 820/1548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:00 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:01.317136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-33b27e74-4aa7-47c9-a74b-3ecba8165c7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:01.320656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-33b27e74-4aa7-47c9-a74b-3ecba8165c7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:01.331741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33b27e74-4aa7-47c9-a74b-3ecba8165c7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:01.332225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33b27e74-4aa7-47c9-a74b-3ecba8165c7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:01.332664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33b27e74-4aa7-47c9-a74b-3ecba8165c7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:01.333728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33b27e74-4aa7-47c9-a74b-3ecba8165c7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:01.334199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33b27e74-4aa7-47c9-a74b-3ecba8165c7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:01.334657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33b27e74-4aa7-47c9-a74b-3ecba8165c7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:01.365743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-33b27e74-4aa7-47c9-a74b-3ecba8165c7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055869 Sep 13 20:14:01.366310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 729/1549] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:01.956036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c00660c3-f20a-4e39-b93e-b0e99ef2aa97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:01.956860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c00660c3-f20a-4e39-b93e-b0e99ef2aa97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:01.965106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c00660c3-f20a-4e39-b93e-b0e99ef2aa97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:01.965663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c00660c3-f20a-4e39-b93e-b0e99ef2aa97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:01.966158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c00660c3-f20a-4e39-b93e-b0e99ef2aa97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:01.966998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c00660c3-f20a-4e39-b93e-b0e99ef2aa97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:01.967521 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c00660c3-f20a-4e39-b93e-b0e99ef2aa97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:01.968013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c00660c3-f20a-4e39-b93e-b0e99ef2aa97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:01.971019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:02.104579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c00660c3-f20a-4e39-b93e-b0e99ef2aa97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:02.113322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c00660c3-f20a-4e39-b93e-b0e99ef2aa97 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163875 Sep 13 20:14:02.113895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 821/1550] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:01 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:02.381717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d145186e-cf99-4a52-a5f8-25652868605f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:02.384126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d145186e-cf99-4a52-a5f8-25652868605f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:02.391667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d145186e-cf99-4a52-a5f8-25652868605f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:02.392241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d145186e-cf99-4a52-a5f8-25652868605f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:02.392727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d145186e-cf99-4a52-a5f8-25652868605f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:02.393627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d145186e-cf99-4a52-a5f8-25652868605f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:02.393987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d145186e-cf99-4a52-a5f8-25652868605f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:02.394495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d145186e-cf99-4a52-a5f8-25652868605f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:02.428664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d145186e-cf99-4a52-a5f8-25652868605f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052677 Sep 13 20:14:02.429208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 730/1551] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:02 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:03.145352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-85a081e9-9dbc-48da-b6d5-8f0cbba156e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:03.146414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-85a081e9-9dbc-48da-b6d5-8f0cbba156e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:03.157455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85a081e9-9dbc-48da-b6d5-8f0cbba156e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:03.158256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85a081e9-9dbc-48da-b6d5-8f0cbba156e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:03.159050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85a081e9-9dbc-48da-b6d5-8f0cbba156e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:03.160113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85a081e9-9dbc-48da-b6d5-8f0cbba156e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:03.160564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85a081e9-9dbc-48da-b6d5-8f0cbba156e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:03.160992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85a081e9-9dbc-48da-b6d5-8f0cbba156e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:03.304053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-85a081e9-9dbc-48da-b6d5-8f0cbba156e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:03.317124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-85a081e9-9dbc-48da-b6d5-8f0cbba156e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.178145 Sep 13 20:14:03.317929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 822/1552] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:03 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:03.445169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-593c33fd-7ad8-4bd6-83aa-62094f162c1e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:03.448791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-593c33fd-7ad8-4bd6-83aa-62094f162c1e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:03.458844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-593c33fd-7ad8-4bd6-83aa-62094f162c1e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:03.459306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-593c33fd-7ad8-4bd6-83aa-62094f162c1e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:03.459622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-593c33fd-7ad8-4bd6-83aa-62094f162c1e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:03.460316 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-593c33fd-7ad8-4bd6-83aa-62094f162c1e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:03.460763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-593c33fd-7ad8-4bd6-83aa-62094f162c1e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:03.461188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-593c33fd-7ad8-4bd6-83aa-62094f162c1e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:03.492611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-593c33fd-7ad8-4bd6-83aa-62094f162c1e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054402 Sep 13 20:14:03.493348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 731/1553] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:03 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:04.348873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-188b3351-4730-4620-b1af-78ad826d8d5e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:04.349491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-188b3351-4730-4620-b1af-78ad826d8d5e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:04.356304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-188b3351-4730-4620-b1af-78ad826d8d5e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:04.356773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-188b3351-4730-4620-b1af-78ad826d8d5e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:04.357193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-188b3351-4730-4620-b1af-78ad826d8d5e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:04.357877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-188b3351-4730-4620-b1af-78ad826d8d5e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:04.358319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-188b3351-4730-4620-b1af-78ad826d8d5e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:04.358784 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-188b3351-4730-4620-b1af-78ad826d8d5e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:04.495643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-188b3351-4730-4620-b1af-78ad826d8d5e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:04.504355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-188b3351-4730-4620-b1af-78ad826d8d5e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161169 Sep 13 20:14:04.504961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 823/1554] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:04 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:04.506666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f94a0177-4587-4b66-9f24-25e401b122e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:04.508842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f94a0177-4587-4b66-9f24-25e401b122e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:04.515623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f94a0177-4587-4b66-9f24-25e401b122e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:04.516075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f94a0177-4587-4b66-9f24-25e401b122e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:04.516509 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f94a0177-4587-4b66-9f24-25e401b122e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:04.517200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f94a0177-4587-4b66-9f24-25e401b122e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:04.517682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f94a0177-4587-4b66-9f24-25e401b122e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:04.518105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f94a0177-4587-4b66-9f24-25e401b122e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:04.548450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f94a0177-4587-4b66-9f24-25e401b122e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046047 Sep 13 20:14:04.549064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 732/1555] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:04 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:05.531831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3d44e405-b22f-44dd-8498-2d387ee06e4f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:05.532800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3d44e405-b22f-44dd-8498-2d387ee06e4f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:05.541066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d44e405-b22f-44dd-8498-2d387ee06e4f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:05.541638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d44e405-b22f-44dd-8498-2d387ee06e4f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:05.542114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d44e405-b22f-44dd-8498-2d387ee06e4f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:05.542930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d44e405-b22f-44dd-8498-2d387ee06e4f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:05.543433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d44e405-b22f-44dd-8498-2d387ee06e4f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:05.543901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d44e405-b22f-44dd-8498-2d387ee06e4f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:05.561027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e0017530-c3c2-41da-93c2-d579c351ae12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:05.563706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e0017530-c3c2-41da-93c2-d579c351ae12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:05.570842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0017530-c3c2-41da-93c2-d579c351ae12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:05.571431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0017530-c3c2-41da-93c2-d579c351ae12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:05.571955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0017530-c3c2-41da-93c2-d579c351ae12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:05.572813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0017530-c3c2-41da-93c2-d579c351ae12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:05.573258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0017530-c3c2-41da-93c2-d579c351ae12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:05.573689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0017530-c3c2-41da-93c2-d579c351ae12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:05.605907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e0017530-c3c2-41da-93c2-d579c351ae12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049268 Sep 13 20:14:05.606815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 733/1556] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:05 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:05.685478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3d44e405-b22f-44dd-8498-2d387ee06e4f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:05.693713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3d44e405-b22f-44dd-8498-2d387ee06e4f tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168489 Sep 13 20:14:05.694283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 824/1557] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:05 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:06.619130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2fc88483-5919-4c26-b772-cb3b0eff7f9d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:06.621295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2fc88483-5919-4c26-b772-cb3b0eff7f9d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:06.628532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2fc88483-5919-4c26-b772-cb3b0eff7f9d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:06.629010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2fc88483-5919-4c26-b772-cb3b0eff7f9d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:06.629435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2fc88483-5919-4c26-b772-cb3b0eff7f9d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:06.630124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2fc88483-5919-4c26-b772-cb3b0eff7f9d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:06.630607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2fc88483-5919-4c26-b772-cb3b0eff7f9d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:06.631022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2fc88483-5919-4c26-b772-cb3b0eff7f9d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:06.664722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2fc88483-5919-4c26-b772-cb3b0eff7f9d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049573 Sep 13 20:14:06.665342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 734/1558] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:06.717767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c0e8671b-184a-4b46-9dc4-26134ea89569 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:06.718470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c0e8671b-184a-4b46-9dc4-26134ea89569 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:06.725011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0e8671b-184a-4b46-9dc4-26134ea89569 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:06.725491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0e8671b-184a-4b46-9dc4-26134ea89569 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:06.725920 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0e8671b-184a-4b46-9dc4-26134ea89569 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:06.726646 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0e8671b-184a-4b46-9dc4-26134ea89569 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:06.727089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0e8671b-184a-4b46-9dc4-26134ea89569 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:06.727501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0e8671b-184a-4b46-9dc4-26134ea89569 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:06.858033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c0e8671b-184a-4b46-9dc4-26134ea89569 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:06.866993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c0e8671b-184a-4b46-9dc4-26134ea89569 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.153496 Sep 13 20:14:06.867574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 825/1559] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:06 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:07.678034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0d508060-b1f6-43ad-9517-b089befc1b9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:07.680138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0d508060-b1f6-43ad-9517-b089befc1b9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:07.687397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0d508060-b1f6-43ad-9517-b089befc1b9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:07.687890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0d508060-b1f6-43ad-9517-b089befc1b9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:07.688328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0d508060-b1f6-43ad-9517-b089befc1b9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:07.689037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0d508060-b1f6-43ad-9517-b089befc1b9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:07.689472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0d508060-b1f6-43ad-9517-b089befc1b9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:07.689890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0d508060-b1f6-43ad-9517-b089befc1b9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:07.725269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0d508060-b1f6-43ad-9517-b089befc1b9a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051487 Sep 13 20:14:07.725831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 735/1560] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:07.893480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c421666a-cfa3-436e-90e7-c2473c4aaf56 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:07.894470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c421666a-cfa3-436e-90e7-c2473c4aaf56 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:07.905535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c421666a-cfa3-436e-90e7-c2473c4aaf56 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:07.906321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c421666a-cfa3-436e-90e7-c2473c4aaf56 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:07.907107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c421666a-cfa3-436e-90e7-c2473c4aaf56 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:07.908240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c421666a-cfa3-436e-90e7-c2473c4aaf56 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:07.908976 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c421666a-cfa3-436e-90e7-c2473c4aaf56 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:07.909667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c421666a-cfa3-436e-90e7-c2473c4aaf56 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:08.043225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c421666a-cfa3-436e-90e7-c2473c4aaf56 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:08.052778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c421666a-cfa3-436e-90e7-c2473c4aaf56 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165751 Sep 13 20:14:08.053353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 826/1561] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:07 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:08.742232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-69a8f187-8636-4b78-9e01-1b215856d744 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:08.745836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-69a8f187-8636-4b78-9e01-1b215856d744 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:08.756046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-69a8f187-8636-4b78-9e01-1b215856d744 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:08.756519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-69a8f187-8636-4b78-9e01-1b215856d744 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:08.756946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-69a8f187-8636-4b78-9e01-1b215856d744 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:08.757627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-69a8f187-8636-4b78-9e01-1b215856d744 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:08.758070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-69a8f187-8636-4b78-9e01-1b215856d744 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:08.758521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-69a8f187-8636-4b78-9e01-1b215856d744 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:08.788701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-69a8f187-8636-4b78-9e01-1b215856d744 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053070 Sep 13 20:14:08.789265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 736/1562] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:09.080738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2cbe5c28-96ff-4579-ade1-8e8fcc8c1567 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:09.081556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2cbe5c28-96ff-4579-ade1-8e8fcc8c1567 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:09.089868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2cbe5c28-96ff-4579-ade1-8e8fcc8c1567 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:09.090379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2cbe5c28-96ff-4579-ade1-8e8fcc8c1567 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:09.090878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2cbe5c28-96ff-4579-ade1-8e8fcc8c1567 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:09.091605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2cbe5c28-96ff-4579-ade1-8e8fcc8c1567 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:09.092109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2cbe5c28-96ff-4579-ade1-8e8fcc8c1567 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:09.092553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2cbe5c28-96ff-4579-ade1-8e8fcc8c1567 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:09.225655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2cbe5c28-96ff-4579-ade1-8e8fcc8c1567 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:09.234831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2cbe5c28-96ff-4579-ade1-8e8fcc8c1567 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160686 Sep 13 20:14:09.235397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 827/1563] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:09 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:09.805796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f95778cd-d95a-4dc8-9fdd-ced59cc99088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:09.809448 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f95778cd-d95a-4dc8-9fdd-ced59cc99088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:09.820391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f95778cd-d95a-4dc8-9fdd-ced59cc99088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:09.821192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f95778cd-d95a-4dc8-9fdd-ced59cc99088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:09.821915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f95778cd-d95a-4dc8-9fdd-ced59cc99088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:09.823272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f95778cd-d95a-4dc8-9fdd-ced59cc99088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:09.824030 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f95778cd-d95a-4dc8-9fdd-ced59cc99088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:09.824794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f95778cd-d95a-4dc8-9fdd-ced59cc99088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:09.858880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f95778cd-d95a-4dc8-9fdd-ced59cc99088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060107 Sep 13 20:14:09.859543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 737/1564] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:10.258482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e21c1611-e600-4689-84b1-1e95b119b6fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:10.259069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e21c1611-e600-4689-84b1-1e95b119b6fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:10.265722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e21c1611-e600-4689-84b1-1e95b119b6fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:10.266201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e21c1611-e600-4689-84b1-1e95b119b6fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:10.266661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e21c1611-e600-4689-84b1-1e95b119b6fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:10.267342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e21c1611-e600-4689-84b1-1e95b119b6fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:10.267764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e21c1611-e600-4689-84b1-1e95b119b6fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:10.268178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e21c1611-e600-4689-84b1-1e95b119b6fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:10.423876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e21c1611-e600-4689-84b1-1e95b119b6fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:10.432683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e21c1611-e600-4689-84b1-1e95b119b6fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.178586 Sep 13 20:14:10.433231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 828/1565] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:10 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:10.871589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-00eba129-bf68-473e-a2b8-b476fae72960 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:10.873788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-00eba129-bf68-473e-a2b8-b476fae72960 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:10.880883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00eba129-bf68-473e-a2b8-b476fae72960 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:10.881373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00eba129-bf68-473e-a2b8-b476fae72960 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:10.881805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00eba129-bf68-473e-a2b8-b476fae72960 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:10.882523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00eba129-bf68-473e-a2b8-b476fae72960 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:10.882977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00eba129-bf68-473e-a2b8-b476fae72960 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:10.883400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00eba129-bf68-473e-a2b8-b476fae72960 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:10.918839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-00eba129-bf68-473e-a2b8-b476fae72960 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051296 Sep 13 20:14:10.919440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 738/1566] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:10 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:11.460500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-013404d0-0eba-41bb-8a78-88a7927445c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:11.461441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-013404d0-0eba-41bb-8a78-88a7927445c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:11.472694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-013404d0-0eba-41bb-8a78-88a7927445c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:11.473764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-013404d0-0eba-41bb-8a78-88a7927445c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:11.474189 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-013404d0-0eba-41bb-8a78-88a7927445c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:11.474910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-013404d0-0eba-41bb-8a78-88a7927445c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:11.475351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-013404d0-0eba-41bb-8a78-88a7927445c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:11.475762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-013404d0-0eba-41bb-8a78-88a7927445c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:11.613440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-013404d0-0eba-41bb-8a78-88a7927445c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:11.622131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-013404d0-0eba-41bb-8a78-88a7927445c5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168231 Sep 13 20:14:11.622768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 829/1567] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:11 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:11.935953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6cecb7c5-7a74-4857-87d0-b7ccf3142884 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:11.939376 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6cecb7c5-7a74-4857-87d0-b7ccf3142884 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:11.942425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:14:11.942727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:14:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments (ip 10.222.0.52) !!! Sep 13 20:14:11.944377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:14:11.944623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:14:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments (ip 10.222.0.52) !!! Sep 13 20:14:11.958927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cecb7c5-7a74-4857-87d0-b7ccf3142884 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:11.959312 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cecb7c5-7a74-4857-87d0-b7ccf3142884 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:11.959740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cecb7c5-7a74-4857-87d0-b7ccf3142884 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:11.960425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cecb7c5-7a74-4857-87d0-b7ccf3142884 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:11.960897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cecb7c5-7a74-4857-87d0-b7ccf3142884 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:11.961313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cecb7c5-7a74-4857-87d0-b7ccf3142884 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:11.994610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6cecb7c5-7a74-4857-87d0-b7ccf3142884 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065322 Sep 13 20:14:11.995196 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 739/1568] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:11 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:12.648253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5bfb3c58-a538-499b-9aa4-33b6710d9f9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:12.648985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5bfb3c58-a538-499b-9aa4-33b6710d9f9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:12.656804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bfb3c58-a538-499b-9aa4-33b6710d9f9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:12.657346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bfb3c58-a538-499b-9aa4-33b6710d9f9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:12.657828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bfb3c58-a538-499b-9aa4-33b6710d9f9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:12.658632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bfb3c58-a538-499b-9aa4-33b6710d9f9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:12.659128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bfb3c58-a538-499b-9aa4-33b6710d9f9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:12.659595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5bfb3c58-a538-499b-9aa4-33b6710d9f9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:12.795276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5bfb3c58-a538-499b-9aa4-33b6710d9f9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:12.804030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5bfb3c58-a538-499b-9aa4-33b6710d9f9a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161230 Sep 13 20:14:12.804605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 830/1569] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:12 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:13.011497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-43d0e258-eb95-49c9-8efe-57760535d8c0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:13.014992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-43d0e258-eb95-49c9-8efe-57760535d8c0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:13.025716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43d0e258-eb95-49c9-8efe-57760535d8c0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:13.026549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43d0e258-eb95-49c9-8efe-57760535d8c0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:13.027273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43d0e258-eb95-49c9-8efe-57760535d8c0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:13.028396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43d0e258-eb95-49c9-8efe-57760535d8c0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:13.029128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43d0e258-eb95-49c9-8efe-57760535d8c0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:13.029814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-43d0e258-eb95-49c9-8efe-57760535d8c0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:13.062109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-43d0e258-eb95-49c9-8efe-57760535d8c0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057445 Sep 13 20:14:13.062692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 740/1570] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:13.831366 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5fc10857-0585-459e-891c-a2ca0c3a9611 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:13.832453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5fc10857-0585-459e-891c-a2ca0c3a9611 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:13.843738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5fc10857-0585-459e-891c-a2ca0c3a9611 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:13.844565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5fc10857-0585-459e-891c-a2ca0c3a9611 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:13.845285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5fc10857-0585-459e-891c-a2ca0c3a9611 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:13.846943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5fc10857-0585-459e-891c-a2ca0c3a9611 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:13.847702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5fc10857-0585-459e-891c-a2ca0c3a9611 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:13.848378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5fc10857-0585-459e-891c-a2ca0c3a9611 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:13.979029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5fc10857-0585-459e-891c-a2ca0c3a9611 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:13.991619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5fc10857-0585-459e-891c-a2ca0c3a9611 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167349 Sep 13 20:14:13.992394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 831/1571] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:13 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:14.078975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3c6a4add-a510-4ecf-bace-c8d023ec118f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:14.082573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3c6a4add-a510-4ecf-bace-c8d023ec118f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:14.090642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c6a4add-a510-4ecf-bace-c8d023ec118f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:14.091153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c6a4add-a510-4ecf-bace-c8d023ec118f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:14.091566 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c6a4add-a510-4ecf-bace-c8d023ec118f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:14.092263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c6a4add-a510-4ecf-bace-c8d023ec118f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:14.092715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c6a4add-a510-4ecf-bace-c8d023ec118f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:14.093142 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c6a4add-a510-4ecf-bace-c8d023ec118f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:14.122838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3c6a4add-a510-4ecf-bace-c8d023ec118f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050545 Sep 13 20:14:14.123383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 741/1572] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:14 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:15.024332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ee8e860d-2e8f-47d8-b553-b43c8e5b1517 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:15.025309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ee8e860d-2e8f-47d8-b553-b43c8e5b1517 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:15.036267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ee8e860d-2e8f-47d8-b553-b43c8e5b1517 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:15.037059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ee8e860d-2e8f-47d8-b553-b43c8e5b1517 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:15.037767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ee8e860d-2e8f-47d8-b553-b43c8e5b1517 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:15.039002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ee8e860d-2e8f-47d8-b553-b43c8e5b1517 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:15.039726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ee8e860d-2e8f-47d8-b553-b43c8e5b1517 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:15.040415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ee8e860d-2e8f-47d8-b553-b43c8e5b1517 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:15.138178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7335b40c-7572-4dcf-8182-3fcc674116b3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:15.140393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7335b40c-7572-4dcf-8182-3fcc674116b3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:15.147101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7335b40c-7572-4dcf-8182-3fcc674116b3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:15.147644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7335b40c-7572-4dcf-8182-3fcc674116b3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:15.148080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7335b40c-7572-4dcf-8182-3fcc674116b3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:15.148779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7335b40c-7572-4dcf-8182-3fcc674116b3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:15.149226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7335b40c-7572-4dcf-8182-3fcc674116b3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:15.150001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7335b40c-7572-4dcf-8182-3fcc674116b3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:15.180738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7335b40c-7572-4dcf-8182-3fcc674116b3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046421 Sep 13 20:14:15.181304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 742/1573] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:15.184880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ee8e860d-2e8f-47d8-b553-b43c8e5b1517 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:15.193475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ee8e860d-2e8f-47d8-b553-b43c8e5b1517 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.175862 Sep 13 20:14:15.194050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 832/1574] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:15 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:16.197644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c330666e-a387-4636-85b6-27b2f3ad6b19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:16.201233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c330666e-a387-4636-85b6-27b2f3ad6b19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:16.212675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c330666e-a387-4636-85b6-27b2f3ad6b19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:16.213426 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c330666e-a387-4636-85b6-27b2f3ad6b19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:16.214226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c330666e-a387-4636-85b6-27b2f3ad6b19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:16.215424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c330666e-a387-4636-85b6-27b2f3ad6b19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:16.216144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c330666e-a387-4636-85b6-27b2f3ad6b19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:16.216901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c330666e-a387-4636-85b6-27b2f3ad6b19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:16.220853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8ec58d91-f09d-4a8b-ab93-fea5476550b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:16.221839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8ec58d91-f09d-4a8b-ab93-fea5476550b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:16.230085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ec58d91-f09d-4a8b-ab93-fea5476550b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:16.230602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ec58d91-f09d-4a8b-ab93-fea5476550b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:16.231028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ec58d91-f09d-4a8b-ab93-fea5476550b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:16.231692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ec58d91-f09d-4a8b-ab93-fea5476550b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:16.232140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ec58d91-f09d-4a8b-ab93-fea5476550b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:16.232544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ec58d91-f09d-4a8b-ab93-fea5476550b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:16.245138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:16.252606 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c330666e-a387-4636-85b6-27b2f3ad6b19 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061832 Sep 13 20:14:16.253399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 743/1575] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:16 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:16.362684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8ec58d91-f09d-4a8b-ab93-fea5476550b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:16.371316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8ec58d91-f09d-4a8b-ab93-fea5476550b0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156922 Sep 13 20:14:16.371926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 833/1576] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:16 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:17.269301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9921c6c7-90fb-41eb-aaba-7d208fb25e48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:17.272835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9921c6c7-90fb-41eb-aaba-7d208fb25e48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:17.280080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9921c6c7-90fb-41eb-aaba-7d208fb25e48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:17.280567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9921c6c7-90fb-41eb-aaba-7d208fb25e48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:17.281031 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9921c6c7-90fb-41eb-aaba-7d208fb25e48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:17.281702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9921c6c7-90fb-41eb-aaba-7d208fb25e48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:17.282155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9921c6c7-90fb-41eb-aaba-7d208fb25e48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:17.282620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9921c6c7-90fb-41eb-aaba-7d208fb25e48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:17.312680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9921c6c7-90fb-41eb-aaba-7d208fb25e48 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050234 Sep 13 20:14:17.313219 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 744/1577] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:17 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:17.394079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e6877cc9-ff6c-4aa7-afaa-7f4380c52ad9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:17.394934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e6877cc9-ff6c-4aa7-afaa-7f4380c52ad9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:17.401799 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6877cc9-ff6c-4aa7-afaa-7f4380c52ad9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:17.402362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6877cc9-ff6c-4aa7-afaa-7f4380c52ad9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:17.402843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6877cc9-ff6c-4aa7-afaa-7f4380c52ad9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:17.403544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6877cc9-ff6c-4aa7-afaa-7f4380c52ad9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:17.404581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6877cc9-ff6c-4aa7-afaa-7f4380c52ad9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:17.405033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6877cc9-ff6c-4aa7-afaa-7f4380c52ad9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:17.540071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e6877cc9-ff6c-4aa7-afaa-7f4380c52ad9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:17.551757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e6877cc9-ff6c-4aa7-afaa-7f4380c52ad9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161435 Sep 13 20:14:17.552591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 834/1578] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:17 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:18.332450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0d7f6a54-8ba0-4cca-b664-16c52dadaa6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:18.336339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0d7f6a54-8ba0-4cca-b664-16c52dadaa6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:18.347003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0d7f6a54-8ba0-4cca-b664-16c52dadaa6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:18.347797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0d7f6a54-8ba0-4cca-b664-16c52dadaa6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:18.348518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0d7f6a54-8ba0-4cca-b664-16c52dadaa6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:18.349662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0d7f6a54-8ba0-4cca-b664-16c52dadaa6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:18.350524 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0d7f6a54-8ba0-4cca-b664-16c52dadaa6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:18.351157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0d7f6a54-8ba0-4cca-b664-16c52dadaa6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:18.380512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0d7f6a54-8ba0-4cca-b664-16c52dadaa6a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057006 Sep 13 20:14:18.381274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 745/1579] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:18.582027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dce83219-37ce-4e82-9b37-d24c34d88bf0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:18.583117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dce83219-37ce-4e82-9b37-d24c34d88bf0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:18.590870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dce83219-37ce-4e82-9b37-d24c34d88bf0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:18.591350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dce83219-37ce-4e82-9b37-d24c34d88bf0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:18.591788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dce83219-37ce-4e82-9b37-d24c34d88bf0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:18.592464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dce83219-37ce-4e82-9b37-d24c34d88bf0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:18.592947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dce83219-37ce-4e82-9b37-d24c34d88bf0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:18.593366 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dce83219-37ce-4e82-9b37-d24c34d88bf0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:18.725487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dce83219-37ce-4e82-9b37-d24c34d88bf0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:18.742296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dce83219-37ce-4e82-9b37-d24c34d88bf0 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165419 Sep 13 20:14:18.742956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 835/1580] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:18 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:19.397792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6e463c85-856a-47d2-a232-6130148950e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:19.399962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6e463c85-856a-47d2-a232-6130148950e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:19.406875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6e463c85-856a-47d2-a232-6130148950e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:19.407365 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6e463c85-856a-47d2-a232-6130148950e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:19.407800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6e463c85-856a-47d2-a232-6130148950e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:19.408520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6e463c85-856a-47d2-a232-6130148950e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:19.408950 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6e463c85-856a-47d2-a232-6130148950e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:19.409377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6e463c85-856a-47d2-a232-6130148950e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:19.439676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6e463c85-856a-47d2-a232-6130148950e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048625 Sep 13 20:14:19.440421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 746/1581] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:19.770574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f7466874-63cd-4890-945b-33b3ac7963f7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:19.771552 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f7466874-63cd-4890-945b-33b3ac7963f7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:19.782447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7466874-63cd-4890-945b-33b3ac7963f7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:19.783253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7466874-63cd-4890-945b-33b3ac7963f7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:19.783970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7466874-63cd-4890-945b-33b3ac7963f7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:19.785106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7466874-63cd-4890-945b-33b3ac7963f7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:19.785850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7466874-63cd-4890-945b-33b3ac7963f7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:19.786591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7466874-63cd-4890-945b-33b3ac7963f7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:19.921118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f7466874-63cd-4890-945b-33b3ac7963f7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:19.933433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f7466874-63cd-4890-945b-33b3ac7963f7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.169171 Sep 13 20:14:19.934214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 836/1582] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:19 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:20.456824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d80d9f48-a213-4a53-bd40-601551485b31 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:20.460527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d80d9f48-a213-4a53-bd40-601551485b31 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:20.471999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d80d9f48-a213-4a53-bd40-601551485b31 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:20.472797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d80d9f48-a213-4a53-bd40-601551485b31 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:20.473532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d80d9f48-a213-4a53-bd40-601551485b31 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:20.474732 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d80d9f48-a213-4a53-bd40-601551485b31 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:20.475609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d80d9f48-a213-4a53-bd40-601551485b31 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:20.476045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d80d9f48-a213-4a53-bd40-601551485b31 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:20.507509 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d80d9f48-a213-4a53-bd40-601551485b31 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057407 Sep 13 20:14:20.508053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 747/1583] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:20.961342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c8116e70-52f6-40b0-9d23-77b61a79dd3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:20.962280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c8116e70-52f6-40b0-9d23-77b61a79dd3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:20.969314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8116e70-52f6-40b0-9d23-77b61a79dd3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:20.969787 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8116e70-52f6-40b0-9d23-77b61a79dd3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:20.970220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8116e70-52f6-40b0-9d23-77b61a79dd3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:20.970940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8116e70-52f6-40b0-9d23-77b61a79dd3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:20.971389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8116e70-52f6-40b0-9d23-77b61a79dd3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:20.971803 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8116e70-52f6-40b0-9d23-77b61a79dd3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:21.111235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c8116e70-52f6-40b0-9d23-77b61a79dd3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:21.113458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:21.121015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c8116e70-52f6-40b0-9d23-77b61a79dd3a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163712 Sep 13 20:14:21.121586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 837/1584] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:20 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:21.524243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-acea884f-1bd4-4eff-ad7e-69e237a63663 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:21.526474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-acea884f-1bd4-4eff-ad7e-69e237a63663 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:21.533504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-acea884f-1bd4-4eff-ad7e-69e237a63663 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:21.533991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-acea884f-1bd4-4eff-ad7e-69e237a63663 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:21.534460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-acea884f-1bd4-4eff-ad7e-69e237a63663 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:21.535159 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-acea884f-1bd4-4eff-ad7e-69e237a63663 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:21.535616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-acea884f-1bd4-4eff-ad7e-69e237a63663 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:21.536047 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-acea884f-1bd4-4eff-ad7e-69e237a63663 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:21.567281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-acea884f-1bd4-4eff-ad7e-69e237a63663 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048784 Sep 13 20:14:21.568131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 748/1585] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:21 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:22.148308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5ebfe9dd-78f4-400e-b2f5-9e8b873db0bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:22.149308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5ebfe9dd-78f4-400e-b2f5-9e8b873db0bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:22.160041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ebfe9dd-78f4-400e-b2f5-9e8b873db0bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:22.160844 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ebfe9dd-78f4-400e-b2f5-9e8b873db0bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:22.162271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ebfe9dd-78f4-400e-b2f5-9e8b873db0bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:22.162783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ebfe9dd-78f4-400e-b2f5-9e8b873db0bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:22.163459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ebfe9dd-78f4-400e-b2f5-9e8b873db0bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:22.163884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ebfe9dd-78f4-400e-b2f5-9e8b873db0bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:22.308126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5ebfe9dd-78f4-400e-b2f5-9e8b873db0bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:22.316816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5ebfe9dd-78f4-400e-b2f5-9e8b873db0bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.175608 Sep 13 20:14:22.317384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 838/1586] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:22 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:22.579771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f79c9c3d-218f-412e-925c-0d28b601c30a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:22.581975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f79c9c3d-218f-412e-925c-0d28b601c30a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:22.588941 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f79c9c3d-218f-412e-925c-0d28b601c30a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:22.589425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f79c9c3d-218f-412e-925c-0d28b601c30a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:22.589854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f79c9c3d-218f-412e-925c-0d28b601c30a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:22.590592 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f79c9c3d-218f-412e-925c-0d28b601c30a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:22.591127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f79c9c3d-218f-412e-925c-0d28b601c30a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:22.591452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f79c9c3d-218f-412e-925c-0d28b601c30a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:22.621724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f79c9c3d-218f-412e-925c-0d28b601c30a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045876 Sep 13 20:14:22.626341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 749/1587] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:23.346158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a0445b53-77d5-4c16-a69e-7de037ad3640 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:23.346765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a0445b53-77d5-4c16-a69e-7de037ad3640 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:23.354280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0445b53-77d5-4c16-a69e-7de037ad3640 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:23.354795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0445b53-77d5-4c16-a69e-7de037ad3640 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:23.355230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0445b53-77d5-4c16-a69e-7de037ad3640 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:23.355925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0445b53-77d5-4c16-a69e-7de037ad3640 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:23.356376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0445b53-77d5-4c16-a69e-7de037ad3640 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:23.356796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0445b53-77d5-4c16-a69e-7de037ad3640 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:23.493879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a0445b53-77d5-4c16-a69e-7de037ad3640 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:23.502718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a0445b53-77d5-4c16-a69e-7de037ad3640 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164259 Sep 13 20:14:23.503295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 839/1588] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:23 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:23.635647 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-438c336b-585a-4f6a-9060-c7e3a33fe71e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:23.637745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-438c336b-585a-4f6a-9060-c7e3a33fe71e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:23.645307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-438c336b-585a-4f6a-9060-c7e3a33fe71e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:23.645792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-438c336b-585a-4f6a-9060-c7e3a33fe71e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:23.646229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-438c336b-585a-4f6a-9060-c7e3a33fe71e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:23.646964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-438c336b-585a-4f6a-9060-c7e3a33fe71e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:23.647421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-438c336b-585a-4f6a-9060-c7e3a33fe71e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:23.647845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-438c336b-585a-4f6a-9060-c7e3a33fe71e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:23.686186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-438c336b-585a-4f6a-9060-c7e3a33fe71e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056644 Sep 13 20:14:23.686783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 750/1589] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:24.530181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d09017aa-2d75-4c8c-87fe-7b72fc2bfdaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:24.531182 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d09017aa-2d75-4c8c-87fe-7b72fc2bfdaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:24.542113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d09017aa-2d75-4c8c-87fe-7b72fc2bfdaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:24.542946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d09017aa-2d75-4c8c-87fe-7b72fc2bfdaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:24.543656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d09017aa-2d75-4c8c-87fe-7b72fc2bfdaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:24.544771 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d09017aa-2d75-4c8c-87fe-7b72fc2bfdaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:24.545506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d09017aa-2d75-4c8c-87fe-7b72fc2bfdaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:24.546187 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d09017aa-2d75-4c8c-87fe-7b72fc2bfdaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:24.681975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d09017aa-2d75-4c8c-87fe-7b72fc2bfdaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:24.690844 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d09017aa-2d75-4c8c-87fe-7b72fc2bfdaf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167212 Sep 13 20:14:24.691417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 840/1590] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:24 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:24.699100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4829b4aa-5724-4945-91b1-21ce5bcb9d13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:24.701258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4829b4aa-5724-4945-91b1-21ce5bcb9d13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:24.708374 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4829b4aa-5724-4945-91b1-21ce5bcb9d13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:24.709002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4829b4aa-5724-4945-91b1-21ce5bcb9d13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:24.709602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4829b4aa-5724-4945-91b1-21ce5bcb9d13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:24.710698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4829b4aa-5724-4945-91b1-21ce5bcb9d13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:24.711334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4829b4aa-5724-4945-91b1-21ce5bcb9d13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:24.712228 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4829b4aa-5724-4945-91b1-21ce5bcb9d13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:24.741843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4829b4aa-5724-4945-91b1-21ce5bcb9d13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046790 Sep 13 20:14:24.742379 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 751/1591] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:24 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:25.719482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-312890c9-a91d-4ce3-b6b8-af9805eb37ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:25.720538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-312890c9-a91d-4ce3-b6b8-af9805eb37ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:25.730051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-312890c9-a91d-4ce3-b6b8-af9805eb37ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:25.730571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-312890c9-a91d-4ce3-b6b8-af9805eb37ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:25.731003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-312890c9-a91d-4ce3-b6b8-af9805eb37ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:25.731697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-312890c9-a91d-4ce3-b6b8-af9805eb37ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:25.732148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-312890c9-a91d-4ce3-b6b8-af9805eb37ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:25.732567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-312890c9-a91d-4ce3-b6b8-af9805eb37ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:25.754656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8f960836-4d2c-4e1f-9bb4-8d490b9b051d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:25.756897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8f960836-4d2c-4e1f-9bb4-8d490b9b051d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:25.763644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f960836-4d2c-4e1f-9bb4-8d490b9b051d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:25.764121 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f960836-4d2c-4e1f-9bb4-8d490b9b051d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:25.764558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f960836-4d2c-4e1f-9bb4-8d490b9b051d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:25.765248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f960836-4d2c-4e1f-9bb4-8d490b9b051d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:25.765700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f960836-4d2c-4e1f-9bb4-8d490b9b051d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:25.766121 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f960836-4d2c-4e1f-9bb4-8d490b9b051d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:25.796987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8f960836-4d2c-4e1f-9bb4-8d490b9b051d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046343 Sep 13 20:14:25.797842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 752/1592] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:25.865402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-312890c9-a91d-4ce3-b6b8-af9805eb37ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:25.873332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-312890c9-a91d-4ce3-b6b8-af9805eb37ac tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160365 Sep 13 20:14:25.873906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 841/1593] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:25 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:26.814334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b27f2f90-8c43-44ad-be33-a0c5a00ff571 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:26.817849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b27f2f90-8c43-44ad-be33-a0c5a00ff571 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:26.828944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b27f2f90-8c43-44ad-be33-a0c5a00ff571 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:26.829616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b27f2f90-8c43-44ad-be33-a0c5a00ff571 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:26.830391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b27f2f90-8c43-44ad-be33-a0c5a00ff571 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:26.831613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b27f2f90-8c43-44ad-be33-a0c5a00ff571 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:26.832362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b27f2f90-8c43-44ad-be33-a0c5a00ff571 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:26.833114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b27f2f90-8c43-44ad-be33-a0c5a00ff571 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:26.864918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b27f2f90-8c43-44ad-be33-a0c5a00ff571 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057683 Sep 13 20:14:26.865470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 753/1594] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:26.897536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-80efe35a-9876-415e-a5e4-c5cd0a34988c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:26.898137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-80efe35a-9876-415e-a5e4-c5cd0a34988c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:26.904796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80efe35a-9876-415e-a5e4-c5cd0a34988c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:26.905275 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80efe35a-9876-415e-a5e4-c5cd0a34988c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:26.905660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80efe35a-9876-415e-a5e4-c5cd0a34988c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:26.906346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80efe35a-9876-415e-a5e4-c5cd0a34988c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:26.906827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80efe35a-9876-415e-a5e4-c5cd0a34988c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:26.907228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80efe35a-9876-415e-a5e4-c5cd0a34988c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:27.205314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-80efe35a-9876-415e-a5e4-c5cd0a34988c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:27.216055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-80efe35a-9876-415e-a5e4-c5cd0a34988c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.322741 Sep 13 20:14:27.216613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 842/1595] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:26 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:27.881853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f6271162-d230-41ce-9725-c990230e524b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:27.884946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f6271162-d230-41ce-9725-c990230e524b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:27.887396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=58 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:27.893406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6271162-d230-41ce-9725-c990230e524b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:27.893913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6271162-d230-41ce-9725-c990230e524b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:27.894395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6271162-d230-41ce-9725-c990230e524b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:27.895134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6271162-d230-41ce-9725-c990230e524b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:27.895610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6271162-d230-41ce-9725-c990230e524b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:27.896056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6271162-d230-41ce-9725-c990230e524b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:27.926903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f6271162-d230-41ce-9725-c990230e524b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051703 Sep 13 20:14:27.927452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 754/1596] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:27 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:28.239383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-558503e8-1246-43c4-80f0-83aceec56eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:28.239977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-558503e8-1246-43c4-80f0-83aceec56eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:28.242271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:28.247697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-558503e8-1246-43c4-80f0-83aceec56eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:28.248160 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-558503e8-1246-43c4-80f0-83aceec56eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:28.248580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-558503e8-1246-43c4-80f0-83aceec56eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:28.249261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-558503e8-1246-43c4-80f0-83aceec56eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:28.249690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-558503e8-1246-43c4-80f0-83aceec56eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:28.250111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-558503e8-1246-43c4-80f0-83aceec56eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:28.388089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-558503e8-1246-43c4-80f0-83aceec56eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:28.396485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-558503e8-1246-43c4-80f0-83aceec56eb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160999 Sep 13 20:14:28.397039 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 843/1597] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:28 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:28.944370 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c8dca5b5-e7bc-443c-b2c8-6e9db1e1aa4c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:28.947290 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c8dca5b5-e7bc-443c-b2c8-6e9db1e1aa4c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:28.954575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8dca5b5-e7bc-443c-b2c8-6e9db1e1aa4c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:28.955115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8dca5b5-e7bc-443c-b2c8-6e9db1e1aa4c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:28.955575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8dca5b5-e7bc-443c-b2c8-6e9db1e1aa4c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:28.956309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8dca5b5-e7bc-443c-b2c8-6e9db1e1aa4c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:28.956787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8dca5b5-e7bc-443c-b2c8-6e9db1e1aa4c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:28.957233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8dca5b5-e7bc-443c-b2c8-6e9db1e1aa4c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:28.988656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c8dca5b5-e7bc-443c-b2c8-6e9db1e1aa4c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051285 Sep 13 20:14:28.989897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 755/1598] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:29.420354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e97fd79b-dcef-4c6d-88e7-1d398d8080a4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:29.420936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e97fd79b-dcef-4c6d-88e7-1d398d8080a4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:29.427727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e97fd79b-dcef-4c6d-88e7-1d398d8080a4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:29.428207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e97fd79b-dcef-4c6d-88e7-1d398d8080a4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:29.428635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e97fd79b-dcef-4c6d-88e7-1d398d8080a4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:29.429396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e97fd79b-dcef-4c6d-88e7-1d398d8080a4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:29.429742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e97fd79b-dcef-4c6d-88e7-1d398d8080a4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:29.430224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e97fd79b-dcef-4c6d-88e7-1d398d8080a4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:29.569223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e97fd79b-dcef-4c6d-88e7-1d398d8080a4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:29.578107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e97fd79b-dcef-4c6d-88e7-1d398d8080a4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.161720 Sep 13 20:14:29.578712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 844/1599] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:29 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:30.005993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ba3fd2d4-c16f-4ee6-938d-7075bf24c61a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:30.009601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ba3fd2d4-c16f-4ee6-938d-7075bf24c61a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:30.019726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba3fd2d4-c16f-4ee6-938d-7075bf24c61a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:30.020555 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba3fd2d4-c16f-4ee6-938d-7075bf24c61a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:30.021282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba3fd2d4-c16f-4ee6-938d-7075bf24c61a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:30.022441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba3fd2d4-c16f-4ee6-938d-7075bf24c61a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:30.023207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba3fd2d4-c16f-4ee6-938d-7075bf24c61a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:30.023917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba3fd2d4-c16f-4ee6-938d-7075bf24c61a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:30.055494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ba3fd2d4-c16f-4ee6-938d-7075bf24c61a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056373 Sep 13 20:14:30.056056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 756/1600] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:30.602806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a1078691-26bf-431a-a481-461d13287cbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:30.603448 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a1078691-26bf-431a-a481-461d13287cbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:30.610355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1078691-26bf-431a-a481-461d13287cbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:30.610892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1078691-26bf-431a-a481-461d13287cbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:30.611292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1078691-26bf-431a-a481-461d13287cbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:30.612006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1078691-26bf-431a-a481-461d13287cbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:30.612449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1078691-26bf-431a-a481-461d13287cbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:30.612861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1078691-26bf-431a-a481-461d13287cbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:30.743659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a1078691-26bf-431a-a481-461d13287cbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:30.752352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a1078691-26bf-431a-a481-461d13287cbf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.153818 Sep 13 20:14:30.752932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 845/1601] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:30 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:31.067733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5f08562e-b1f5-4335-a42e-0bff58b1ab12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:31.070001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5f08562e-b1f5-4335-a42e-0bff58b1ab12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:31.076983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f08562e-b1f5-4335-a42e-0bff58b1ab12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:31.077465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f08562e-b1f5-4335-a42e-0bff58b1ab12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:31.077929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f08562e-b1f5-4335-a42e-0bff58b1ab12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:31.078665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f08562e-b1f5-4335-a42e-0bff58b1ab12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:31.079092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f08562e-b1f5-4335-a42e-0bff58b1ab12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:31.079514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f08562e-b1f5-4335-a42e-0bff58b1ab12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:31.110165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5f08562e-b1f5-4335-a42e-0bff58b1ab12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046434 Sep 13 20:14:31.110765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 757/1602] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:31 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:31.780260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-81278341-3eb9-4c5d-af12-1e85141a3fda tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:31.781239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-81278341-3eb9-4c5d-af12-1e85141a3fda tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:31.791633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-81278341-3eb9-4c5d-af12-1e85141a3fda tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:31.792125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-81278341-3eb9-4c5d-af12-1e85141a3fda tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:31.792555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-81278341-3eb9-4c5d-af12-1e85141a3fda tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:31.793239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-81278341-3eb9-4c5d-af12-1e85141a3fda tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:31.793687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-81278341-3eb9-4c5d-af12-1e85141a3fda tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:31.794107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-81278341-3eb9-4c5d-af12-1e85141a3fda tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:31.923172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-81278341-3eb9-4c5d-af12-1e85141a3fda tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:31.931960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-81278341-3eb9-4c5d-af12-1e85141a3fda tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158471 Sep 13 20:14:31.932520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 846/1603] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:31 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:32.127151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ba146907-9673-4460-8244-3590cdadadf0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:32.130558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ba146907-9673-4460-8244-3590cdadadf0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:32.141536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba146907-9673-4460-8244-3590cdadadf0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:32.142319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba146907-9673-4460-8244-3590cdadadf0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:32.143081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba146907-9673-4460-8244-3590cdadadf0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:32.144204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba146907-9673-4460-8244-3590cdadadf0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:32.144945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba146907-9673-4460-8244-3590cdadadf0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:32.145644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba146907-9673-4460-8244-3590cdadadf0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:32.177439 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ba146907-9673-4460-8244-3590cdadadf0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056976 Sep 13 20:14:32.177845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 758/1604] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:32 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:32.959596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0604f370-9ac9-471a-87aa-f7cec08e285a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:32.960479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0604f370-9ac9-471a-87aa-f7cec08e285a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:32.968240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0604f370-9ac9-471a-87aa-f7cec08e285a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:32.968711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0604f370-9ac9-471a-87aa-f7cec08e285a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:32.969130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0604f370-9ac9-471a-87aa-f7cec08e285a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:32.969807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0604f370-9ac9-471a-87aa-f7cec08e285a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:32.970246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0604f370-9ac9-471a-87aa-f7cec08e285a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:32.970764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0604f370-9ac9-471a-87aa-f7cec08e285a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:33.107798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0604f370-9ac9-471a-87aa-f7cec08e285a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:33.119068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0604f370-9ac9-471a-87aa-f7cec08e285a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165731 Sep 13 20:14:33.119956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 847/1605] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:32 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:33.194660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2756e85d-e1a1-4f55-97f3-5c5fab7bca98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:33.197588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2756e85d-e1a1-4f55-97f3-5c5fab7bca98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:33.204264 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2756e85d-e1a1-4f55-97f3-5c5fab7bca98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:33.204742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2756e85d-e1a1-4f55-97f3-5c5fab7bca98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:33.205181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2756e85d-e1a1-4f55-97f3-5c5fab7bca98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:33.205871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2756e85d-e1a1-4f55-97f3-5c5fab7bca98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:33.206322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2756e85d-e1a1-4f55-97f3-5c5fab7bca98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:33.206783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2756e85d-e1a1-4f55-97f3-5c5fab7bca98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:33.236983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2756e85d-e1a1-4f55-97f3-5c5fab7bca98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049193 Sep 13 20:14:33.237537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 759/1606] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:33 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:34.147438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4d51af96-635b-43b4-874f-7e2d7b512ee2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:34.148459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4d51af96-635b-43b4-874f-7e2d7b512ee2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:34.159882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d51af96-635b-43b4-874f-7e2d7b512ee2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:34.160667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d51af96-635b-43b4-874f-7e2d7b512ee2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:34.162158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d51af96-635b-43b4-874f-7e2d7b512ee2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:34.163485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d51af96-635b-43b4-874f-7e2d7b512ee2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:34.164231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d51af96-635b-43b4-874f-7e2d7b512ee2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:34.164954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d51af96-635b-43b4-874f-7e2d7b512ee2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:34.249756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dbf3d5c6-689d-48f5-abdd-8fbf253fd78e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:34.252031 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dbf3d5c6-689d-48f5-abdd-8fbf253fd78e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:34.258635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbf3d5c6-689d-48f5-abdd-8fbf253fd78e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:34.259120 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbf3d5c6-689d-48f5-abdd-8fbf253fd78e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:34.259550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbf3d5c6-689d-48f5-abdd-8fbf253fd78e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:34.260249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbf3d5c6-689d-48f5-abdd-8fbf253fd78e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:34.260690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbf3d5c6-689d-48f5-abdd-8fbf253fd78e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:34.261109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbf3d5c6-689d-48f5-abdd-8fbf253fd78e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:34.274974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:34.292244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dbf3d5c6-689d-48f5-abdd-8fbf253fd78e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046616 Sep 13 20:14:34.292809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 760/1607] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:34 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:34.294514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4d51af96-635b-43b4-874f-7e2d7b512ee2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:34.303373 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4d51af96-635b-43b4-874f-7e2d7b512ee2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163010 Sep 13 20:14:34.303928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 848/1608] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:34 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:35.308051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-82ec937c-d7c4-4d06-8537-edb083558a42 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:35.310397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-82ec937c-d7c4-4d06-8537-edb083558a42 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:35.317504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82ec937c-d7c4-4d06-8537-edb083558a42 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:35.318012 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82ec937c-d7c4-4d06-8537-edb083558a42 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:35.318501 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82ec937c-d7c4-4d06-8537-edb083558a42 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:35.319237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82ec937c-d7c4-4d06-8537-edb083558a42 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:35.319712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82ec937c-d7c4-4d06-8537-edb083558a42 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:35.320178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-82ec937c-d7c4-4d06-8537-edb083558a42 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:35.326817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-75969a93-796e-45f6-9d99-724cf107ef10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:35.327479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-75969a93-796e-45f6-9d99-724cf107ef10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:35.337786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75969a93-796e-45f6-9d99-724cf107ef10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:35.338322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75969a93-796e-45f6-9d99-724cf107ef10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:35.338779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75969a93-796e-45f6-9d99-724cf107ef10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:35.339483 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75969a93-796e-45f6-9d99-724cf107ef10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:35.339916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75969a93-796e-45f6-9d99-724cf107ef10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:35.340350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75969a93-796e-45f6-9d99-724cf107ef10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:35.352774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-82ec937c-d7c4-4d06-8537-edb083558a42 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050368 Sep 13 20:14:35.353632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 761/1609] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:35 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:35.423209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9ad53a63-a574-4ad1-ab95-6b6c3cebfa65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:35.423710 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9ad53a63-a574-4ad1-ab95-6b6c3cebfa65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:35.429726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ad53a63-a574-4ad1-ab95-6b6c3cebfa65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:35.430207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ad53a63-a574-4ad1-ab95-6b6c3cebfa65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:35.430723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ad53a63-a574-4ad1-ab95-6b6c3cebfa65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:35.431421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ad53a63-a574-4ad1-ab95-6b6c3cebfa65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:35.431870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ad53a63-a574-4ad1-ab95-6b6c3cebfa65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:35.432286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ad53a63-a574-4ad1-ab95-6b6c3cebfa65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:35.458061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9ad53a63-a574-4ad1-ab95-6b6c3cebfa65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Going to try to terminate instance {{(pid=120845) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:14:35.505026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-75969a93-796e-45f6-9d99-724cf107ef10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:35.513782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-75969a93-796e-45f6-9d99-724cf107ef10 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.191153 Sep 13 20:14:35.514623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 849/1610] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:35 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:35.548114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9ad53a63-a574-4ad1-ab95-6b6c3cebfa65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 204 len: 0 microversion: 2.1 time: 0.128327 Sep 13 20:14:35.549151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 762/1611] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:14:35 2022] DELETE /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:14:35.557760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cdcd3af1-848f-4347-9923-ae45420214b2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:35.558398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cdcd3af1-848f-4347-9923-ae45420214b2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:35.564358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cdcd3af1-848f-4347-9923-ae45420214b2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:35.564824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cdcd3af1-848f-4347-9923-ae45420214b2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:35.565248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cdcd3af1-848f-4347-9923-ae45420214b2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:35.566132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cdcd3af1-848f-4347-9923-ae45420214b2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:35.566612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cdcd3af1-848f-4347-9923-ae45420214b2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:35.567029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cdcd3af1-848f-4347-9923-ae45420214b2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:35.693977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cdcd3af1-848f-4347-9923-ae45420214b2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:35.703063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cdcd3af1-848f-4347-9923-ae45420214b2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.149520 Sep 13 20:14:35.703633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 850/1612] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:35 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:36.371192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c92e0471-e8d1-4d62-947d-518b682681c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:36.374919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c92e0471-e8d1-4d62-947d-518b682681c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:36.385416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c92e0471-e8d1-4d62-947d-518b682681c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:36.385904 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c92e0471-e8d1-4d62-947d-518b682681c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:36.386339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c92e0471-e8d1-4d62-947d-518b682681c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:36.387070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c92e0471-e8d1-4d62-947d-518b682681c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:36.387525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c92e0471-e8d1-4d62-947d-518b682681c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:36.387949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c92e0471-e8d1-4d62-947d-518b682681c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:36.418602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c92e0471-e8d1-4d62-947d-518b682681c2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055226 Sep 13 20:14:36.419156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 763/1613] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:36 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:36.541130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a4768650-90fb-485c-88ec-d162a5ec170c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:36.541932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a4768650-90fb-485c-88ec-d162a5ec170c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:36.552020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a4768650-90fb-485c-88ec-d162a5ec170c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:36.552686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a4768650-90fb-485c-88ec-d162a5ec170c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:36.553322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a4768650-90fb-485c-88ec-d162a5ec170c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:36.554435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a4768650-90fb-485c-88ec-d162a5ec170c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:36.555109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a4768650-90fb-485c-88ec-d162a5ec170c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:36.555900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a4768650-90fb-485c-88ec-d162a5ec170c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:36.686850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a4768650-90fb-485c-88ec-d162a5ec170c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:36.699606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a4768650-90fb-485c-88ec-d162a5ec170c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.164864 Sep 13 20:14:36.700359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 851/1614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:36 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:36.726237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5d982f30-0cf7-4c27-aa66-7d81740122d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:36.726905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5d982f30-0cf7-4c27-aa66-7d81740122d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:36.733573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d982f30-0cf7-4c27-aa66-7d81740122d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:36.734060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d982f30-0cf7-4c27-aa66-7d81740122d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:36.734535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d982f30-0cf7-4c27-aa66-7d81740122d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:36.735249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d982f30-0cf7-4c27-aa66-7d81740122d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:36.735675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d982f30-0cf7-4c27-aa66-7d81740122d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:36.736096 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d982f30-0cf7-4c27-aa66-7d81740122d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:36.915986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5d982f30-0cf7-4c27-aa66-7d81740122d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:36.924513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5d982f30-0cf7-4c27-aa66-7d81740122d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.202297 Sep 13 20:14:36.925075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 764/1615] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:36 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:37.434654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2573724c-90a0-4401-8d68-10d0fc7dade9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:37.436964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2573724c-90a0-4401-8d68-10d0fc7dade9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:37.443395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2573724c-90a0-4401-8d68-10d0fc7dade9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:37.443871 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2573724c-90a0-4401-8d68-10d0fc7dade9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:37.444294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2573724c-90a0-4401-8d68-10d0fc7dade9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:37.444983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2573724c-90a0-4401-8d68-10d0fc7dade9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:37.445429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2573724c-90a0-4401-8d68-10d0fc7dade9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:37.445850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2573724c-90a0-4401-8d68-10d0fc7dade9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:37.475839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2573724c-90a0-4401-8d68-10d0fc7dade9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047017 Sep 13 20:14:37.476376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 852/1616] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:37 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:37.724243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6a8c47da-d208-4ac9-b737-2bdd686f6a9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:37.724893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6a8c47da-d208-4ac9-b737-2bdd686f6a9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:37.731983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a8c47da-d208-4ac9-b737-2bdd686f6a9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:37.732472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a8c47da-d208-4ac9-b737-2bdd686f6a9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:37.732912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a8c47da-d208-4ac9-b737-2bdd686f6a9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:37.733608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a8c47da-d208-4ac9-b737-2bdd686f6a9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:37.734061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a8c47da-d208-4ac9-b737-2bdd686f6a9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:37.734522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a8c47da-d208-4ac9-b737-2bdd686f6a9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:37.878406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6a8c47da-d208-4ac9-b737-2bdd686f6a9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:37.887583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6a8c47da-d208-4ac9-b737-2bdd686f6a9e tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167289 Sep 13 20:14:37.888169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 765/1617] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:37 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:37.948105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b1edc4c1-6f76-47de-8ef2-ceaece0aa6c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:37.948709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b1edc4c1-6f76-47de-8ef2-ceaece0aa6c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:37.955213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1edc4c1-6f76-47de-8ef2-ceaece0aa6c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:37.955660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1edc4c1-6f76-47de-8ef2-ceaece0aa6c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:37.956097 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1edc4c1-6f76-47de-8ef2-ceaece0aa6c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:37.956752 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1edc4c1-6f76-47de-8ef2-ceaece0aa6c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:37.957213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1edc4c1-6f76-47de-8ef2-ceaece0aa6c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:37.957623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1edc4c1-6f76-47de-8ef2-ceaece0aa6c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:38.094520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b1edc4c1-6f76-47de-8ef2-ceaece0aa6c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:38.103086 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b1edc4c1-6f76-47de-8ef2-ceaece0aa6c4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158862 Sep 13 20:14:38.103649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 853/1618] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:37 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:38.493494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-48bf2572-1e82-4410-999a-6163495ed55b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:38.498640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-48bf2572-1e82-4410-999a-6163495ed55b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:38.509008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48bf2572-1e82-4410-999a-6163495ed55b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:38.510409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48bf2572-1e82-4410-999a-6163495ed55b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:38.511167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48bf2572-1e82-4410-999a-6163495ed55b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:38.511866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48bf2572-1e82-4410-999a-6163495ed55b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:38.512316 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48bf2572-1e82-4410-999a-6163495ed55b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:38.512742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48bf2572-1e82-4410-999a-6163495ed55b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:38.543082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-48bf2572-1e82-4410-999a-6163495ed55b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056374 Sep 13 20:14:38.543832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 766/1619] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:38 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:38.917264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1f34b638-d0ed-4041-9cda-f1be0b52bda3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:38.918128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1f34b638-d0ed-4041-9cda-f1be0b52bda3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:38.928530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f34b638-d0ed-4041-9cda-f1be0b52bda3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:38.929340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f34b638-d0ed-4041-9cda-f1be0b52bda3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:38.930108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f34b638-d0ed-4041-9cda-f1be0b52bda3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:38.931331 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f34b638-d0ed-4041-9cda-f1be0b52bda3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:38.932077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f34b638-d0ed-4041-9cda-f1be0b52bda3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:38.932877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f34b638-d0ed-4041-9cda-f1be0b52bda3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:38.948105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:39.073900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1f34b638-d0ed-4041-9cda-f1be0b52bda3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:39.082661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1f34b638-d0ed-4041-9cda-f1be0b52bda3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.171971 Sep 13 20:14:39.083227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 854/1620] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:38 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:39.129793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6f334678-0f2c-4f9c-ae93-128eaaffb926 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:39.130841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6f334678-0f2c-4f9c-ae93-128eaaffb926 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:39.139547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f334678-0f2c-4f9c-ae93-128eaaffb926 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:39.140026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f334678-0f2c-4f9c-ae93-128eaaffb926 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:39.140461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f334678-0f2c-4f9c-ae93-128eaaffb926 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:39.141149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f334678-0f2c-4f9c-ae93-128eaaffb926 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:39.141604 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f334678-0f2c-4f9c-ae93-128eaaffb926 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:39.142028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f334678-0f2c-4f9c-ae93-128eaaffb926 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:39.278996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6f334678-0f2c-4f9c-ae93-128eaaffb926 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:39.288075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6f334678-0f2c-4f9c-ae93-128eaaffb926 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164940 Sep 13 20:14:39.288657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 767/1621] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:39 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:39.559786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3a6ce6fa-ce9e-4631-aeb1-a8184e746412 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:39.561894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3a6ce6fa-ce9e-4631-aeb1-a8184e746412 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:39.568379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3a6ce6fa-ce9e-4631-aeb1-a8184e746412 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:39.568864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3a6ce6fa-ce9e-4631-aeb1-a8184e746412 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:39.569296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3a6ce6fa-ce9e-4631-aeb1-a8184e746412 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:39.569995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3a6ce6fa-ce9e-4631-aeb1-a8184e746412 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:39.570474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3a6ce6fa-ce9e-4631-aeb1-a8184e746412 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:39.570894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3a6ce6fa-ce9e-4631-aeb1-a8184e746412 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:39.604651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3a6ce6fa-ce9e-4631-aeb1-a8184e746412 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050894 Sep 13 20:14:39.605206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 855/1622] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:39 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:40.106701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-556a61c0-47cb-4c49-a6f8-24400933d067 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:40.107313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-556a61c0-47cb-4c49-a6f8-24400933d067 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:40.113492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-556a61c0-47cb-4c49-a6f8-24400933d067 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:40.113968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-556a61c0-47cb-4c49-a6f8-24400933d067 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:40.114417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-556a61c0-47cb-4c49-a6f8-24400933d067 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:40.115109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-556a61c0-47cb-4c49-a6f8-24400933d067 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:40.115567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-556a61c0-47cb-4c49-a6f8-24400933d067 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:40.115987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-556a61c0-47cb-4c49-a6f8-24400933d067 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:40.248252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-556a61c0-47cb-4c49-a6f8-24400933d067 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:40.256880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-556a61c0-47cb-4c49-a6f8-24400933d067 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.154105 Sep 13 20:14:40.257455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 768/1623] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:40 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:40.324998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2f6ad985-c864-40c6-95be-21f797240af9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:40.325938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2f6ad985-c864-40c6-95be-21f797240af9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:40.337111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f6ad985-c864-40c6-95be-21f797240af9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:40.337931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f6ad985-c864-40c6-95be-21f797240af9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:40.338723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f6ad985-c864-40c6-95be-21f797240af9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:40.339638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f6ad985-c864-40c6-95be-21f797240af9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:40.340089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f6ad985-c864-40c6-95be-21f797240af9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:40.340508 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f6ad985-c864-40c6-95be-21f797240af9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:40.477098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2f6ad985-c864-40c6-95be-21f797240af9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:40.489489 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2f6ad985-c864-40c6-95be-21f797240af9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.170878 Sep 13 20:14:40.490163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 856/1624] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:40 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:40.621264 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fe96e9d0-53ef-4686-a1c9-476a64f22fe5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:40.624801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fe96e9d0-53ef-4686-a1c9-476a64f22fe5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:40.643736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fe96e9d0-53ef-4686-a1c9-476a64f22fe5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:40.644227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fe96e9d0-53ef-4686-a1c9-476a64f22fe5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:40.644662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fe96e9d0-53ef-4686-a1c9-476a64f22fe5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:40.645372 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fe96e9d0-53ef-4686-a1c9-476a64f22fe5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:40.645834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fe96e9d0-53ef-4686-a1c9-476a64f22fe5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:40.646261 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fe96e9d0-53ef-4686-a1c9-476a64f22fe5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:40.677645 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fe96e9d0-53ef-4686-a1c9-476a64f22fe5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063291 Sep 13 20:14:40.678167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 769/1625] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:40 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:41.283955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3c069791-c51f-43f5-95e7-16852600e27b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:41.284945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3c069791-c51f-43f5-95e7-16852600e27b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:41.294260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c069791-c51f-43f5-95e7-16852600e27b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:41.294757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c069791-c51f-43f5-95e7-16852600e27b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:41.295182 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c069791-c51f-43f5-95e7-16852600e27b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:41.295858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c069791-c51f-43f5-95e7-16852600e27b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:41.296299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c069791-c51f-43f5-95e7-16852600e27b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:41.296708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c069791-c51f-43f5-95e7-16852600e27b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:41.433821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3c069791-c51f-43f5-95e7-16852600e27b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:41.442441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3c069791-c51f-43f5-95e7-16852600e27b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165030 Sep 13 20:14:41.443014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 857/1626] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:41 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:41.514804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-86ae28fb-05b1-410a-8a2f-0253af80e8ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:41.515417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-86ae28fb-05b1-410a-8a2f-0253af80e8ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:41.522300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-86ae28fb-05b1-410a-8a2f-0253af80e8ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:41.522830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-86ae28fb-05b1-410a-8a2f-0253af80e8ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:41.523266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-86ae28fb-05b1-410a-8a2f-0253af80e8ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:41.523955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-86ae28fb-05b1-410a-8a2f-0253af80e8ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:41.524427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-86ae28fb-05b1-410a-8a2f-0253af80e8ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:41.524809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-86ae28fb-05b1-410a-8a2f-0253af80e8ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:41.655857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-86ae28fb-05b1-410a-8a2f-0253af80e8ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:41.664641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-86ae28fb-05b1-410a-8a2f-0253af80e8ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.153823 Sep 13 20:14:41.665145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 770/1627] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:41 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:41.693334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-95c402bc-18ff-4dbe-89ee-159afbce8265 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:41.696698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-95c402bc-18ff-4dbe-89ee-159afbce8265 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:41.704686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95c402bc-18ff-4dbe-89ee-159afbce8265 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:41.705170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95c402bc-18ff-4dbe-89ee-159afbce8265 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:41.705603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95c402bc-18ff-4dbe-89ee-159afbce8265 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:41.706293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95c402bc-18ff-4dbe-89ee-159afbce8265 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:41.706792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95c402bc-18ff-4dbe-89ee-159afbce8265 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:41.707239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95c402bc-18ff-4dbe-89ee-159afbce8265 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:41.737712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-95c402bc-18ff-4dbe-89ee-159afbce8265 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050892 Sep 13 20:14:41.738242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 858/1628] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:41 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:14:42.470107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-de336e33-50cd-4288-bc46-c79338ef0321 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:42.471151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-de336e33-50cd-4288-bc46-c79338ef0321 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:42.481541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de336e33-50cd-4288-bc46-c79338ef0321 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:42.482338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de336e33-50cd-4288-bc46-c79338ef0321 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:42.483153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de336e33-50cd-4288-bc46-c79338ef0321 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:42.484332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de336e33-50cd-4288-bc46-c79338ef0321 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:42.485084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de336e33-50cd-4288-bc46-c79338ef0321 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:42.485988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de336e33-50cd-4288-bc46-c79338ef0321 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:42.620666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-de336e33-50cd-4288-bc46-c79338ef0321 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:42.629460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-de336e33-50cd-4288-bc46-c79338ef0321 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165929 Sep 13 20:14:42.630067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 771/1629] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:42 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:42.688487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-921e81b9-721c-4336-be8d-d592e6459481 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:42.689063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-921e81b9-721c-4336-be8d-d592e6459481 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:42.696159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-921e81b9-721c-4336-be8d-d592e6459481 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:42.696608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-921e81b9-721c-4336-be8d-d592e6459481 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:42.697072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-921e81b9-721c-4336-be8d-d592e6459481 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:42.697760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-921e81b9-721c-4336-be8d-d592e6459481 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:42.698205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-921e81b9-721c-4336-be8d-d592e6459481 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:42.698664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-921e81b9-721c-4336-be8d-d592e6459481 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:42.750151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8c4f259c-f7e2-42f4-a6f9-f5aa9756db1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:42.752295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8c4f259c-f7e2-42f4-a6f9-f5aa9756db1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:42.758473 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c4f259c-f7e2-42f4-a6f9-f5aa9756db1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:42.758955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c4f259c-f7e2-42f4-a6f9-f5aa9756db1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:42.759387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c4f259c-f7e2-42f4-a6f9-f5aa9756db1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:42.760148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c4f259c-f7e2-42f4-a6f9-f5aa9756db1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:42.760597 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c4f259c-f7e2-42f4-a6f9-f5aa9756db1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:42.761022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c4f259c-f7e2-42f4-a6f9-f5aa9756db1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:42.791922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8c4f259c-f7e2-42f4-a6f9-f5aa9756db1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045993 Sep 13 20:14:42.792780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 772/1630] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:42 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:14:42.832260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-921e81b9-721c-4336-be8d-d592e6459481 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:42.841324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-921e81b9-721c-4336-be8d-d592e6459481 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.156779 Sep 13 20:14:42.841978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 859/1631] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:42 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:43.657257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c331cdf9-9626-4ebb-bfaa-d07b207225e4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:43.658427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c331cdf9-9626-4ebb-bfaa-d07b207225e4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:43.668945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c331cdf9-9626-4ebb-bfaa-d07b207225e4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:43.669434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c331cdf9-9626-4ebb-bfaa-d07b207225e4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:43.669869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c331cdf9-9626-4ebb-bfaa-d07b207225e4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:43.670618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c331cdf9-9626-4ebb-bfaa-d07b207225e4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:43.671070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c331cdf9-9626-4ebb-bfaa-d07b207225e4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:43.671497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c331cdf9-9626-4ebb-bfaa-d07b207225e4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:43.804919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cdb41c11-03b6-4336-9fcf-0cf0bdb3138a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:43.805463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c331cdf9-9626-4ebb-bfaa-d07b207225e4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:43.807143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cdb41c11-03b6-4336-9fcf-0cf0bdb3138a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:43.813261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cdb41c11-03b6-4336-9fcf-0cf0bdb3138a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:43.813733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cdb41c11-03b6-4336-9fcf-0cf0bdb3138a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:43.813916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c331cdf9-9626-4ebb-bfaa-d07b207225e4 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163232 Sep 13 20:14:43.814157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cdb41c11-03b6-4336-9fcf-0cf0bdb3138a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:43.814319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 773/1632] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:43 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:43.814877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cdb41c11-03b6-4336-9fcf-0cf0bdb3138a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:43.815325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cdb41c11-03b6-4336-9fcf-0cf0bdb3138a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:43.815707 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cdb41c11-03b6-4336-9fcf-0cf0bdb3138a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:43.845257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cdb41c11-03b6-4336-9fcf-0cf0bdb3138a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Sep 13 20:14:43.845712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 860/1633] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:43 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:14:43.864954 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5368a440-5e11-47df-a769-ac31c506a62a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:43.865567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5368a440-5e11-47df-a769-ac31c506a62a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:43.871761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5368a440-5e11-47df-a769-ac31c506a62a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:43.872245 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5368a440-5e11-47df-a769-ac31c506a62a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:43.873236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5368a440-5e11-47df-a769-ac31c506a62a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:43.873424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5368a440-5e11-47df-a769-ac31c506a62a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:43.873875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5368a440-5e11-47df-a769-ac31c506a62a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:43.874297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5368a440-5e11-47df-a769-ac31c506a62a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:44.010784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5368a440-5e11-47df-a769-ac31c506a62a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:44.023514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5368a440-5e11-47df-a769-ac31c506a62a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.162195 Sep 13 20:14:44.024313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 774/1634] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:43 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:44.841348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-00536727-ed8b-4c8d-ab46-bcc4d5f765bb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:44.841956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-00536727-ed8b-4c8d-ab46-bcc4d5f765bb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:44.849364 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00536727-ed8b-4c8d-ab46-bcc4d5f765bb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:44.849889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00536727-ed8b-4c8d-ab46-bcc4d5f765bb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:44.850360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00536727-ed8b-4c8d-ab46-bcc4d5f765bb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:44.851152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00536727-ed8b-4c8d-ab46-bcc4d5f765bb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:44.851643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00536727-ed8b-4c8d-ab46-bcc4d5f765bb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:44.852101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00536727-ed8b-4c8d-ab46-bcc4d5f765bb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:44.858820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a58cbe66-0922-4ca6-aae0-019131097e11 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:44.861380 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a58cbe66-0922-4ca6-aae0-019131097e11 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:44.869185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a58cbe66-0922-4ca6-aae0-019131097e11 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:44.869729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a58cbe66-0922-4ca6-aae0-019131097e11 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:44.870217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a58cbe66-0922-4ca6-aae0-019131097e11 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:44.871138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a58cbe66-0922-4ca6-aae0-019131097e11 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:44.872547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a58cbe66-0922-4ca6-aae0-019131097e11 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:44.872980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a58cbe66-0922-4ca6-aae0-019131097e11 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:44.887531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:44.906772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a58cbe66-0922-4ca6-aae0-019131097e11 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052497 Sep 13 20:14:44.907333 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 775/1635] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:44 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:44.984945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-00536727-ed8b-4c8d-ab46-bcc4d5f765bb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:44.993591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-00536727-ed8b-4c8d-ab46-bcc4d5f765bb tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158898 Sep 13 20:14:44.994153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 861/1636] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:44 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:45.048288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-52ceb756-b0dd-40a2-94cd-4a28b3a4d047 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:45.048919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-52ceb756-b0dd-40a2-94cd-4a28b3a4d047 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:45.055560 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52ceb756-b0dd-40a2-94cd-4a28b3a4d047 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:45.056044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52ceb756-b0dd-40a2-94cd-4a28b3a4d047 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:45.056481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52ceb756-b0dd-40a2-94cd-4a28b3a4d047 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:45.057379 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52ceb756-b0dd-40a2-94cd-4a28b3a4d047 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:45.057602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52ceb756-b0dd-40a2-94cd-4a28b3a4d047 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:45.058049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52ceb756-b0dd-40a2-94cd-4a28b3a4d047 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:45.192337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-52ceb756-b0dd-40a2-94cd-4a28b3a4d047 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:45.201246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-52ceb756-b0dd-40a2-94cd-4a28b3a4d047 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.156849 Sep 13 20:14:45.201815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 776/1637] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:45 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:45.924248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-67bb84df-d5fa-497b-b01d-82c076503a3e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:45.928057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-67bb84df-d5fa-497b-b01d-82c076503a3e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:45.939120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67bb84df-d5fa-497b-b01d-82c076503a3e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:45.939914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67bb84df-d5fa-497b-b01d-82c076503a3e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:45.940675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67bb84df-d5fa-497b-b01d-82c076503a3e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:45.941815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67bb84df-d5fa-497b-b01d-82c076503a3e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:45.942600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67bb84df-d5fa-497b-b01d-82c076503a3e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:45.943302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67bb84df-d5fa-497b-b01d-82c076503a3e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:45.975801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-67bb84df-d5fa-497b-b01d-82c076503a3e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058881 Sep 13 20:14:45.976355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 862/1638] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:45 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:46.016815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-84169ead-791c-4684-ae5c-0a26aa4fb227 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:46.017373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-84169ead-791c-4684-ae5c-0a26aa4fb227 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:46.024209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84169ead-791c-4684-ae5c-0a26aa4fb227 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:46.024690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84169ead-791c-4684-ae5c-0a26aa4fb227 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:46.025361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84169ead-791c-4684-ae5c-0a26aa4fb227 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:46.026057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84169ead-791c-4684-ae5c-0a26aa4fb227 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:46.026615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84169ead-791c-4684-ae5c-0a26aa4fb227 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:46.027213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84169ead-791c-4684-ae5c-0a26aa4fb227 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:46.160496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-84169ead-791c-4684-ae5c-0a26aa4fb227 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:46.169408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-84169ead-791c-4684-ae5c-0a26aa4fb227 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156424 Sep 13 20:14:46.169971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 777/1639] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:46 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:46.224675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a0faa741-a8b6-45c8-bd62-71053aea7f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:46.225317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a0faa741-a8b6-45c8-bd62-71053aea7f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:46.231636 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0faa741-a8b6-45c8-bd62-71053aea7f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:46.232118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0faa741-a8b6-45c8-bd62-71053aea7f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:46.232546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0faa741-a8b6-45c8-bd62-71053aea7f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:46.233238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0faa741-a8b6-45c8-bd62-71053aea7f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:46.233688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0faa741-a8b6-45c8-bd62-71053aea7f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:46.234110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0faa741-a8b6-45c8-bd62-71053aea7f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:46.380316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a0faa741-a8b6-45c8-bd62-71053aea7f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:46.392807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a0faa741-a8b6-45c8-bd62-71053aea7f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.171831 Sep 13 20:14:46.393550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 863/1640] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:46 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:46.992944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ac5eae2a-6d32-4a77-b407-1757c656d9b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:46.996482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ac5eae2a-6d32-4a77-b407-1757c656d9b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:47.003331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ac5eae2a-6d32-4a77-b407-1757c656d9b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:47.003810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ac5eae2a-6d32-4a77-b407-1757c656d9b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:47.004238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ac5eae2a-6d32-4a77-b407-1757c656d9b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:47.004931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ac5eae2a-6d32-4a77-b407-1757c656d9b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:47.005375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ac5eae2a-6d32-4a77-b407-1757c656d9b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:47.005797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ac5eae2a-6d32-4a77-b407-1757c656d9b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:47.036903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ac5eae2a-6d32-4a77-b407-1757c656d9b4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050664 Sep 13 20:14:47.037624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 778/1641] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:46 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:47.201310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6404412d-fc68-4204-8e07-265bfb6648b3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:47.202318 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6404412d-fc68-4204-8e07-265bfb6648b3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:47.213568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6404412d-fc68-4204-8e07-265bfb6648b3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:47.214315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6404412d-fc68-4204-8e07-265bfb6648b3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:47.215100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6404412d-fc68-4204-8e07-265bfb6648b3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:47.216280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6404412d-fc68-4204-8e07-265bfb6648b3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:47.216731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6404412d-fc68-4204-8e07-265bfb6648b3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:47.217150 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6404412d-fc68-4204-8e07-265bfb6648b3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:47.358263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6404412d-fc68-4204-8e07-265bfb6648b3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:47.367121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6404412d-fc68-4204-8e07-265bfb6648b3 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.172448 Sep 13 20:14:47.367692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 864/1642] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:47 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:47.417783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-28ed673d-8d68-45e3-aa02-7268ef737ab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:47.418644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-28ed673d-8d68-45e3-aa02-7268ef737ab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:47.425174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28ed673d-8d68-45e3-aa02-7268ef737ab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:47.425649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28ed673d-8d68-45e3-aa02-7268ef737ab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:47.426077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28ed673d-8d68-45e3-aa02-7268ef737ab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:47.426793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28ed673d-8d68-45e3-aa02-7268ef737ab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:47.427234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28ed673d-8d68-45e3-aa02-7268ef737ab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:47.427651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-28ed673d-8d68-45e3-aa02-7268ef737ab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:47.565116 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-28ed673d-8d68-45e3-aa02-7268ef737ab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:47.574979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-28ed673d-8d68-45e3-aa02-7268ef737ab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.162004 Sep 13 20:14:47.575885 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 779/1643] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:47 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:48.053928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3b7ba531-d4e5-4c00-bcab-5cae8d86c1e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:48.057455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3b7ba531-d4e5-4c00-bcab-5cae8d86c1e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:48.067750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b7ba531-d4e5-4c00-bcab-5cae8d86c1e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:48.068549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b7ba531-d4e5-4c00-bcab-5cae8d86c1e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:48.069257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b7ba531-d4e5-4c00-bcab-5cae8d86c1e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:48.070426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b7ba531-d4e5-4c00-bcab-5cae8d86c1e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:48.071186 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b7ba531-d4e5-4c00-bcab-5cae8d86c1e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:48.071884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3b7ba531-d4e5-4c00-bcab-5cae8d86c1e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:48.103680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3b7ba531-d4e5-4c00-bcab-5cae8d86c1e0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056534 Sep 13 20:14:48.104519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 865/1644] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:48 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:48.390518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4670e081-f431-49bf-8dd2-848652a83b4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:48.391101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4670e081-f431-49bf-8dd2-848652a83b4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:48.397994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4670e081-f431-49bf-8dd2-848652a83b4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:48.398515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4670e081-f431-49bf-8dd2-848652a83b4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:48.398960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4670e081-f431-49bf-8dd2-848652a83b4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:48.399652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4670e081-f431-49bf-8dd2-848652a83b4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:48.400110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4670e081-f431-49bf-8dd2-848652a83b4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:48.400542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4670e081-f431-49bf-8dd2-848652a83b4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:48.546434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4670e081-f431-49bf-8dd2-848652a83b4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:48.560172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4670e081-f431-49bf-8dd2-848652a83b4b tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.173563 Sep 13 20:14:48.560773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 780/1645] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:48 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:48.599812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5c847d79-0403-47a4-a5e9-552e7aa94e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:48.600487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5c847d79-0403-47a4-a5e9-552e7aa94e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:48.607392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c847d79-0403-47a4-a5e9-552e7aa94e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:48.607947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c847d79-0403-47a4-a5e9-552e7aa94e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:48.608416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c847d79-0403-47a4-a5e9-552e7aa94e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:48.609112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c847d79-0403-47a4-a5e9-552e7aa94e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:48.609554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c847d79-0403-47a4-a5e9-552e7aa94e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:48.609961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c847d79-0403-47a4-a5e9-552e7aa94e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:48.740470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5c847d79-0403-47a4-a5e9-552e7aa94e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:48.749566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5c847d79-0403-47a4-a5e9-552e7aa94e65 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.153770 Sep 13 20:14:48.750136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 866/1646] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:48 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:49.116732 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-523289c5-829f-45ed-a421-2972ec19eb8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:49.118983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-523289c5-829f-45ed-a421-2972ec19eb8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:49.125704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-523289c5-829f-45ed-a421-2972ec19eb8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:49.126184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-523289c5-829f-45ed-a421-2972ec19eb8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:49.126658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-523289c5-829f-45ed-a421-2972ec19eb8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:49.127358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-523289c5-829f-45ed-a421-2972ec19eb8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:49.127810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-523289c5-829f-45ed-a421-2972ec19eb8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:49.128235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-523289c5-829f-45ed-a421-2972ec19eb8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:49.159613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-523289c5-829f-45ed-a421-2972ec19eb8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047012 Sep 13 20:14:49.160164 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 781/1647] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:49 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:49.584363 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9f9ab203-50ad-4f30-a6e5-87b4498bcb8d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:49.584977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9f9ab203-50ad-4f30-a6e5-87b4498bcb8d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:49.591837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f9ab203-50ad-4f30-a6e5-87b4498bcb8d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:49.592323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f9ab203-50ad-4f30-a6e5-87b4498bcb8d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:49.592760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f9ab203-50ad-4f30-a6e5-87b4498bcb8d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:49.593450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f9ab203-50ad-4f30-a6e5-87b4498bcb8d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:49.593897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f9ab203-50ad-4f30-a6e5-87b4498bcb8d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:49.594320 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f9ab203-50ad-4f30-a6e5-87b4498bcb8d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:49.727008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9f9ab203-50ad-4f30-a6e5-87b4498bcb8d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:49.735671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9f9ab203-50ad-4f30-a6e5-87b4498bcb8d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155379 Sep 13 20:14:49.736282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 867/1648] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:49 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:49.781413 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ae449f03-0ff1-4c0a-b5c6-5e9d1e91dd17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:49.782058 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ae449f03-0ff1-4c0a-b5c6-5e9d1e91dd17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:49.791745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae449f03-0ff1-4c0a-b5c6-5e9d1e91dd17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:49.792318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae449f03-0ff1-4c0a-b5c6-5e9d1e91dd17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:49.792873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae449f03-0ff1-4c0a-b5c6-5e9d1e91dd17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:49.793865 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae449f03-0ff1-4c0a-b5c6-5e9d1e91dd17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:49.794416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae449f03-0ff1-4c0a-b5c6-5e9d1e91dd17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:49.794863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae449f03-0ff1-4c0a-b5c6-5e9d1e91dd17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:49.935828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ae449f03-0ff1-4c0a-b5c6-5e9d1e91dd17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:49.944709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ae449f03-0ff1-4c0a-b5c6-5e9d1e91dd17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169505 Sep 13 20:14:49.945240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 782/1649] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:49 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:50.176403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e8a4bd09-cd02-4586-b24c-09cce9069b73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:50.179964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e8a4bd09-cd02-4586-b24c-09cce9069b73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:50.188088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8a4bd09-cd02-4586-b24c-09cce9069b73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:50.188491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8a4bd09-cd02-4586-b24c-09cce9069b73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:50.188911 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8a4bd09-cd02-4586-b24c-09cce9069b73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:50.189589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8a4bd09-cd02-4586-b24c-09cce9069b73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:50.190027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8a4bd09-cd02-4586-b24c-09cce9069b73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:50.190448 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e8a4bd09-cd02-4586-b24c-09cce9069b73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:50.220653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e8a4bd09-cd02-4586-b24c-09cce9069b73 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050927 Sep 13 20:14:50.221417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 868/1650] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:50 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:50.758817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d8630d93-0a52-4974-ae9c-5708eb9effd9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:50.759426 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d8630d93-0a52-4974-ae9c-5708eb9effd9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:50.765734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8630d93-0a52-4974-ae9c-5708eb9effd9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:50.766187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8630d93-0a52-4974-ae9c-5708eb9effd9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:50.769853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8630d93-0a52-4974-ae9c-5708eb9effd9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:50.769853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8630d93-0a52-4974-ae9c-5708eb9effd9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:50.769853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8630d93-0a52-4974-ae9c-5708eb9effd9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:50.769853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8630d93-0a52-4974-ae9c-5708eb9effd9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:50.913410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d8630d93-0a52-4974-ae9c-5708eb9effd9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:50.921956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d8630d93-0a52-4974-ae9c-5708eb9effd9 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167169 Sep 13 20:14:50.922564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 783/1651] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:50 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:50.968592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-43dfc690-0c69-4bb0-a70c-76c23f315071 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:50.969235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-43dfc690-0c69-4bb0-a70c-76c23f315071 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:50.975829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43dfc690-0c69-4bb0-a70c-76c23f315071 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:50.976301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43dfc690-0c69-4bb0-a70c-76c23f315071 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:50.976727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43dfc690-0c69-4bb0-a70c-76c23f315071 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:50.977409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43dfc690-0c69-4bb0-a70c-76c23f315071 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:50.977866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43dfc690-0c69-4bb0-a70c-76c23f315071 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:50.978284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43dfc690-0c69-4bb0-a70c-76c23f315071 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:51.114503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-43dfc690-0c69-4bb0-a70c-76c23f315071 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:51.123477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-43dfc690-0c69-4bb0-a70c-76c23f315071 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158792 Sep 13 20:14:51.124263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 869/1652] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:50 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:51.234088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2f057963-39e8-4bd5-8956-ab20c2193cf6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:51.236313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2f057963-39e8-4bd5-8956-ab20c2193cf6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:51.242852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2f057963-39e8-4bd5-8956-ab20c2193cf6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:51.243331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2f057963-39e8-4bd5-8956-ab20c2193cf6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:51.243767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2f057963-39e8-4bd5-8956-ab20c2193cf6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:51.244458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2f057963-39e8-4bd5-8956-ab20c2193cf6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:51.244904 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2f057963-39e8-4bd5-8956-ab20c2193cf6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:51.245329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2f057963-39e8-4bd5-8956-ab20c2193cf6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:51.283006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2f057963-39e8-4bd5-8956-ab20c2193cf6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052658 Sep 13 20:14:51.283713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 784/1653] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:51 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:51.949190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2646e87e-7691-4502-b892-b4b432cd7200 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:51.950291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2646e87e-7691-4502-b892-b4b432cd7200 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:51.957249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2646e87e-7691-4502-b892-b4b432cd7200 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:51.957734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2646e87e-7691-4502-b892-b4b432cd7200 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:51.958170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2646e87e-7691-4502-b892-b4b432cd7200 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:51.958901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2646e87e-7691-4502-b892-b4b432cd7200 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:51.959354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2646e87e-7691-4502-b892-b4b432cd7200 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:51.959780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2646e87e-7691-4502-b892-b4b432cd7200 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:52.091147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2646e87e-7691-4502-b892-b4b432cd7200 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:52.100250 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2646e87e-7691-4502-b892-b4b432cd7200 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.157761 Sep 13 20:14:52.100819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 870/1654] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:51 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:52.148621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-88f17d3e-d49c-44cb-ad7f-cd736bd17473 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:52.149229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-88f17d3e-d49c-44cb-ad7f-cd736bd17473 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:52.156152 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88f17d3e-d49c-44cb-ad7f-cd736bd17473 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:52.156595 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88f17d3e-d49c-44cb-ad7f-cd736bd17473 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:52.157038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88f17d3e-d49c-44cb-ad7f-cd736bd17473 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:52.157719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88f17d3e-d49c-44cb-ad7f-cd736bd17473 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:52.158163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88f17d3e-d49c-44cb-ad7f-cd736bd17473 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:52.158614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88f17d3e-d49c-44cb-ad7f-cd736bd17473 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:52.296523 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4f70330f-c2b5-4610-a12c-ef8b1f07fc32 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:52.298867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4f70330f-c2b5-4610-a12c-ef8b1f07fc32 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:52.304800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-88f17d3e-d49c-44cb-ad7f-cd736bd17473 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:52.305315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f70330f-c2b5-4610-a12c-ef8b1f07fc32 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:52.305803 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f70330f-c2b5-4610-a12c-ef8b1f07fc32 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:52.306235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f70330f-c2b5-4610-a12c-ef8b1f07fc32 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:52.306937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f70330f-c2b5-4610-a12c-ef8b1f07fc32 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:52.307391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f70330f-c2b5-4610-a12c-ef8b1f07fc32 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:52.307814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4f70330f-c2b5-4610-a12c-ef8b1f07fc32 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:52.312767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:52.313984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-88f17d3e-d49c-44cb-ad7f-cd736bd17473 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169526 Sep 13 20:14:52.314661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 785/1655] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:52 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:52.338128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4f70330f-c2b5-4610-a12c-ef8b1f07fc32 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045901 Sep 13 20:14:52.338769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 871/1656] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:52 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:53.128044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fb52ad69-7168-4452-ae12-3824069c4091 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:53.128925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fb52ad69-7168-4452-ae12-3824069c4091 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:53.139368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb52ad69-7168-4452-ae12-3824069c4091 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:53.140172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb52ad69-7168-4452-ae12-3824069c4091 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:53.140912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb52ad69-7168-4452-ae12-3824069c4091 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:53.142063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb52ad69-7168-4452-ae12-3824069c4091 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:53.142825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb52ad69-7168-4452-ae12-3824069c4091 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:53.143587 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb52ad69-7168-4452-ae12-3824069c4091 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:53.289152 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fb52ad69-7168-4452-ae12-3824069c4091 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:53.297718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fb52ad69-7168-4452-ae12-3824069c4091 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.176592 Sep 13 20:14:53.298310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 786/1657] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:53 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:53.337552 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e98fe50c-9ab8-4d7b-ba8b-d6ae032469f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:53.338272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e98fe50c-9ab8-4d7b-ba8b-d6ae032469f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:53.345209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e98fe50c-9ab8-4d7b-ba8b-d6ae032469f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:53.345686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e98fe50c-9ab8-4d7b-ba8b-d6ae032469f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:53.346115 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e98fe50c-9ab8-4d7b-ba8b-d6ae032469f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:53.346838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e98fe50c-9ab8-4d7b-ba8b-d6ae032469f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:53.347288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e98fe50c-9ab8-4d7b-ba8b-d6ae032469f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:53.347705 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e98fe50c-9ab8-4d7b-ba8b-d6ae032469f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:53.350833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c118a017-dc0e-43e2-9262-fec533a4d5c7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:53.352983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c118a017-dc0e-43e2-9262-fec533a4d5c7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:53.359551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c118a017-dc0e-43e2-9262-fec533a4d5c7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:53.360051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c118a017-dc0e-43e2-9262-fec533a4d5c7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:53.360482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c118a017-dc0e-43e2-9262-fec533a4d5c7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:53.361182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c118a017-dc0e-43e2-9262-fec533a4d5c7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:53.361635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c118a017-dc0e-43e2-9262-fec533a4d5c7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:53.362055 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c118a017-dc0e-43e2-9262-fec533a4d5c7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:53.392412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c118a017-dc0e-43e2-9262-fec533a4d5c7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045411 Sep 13 20:14:53.393117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 787/1658] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:53 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:53.483466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e98fe50c-9ab8-4d7b-ba8b-d6ae032469f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:53.492084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e98fe50c-9ab8-4d7b-ba8b-d6ae032469f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158750 Sep 13 20:14:53.492621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 872/1659] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:53 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:54.325103 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-054033d1-ba2f-45f7-9205-dcee5a64235c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:54.326084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-054033d1-ba2f-45f7-9205-dcee5a64235c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:54.334407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-054033d1-ba2f-45f7-9205-dcee5a64235c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:54.334996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-054033d1-ba2f-45f7-9205-dcee5a64235c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:54.335468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-054033d1-ba2f-45f7-9205-dcee5a64235c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:54.336294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-054033d1-ba2f-45f7-9205-dcee5a64235c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:54.337186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-054033d1-ba2f-45f7-9205-dcee5a64235c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:54.337675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-054033d1-ba2f-45f7-9205-dcee5a64235c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:54.407260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c1889ce7-35d3-4643-9a15-481d8db30030 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:54.409423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c1889ce7-35d3-4643-9a15-481d8db30030 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:54.416229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1889ce7-35d3-4643-9a15-481d8db30030 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:54.416711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1889ce7-35d3-4643-9a15-481d8db30030 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:54.417144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1889ce7-35d3-4643-9a15-481d8db30030 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:54.417836 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1889ce7-35d3-4643-9a15-481d8db30030 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:54.418285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1889ce7-35d3-4643-9a15-481d8db30030 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:54.418740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1889ce7-35d3-4643-9a15-481d8db30030 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:54.449391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c1889ce7-35d3-4643-9a15-481d8db30030 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047059 Sep 13 20:14:54.454254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 873/1660] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:54 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:54.479634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-054033d1-ba2f-45f7-9205-dcee5a64235c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:54.488254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-054033d1-ba2f-45f7-9205-dcee5a64235c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.169757 Sep 13 20:14:54.488833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 788/1661] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:54 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:54.526083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-389c20d8-94f8-4604-a777-834060f52bf8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:54.527025 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-389c20d8-94f8-4604-a777-834060f52bf8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:54.533809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-389c20d8-94f8-4604-a777-834060f52bf8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:54.534296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-389c20d8-94f8-4604-a777-834060f52bf8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:54.534776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-389c20d8-94f8-4604-a777-834060f52bf8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:54.535459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-389c20d8-94f8-4604-a777-834060f52bf8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:54.535903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-389c20d8-94f8-4604-a777-834060f52bf8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:54.536362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-389c20d8-94f8-4604-a777-834060f52bf8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:54.681371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-389c20d8-94f8-4604-a777-834060f52bf8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:54.690341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-389c20d8-94f8-4604-a777-834060f52bf8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.170811 Sep 13 20:14:54.690939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 874/1662] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:54 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:55.463467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-001c0d6c-a196-4593-a760-1c02080d1c99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:55.465858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-001c0d6c-a196-4593-a760-1c02080d1c99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:55.473300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-001c0d6c-a196-4593-a760-1c02080d1c99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:55.473788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-001c0d6c-a196-4593-a760-1c02080d1c99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:55.474230 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-001c0d6c-a196-4593-a760-1c02080d1c99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:55.474958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-001c0d6c-a196-4593-a760-1c02080d1c99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:55.475414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-001c0d6c-a196-4593-a760-1c02080d1c99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:55.475866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-001c0d6c-a196-4593-a760-1c02080d1c99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:55.505773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-001c0d6c-a196-4593-a760-1c02080d1c99 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047307 Sep 13 20:14:55.506315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 789/1663] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:55 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:55.511235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f434841e-4cdd-4ba4-9616-b9ef978b07fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:55.511865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f434841e-4cdd-4ba4-9616-b9ef978b07fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:55.518626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f434841e-4cdd-4ba4-9616-b9ef978b07fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:55.519210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f434841e-4cdd-4ba4-9616-b9ef978b07fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:55.519553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f434841e-4cdd-4ba4-9616-b9ef978b07fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:55.520241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f434841e-4cdd-4ba4-9616-b9ef978b07fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:55.520691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f434841e-4cdd-4ba4-9616-b9ef978b07fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:55.521108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f434841e-4cdd-4ba4-9616-b9ef978b07fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:55.657359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f434841e-4cdd-4ba4-9616-b9ef978b07fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:55.666021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f434841e-4cdd-4ba4-9616-b9ef978b07fa tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.159039 Sep 13 20:14:55.666608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 875/1664] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:55 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:55.721293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-50d8b7ef-24f6-45cd-9497-0776b56904ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:55.721889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-50d8b7ef-24f6-45cd-9497-0776b56904ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:55.728160 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50d8b7ef-24f6-45cd-9497-0776b56904ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:55.728641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50d8b7ef-24f6-45cd-9497-0776b56904ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:55.729081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50d8b7ef-24f6-45cd-9497-0776b56904ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:55.729772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50d8b7ef-24f6-45cd-9497-0776b56904ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:55.730201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50d8b7ef-24f6-45cd-9497-0776b56904ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:55.730673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-50d8b7ef-24f6-45cd-9497-0776b56904ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:55.860405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-50d8b7ef-24f6-45cd-9497-0776b56904ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:55.872804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-50d8b7ef-24f6-45cd-9497-0776b56904ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.155135 Sep 13 20:14:55.873466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 790/1665] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:55 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:56.520703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-10336fc7-ef55-4a2a-a249-51402973c3ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:56.523601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-10336fc7-ef55-4a2a-a249-51402973c3ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:56.532363 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10336fc7-ef55-4a2a-a249-51402973c3ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:56.532994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10336fc7-ef55-4a2a-a249-51402973c3ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:56.533566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10336fc7-ef55-4a2a-a249-51402973c3ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:56.534614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10336fc7-ef55-4a2a-a249-51402973c3ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:56.535248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10336fc7-ef55-4a2a-a249-51402973c3ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:56.535806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10336fc7-ef55-4a2a-a249-51402973c3ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:56.568544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-10336fc7-ef55-4a2a-a249-51402973c3ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053114 Sep 13 20:14:56.572937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 876/1666] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:56 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:56.693162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a09b5c60-c54d-490b-8ffd-f3f2e7e2e060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:56.694190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a09b5c60-c54d-490b-8ffd-f3f2e7e2e060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:56.705236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a09b5c60-c54d-490b-8ffd-f3f2e7e2e060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:56.706000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a09b5c60-c54d-490b-8ffd-f3f2e7e2e060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:56.706799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a09b5c60-c54d-490b-8ffd-f3f2e7e2e060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:56.707946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a09b5c60-c54d-490b-8ffd-f3f2e7e2e060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:56.708706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a09b5c60-c54d-490b-8ffd-f3f2e7e2e060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:56.709420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a09b5c60-c54d-490b-8ffd-f3f2e7e2e060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:56.845227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a09b5c60-c54d-490b-8ffd-f3f2e7e2e060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:56.854000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a09b5c60-c54d-490b-8ffd-f3f2e7e2e060 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.167442 Sep 13 20:14:56.854616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 791/1667] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:56 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:56.896396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5573d459-1703-4958-b03b-b06d14b61344 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:56.897001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5573d459-1703-4958-b03b-b06d14b61344 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:56.903093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5573d459-1703-4958-b03b-b06d14b61344 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:56.903566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5573d459-1703-4958-b03b-b06d14b61344 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:56.903992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5573d459-1703-4958-b03b-b06d14b61344 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:56.904731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5573d459-1703-4958-b03b-b06d14b61344 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:56.905174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5573d459-1703-4958-b03b-b06d14b61344 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:56.905586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5573d459-1703-4958-b03b-b06d14b61344 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:57.033615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5573d459-1703-4958-b03b-b06d14b61344 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:57.042168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5573d459-1703-4958-b03b-b06d14b61344 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.149628 Sep 13 20:14:57.042773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 877/1668] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:56 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:57.641456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-567dee5f-38b3-4858-9728-3f862bc24f82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:57.643725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-567dee5f-38b3-4858-9728-3f862bc24f82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:57.649781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-567dee5f-38b3-4858-9728-3f862bc24f82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:57.650266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-567dee5f-38b3-4858-9728-3f862bc24f82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:57.650824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-567dee5f-38b3-4858-9728-3f862bc24f82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:57.651402 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-567dee5f-38b3-4858-9728-3f862bc24f82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:57.651850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-567dee5f-38b3-4858-9728-3f862bc24f82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:57.652265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-567dee5f-38b3-4858-9728-3f862bc24f82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:57.654723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:57.682742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-567dee5f-38b3-4858-9728-3f862bc24f82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105744 Sep 13 20:14:57.683419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 792/1669] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:57 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:57.881195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1d6d2cc3-473e-410a-a021-0445fc83cc71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:57.882202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1d6d2cc3-473e-410a-a021-0445fc83cc71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:57.891923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d6d2cc3-473e-410a-a021-0445fc83cc71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:57.892397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d6d2cc3-473e-410a-a021-0445fc83cc71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:57.892828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d6d2cc3-473e-410a-a021-0445fc83cc71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:57.893502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d6d2cc3-473e-410a-a021-0445fc83cc71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:57.893934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d6d2cc3-473e-410a-a021-0445fc83cc71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:57.894341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d6d2cc3-473e-410a-a021-0445fc83cc71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:58.028251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1d6d2cc3-473e-410a-a021-0445fc83cc71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:58.040889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1d6d2cc3-473e-410a-a021-0445fc83cc71 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.165912 Sep 13 20:14:58.041723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 878/1670] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:57 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:58.065239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7892ec74-aa51-4e38-a14c-5d9a3d2dca5b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:58.065847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7892ec74-aa51-4e38-a14c-5d9a3d2dca5b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:58.068164 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:58.073674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7892ec74-aa51-4e38-a14c-5d9a3d2dca5b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:58.074147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7892ec74-aa51-4e38-a14c-5d9a3d2dca5b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:58.074615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7892ec74-aa51-4e38-a14c-5d9a3d2dca5b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:58.075295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7892ec74-aa51-4e38-a14c-5d9a3d2dca5b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:58.075735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7892ec74-aa51-4e38-a14c-5d9a3d2dca5b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:58.076136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7892ec74-aa51-4e38-a14c-5d9a3d2dca5b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:58.211482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7892ec74-aa51-4e38-a14c-5d9a3d2dca5b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:58.222127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7892ec74-aa51-4e38-a14c-5d9a3d2dca5b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.160636 Sep 13 20:14:58.222886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 793/1671] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:58 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:58.699349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b7bc0615-2701-45a8-bd6d-befe492b6a09 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:58.702764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b7bc0615-2701-45a8-bd6d-befe492b6a09 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:58.704688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=72 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:58.710122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7bc0615-2701-45a8-bd6d-befe492b6a09 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:58.710623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7bc0615-2701-45a8-bd6d-befe492b6a09 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:58.711071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7bc0615-2701-45a8-bd6d-befe492b6a09 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:58.712122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7bc0615-2701-45a8-bd6d-befe492b6a09 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:58.712576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7bc0615-2701-45a8-bd6d-befe492b6a09 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:58.713020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7bc0615-2701-45a8-bd6d-befe492b6a09 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:58.744075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b7bc0615-2701-45a8-bd6d-befe492b6a09 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051330 Sep 13 20:14:58.744652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 879/1672] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:58 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:14:59.069046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1004d373-5982-4ef6-81ac-c6b4a8fee35c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:59.070085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1004d373-5982-4ef6-81ac-c6b4a8fee35c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:59.081133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1004d373-5982-4ef6-81ac-c6b4a8fee35c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:59.081970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1004d373-5982-4ef6-81ac-c6b4a8fee35c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:59.082757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1004d373-5982-4ef6-81ac-c6b4a8fee35c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:59.083907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1004d373-5982-4ef6-81ac-c6b4a8fee35c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:59.084657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1004d373-5982-4ef6-81ac-c6b4a8fee35c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:59.085355 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1004d373-5982-4ef6-81ac-c6b4a8fee35c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:59.220278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1004d373-5982-4ef6-81ac-c6b4a8fee35c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:59.229452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1004d373-5982-4ef6-81ac-c6b4a8fee35c tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166982 Sep 13 20:14:59.230121 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 794/1673] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:59 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:14:59.246872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-93e87bb3-ffc5-476f-a3b6-42d83d39248f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:59.247474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-93e87bb3-ffc5-476f-a3b6-42d83d39248f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:59.254095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93e87bb3-ffc5-476f-a3b6-42d83d39248f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:59.254610 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93e87bb3-ffc5-476f-a3b6-42d83d39248f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:59.255034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93e87bb3-ffc5-476f-a3b6-42d83d39248f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:59.255706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93e87bb3-ffc5-476f-a3b6-42d83d39248f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:59.256138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93e87bb3-ffc5-476f-a3b6-42d83d39248f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:59.256548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-93e87bb3-ffc5-476f-a3b6-42d83d39248f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:59.384669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-93e87bb3-ffc5-476f-a3b6-42d83d39248f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:14:59.393769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-93e87bb3-ffc5-476f-a3b6-42d83d39248f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.150799 Sep 13 20:14:59.394330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 880/1674] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:14:59 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:14:59.757392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9d4c9df3-9941-4dd6-b4b8-a762c52ae439 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:14:59.760060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9d4c9df3-9941-4dd6-b4b8-a762c52ae439 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:14:59.767078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d4c9df3-9941-4dd6-b4b8-a762c52ae439 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:59.767613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d4c9df3-9941-4dd6-b4b8-a762c52ae439 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:59.768106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d4c9df3-9941-4dd6-b4b8-a762c52ae439 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:59.768875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d4c9df3-9941-4dd6-b4b8-a762c52ae439 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:14:59.769373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d4c9df3-9941-4dd6-b4b8-a762c52ae439 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:14:59.769899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d4c9df3-9941-4dd6-b4b8-a762c52ae439 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:14:59.801443 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9d4c9df3-9941-4dd6-b4b8-a762c52ae439 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048624 Sep 13 20:14:59.802003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 795/1675] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:14:59 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:15:00.257260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4c20acea-deea-4f5a-acbb-821e9ac14124 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:00.258238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4c20acea-deea-4f5a-acbb-821e9ac14124 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:00.267741 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c20acea-deea-4f5a-acbb-821e9ac14124 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:00.268216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c20acea-deea-4f5a-acbb-821e9ac14124 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:00.268644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c20acea-deea-4f5a-acbb-821e9ac14124 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:00.269328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c20acea-deea-4f5a-acbb-821e9ac14124 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:00.269770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c20acea-deea-4f5a-acbb-821e9ac14124 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:00.270188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c20acea-deea-4f5a-acbb-821e9ac14124 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:00.402689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4c20acea-deea-4f5a-acbb-821e9ac14124 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:00.411463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4c20acea-deea-4f5a-acbb-821e9ac14124 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160701 Sep 13 20:15:00.412308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 881/1676] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:00 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:00.417351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-085aea1c-ee51-4c8f-87df-25d64f6be749 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:00.418048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-085aea1c-ee51-4c8f-87df-25d64f6be749 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:00.424536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-085aea1c-ee51-4c8f-87df-25d64f6be749 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:00.425081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-085aea1c-ee51-4c8f-87df-25d64f6be749 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:00.425536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-085aea1c-ee51-4c8f-87df-25d64f6be749 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:00.426217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-085aea1c-ee51-4c8f-87df-25d64f6be749 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:00.426730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-085aea1c-ee51-4c8f-87df-25d64f6be749 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:00.427159 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-085aea1c-ee51-4c8f-87df-25d64f6be749 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:00.561297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-085aea1c-ee51-4c8f-87df-25d64f6be749 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:00.570050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-085aea1c-ee51-4c8f-87df-25d64f6be749 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.156569 Sep 13 20:15:00.570864 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 796/1677] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:00 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:00.818225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e127d50b-057d-402d-81a7-4eaaca53aae9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:00.821957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e127d50b-057d-402d-81a7-4eaaca53aae9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:00.830353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e127d50b-057d-402d-81a7-4eaaca53aae9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:00.830858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e127d50b-057d-402d-81a7-4eaaca53aae9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:00.831278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e127d50b-057d-402d-81a7-4eaaca53aae9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:00.831957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e127d50b-057d-402d-81a7-4eaaca53aae9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:00.832384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e127d50b-057d-402d-81a7-4eaaca53aae9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:00.832792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e127d50b-057d-402d-81a7-4eaaca53aae9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:00.862850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e127d50b-057d-402d-81a7-4eaaca53aae9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051208 Sep 13 20:15:00.863549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 882/1678] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:15:00 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:15:01.434695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-20b45a32-a7db-4cf6-9cf4-8e82c071e3e6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:01.435331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-20b45a32-a7db-4cf6-9cf4-8e82c071e3e6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:01.442294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20b45a32-a7db-4cf6-9cf4-8e82c071e3e6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:01.442776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20b45a32-a7db-4cf6-9cf4-8e82c071e3e6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:01.443216 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20b45a32-a7db-4cf6-9cf4-8e82c071e3e6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:01.443917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20b45a32-a7db-4cf6-9cf4-8e82c071e3e6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:01.444368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20b45a32-a7db-4cf6-9cf4-8e82c071e3e6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:01.444795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20b45a32-a7db-4cf6-9cf4-8e82c071e3e6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:01.578790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-20b45a32-a7db-4cf6-9cf4-8e82c071e3e6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:01.587612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-20b45a32-a7db-4cf6-9cf4-8e82c071e3e6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156829 Sep 13 20:15:01.588148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 797/1679] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:01 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:01.593983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-19062202-94c6-44d6-a826-9ea2c02cd7d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:01.594629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-19062202-94c6-44d6-a826-9ea2c02cd7d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:01.600917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19062202-94c6-44d6-a826-9ea2c02cd7d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:01.601394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19062202-94c6-44d6-a826-9ea2c02cd7d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:01.601823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19062202-94c6-44d6-a826-9ea2c02cd7d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:01.602552 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19062202-94c6-44d6-a826-9ea2c02cd7d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:01.602982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19062202-94c6-44d6-a826-9ea2c02cd7d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:01.603400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19062202-94c6-44d6-a826-9ea2c02cd7d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:01.744172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-19062202-94c6-44d6-a826-9ea2c02cd7d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:01.756569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-19062202-94c6-44d6-a826-9ea2c02cd7d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166658 Sep 13 20:15:01.757254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 883/1680] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:01 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:01.877682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a3b39fad-d515-4119-bec2-7b28ad25e7ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:01.879894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a3b39fad-d515-4119-bec2-7b28ad25e7ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:01.886297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3b39fad-d515-4119-bec2-7b28ad25e7ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:01.886818 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3b39fad-d515-4119-bec2-7b28ad25e7ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:01.887255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3b39fad-d515-4119-bec2-7b28ad25e7ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:01.887949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3b39fad-d515-4119-bec2-7b28ad25e7ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:01.888400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3b39fad-d515-4119-bec2-7b28ad25e7ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:01.888823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3b39fad-d515-4119-bec2-7b28ad25e7ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:01.919154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a3b39fad-d515-4119-bec2-7b28ad25e7ee tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046418 Sep 13 20:15:01.919891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 798/1681] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:15:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:15:02.612270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8b745076-45f0-4af9-abf9-229c1b7a9184 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:02.613029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8b745076-45f0-4af9-abf9-229c1b7a9184 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:02.621436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b745076-45f0-4af9-abf9-229c1b7a9184 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:02.622040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b745076-45f0-4af9-abf9-229c1b7a9184 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:02.622638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b745076-45f0-4af9-abf9-229c1b7a9184 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:02.623493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b745076-45f0-4af9-abf9-229c1b7a9184 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:02.624055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b745076-45f0-4af9-abf9-229c1b7a9184 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:02.624579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b745076-45f0-4af9-abf9-229c1b7a9184 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:02.767065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8b745076-45f0-4af9-abf9-229c1b7a9184 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:02.778732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8b745076-45f0-4af9-abf9-229c1b7a9184 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.171276 Sep 13 20:15:02.779332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 884/1682] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:02 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:02.782310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a817812f-bd85-40d8-94a3-1fcc1d21cccb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:02.782964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a817812f-bd85-40d8-94a3-1fcc1d21cccb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:02.789514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a817812f-bd85-40d8-94a3-1fcc1d21cccb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:02.789988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a817812f-bd85-40d8-94a3-1fcc1d21cccb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:02.790424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a817812f-bd85-40d8-94a3-1fcc1d21cccb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:02.791129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a817812f-bd85-40d8-94a3-1fcc1d21cccb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:02.791574 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a817812f-bd85-40d8-94a3-1fcc1d21cccb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:02.792018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a817812f-bd85-40d8-94a3-1fcc1d21cccb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:02.920496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a817812f-bd85-40d8-94a3-1fcc1d21cccb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:02.930972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a817812f-bd85-40d8-94a3-1fcc1d21cccb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.152468 Sep 13 20:15:02.931774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 799/1683] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:02 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:15:02.932041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0e92f926-6c0a-49ab-b13e-a3c89e0d8dbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:02.933736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0e92f926-6c0a-49ab-b13e-a3c89e0d8dbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:02.939830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e92f926-6c0a-49ab-b13e-a3c89e0d8dbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:02.940288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e92f926-6c0a-49ab-b13e-a3c89e0d8dbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:02.940717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e92f926-6c0a-49ab-b13e-a3c89e0d8dbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:02.941408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e92f926-6c0a-49ab-b13e-a3c89e0d8dbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:02.941842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e92f926-6c0a-49ab-b13e-a3c89e0d8dbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:02.942249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e92f926-6c0a-49ab-b13e-a3c89e0d8dbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:02.972030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0e92f926-6c0a-49ab-b13e-a3c89e0d8dbc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Sep 13 20:15:02.972592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 885/1684] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:15:02 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:15:03.803292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ae47c024-d253-4281-804d-ca0b372b74fc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:03.803856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ae47c024-d253-4281-804d-ca0b372b74fc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:03.810631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae47c024-d253-4281-804d-ca0b372b74fc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:03.811105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae47c024-d253-4281-804d-ca0b372b74fc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:03.811546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae47c024-d253-4281-804d-ca0b372b74fc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:03.812237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae47c024-d253-4281-804d-ca0b372b74fc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:03.812691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae47c024-d253-4281-804d-ca0b372b74fc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:03.813115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae47c024-d253-4281-804d-ca0b372b74fc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:03.947189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ae47c024-d253-4281-804d-ca0b372b74fc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:03.954646 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6200bea8-e545-4b32-8d66-08c41f0546ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:03.955218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6200bea8-e545-4b32-8d66-08c41f0546ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:03.955852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ae47c024-d253-4281-804d-ca0b372b74fc tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156531 Sep 13 20:15:03.956436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 800/1685] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:03 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:03.962679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6200bea8-e545-4b32-8d66-08c41f0546ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:03.963131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6200bea8-e545-4b32-8d66-08c41f0546ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:03.963577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6200bea8-e545-4b32-8d66-08c41f0546ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:03.964264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6200bea8-e545-4b32-8d66-08c41f0546ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:03.964705 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6200bea8-e545-4b32-8d66-08c41f0546ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:03.965102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6200bea8-e545-4b32-8d66-08c41f0546ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:03.984805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fd10a57f-f85f-4ce7-b034-b041e30d9713 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:03.987071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fd10a57f-f85f-4ce7-b034-b041e30d9713 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:03.995181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd10a57f-f85f-4ce7-b034-b041e30d9713 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:03.995655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd10a57f-f85f-4ce7-b034-b041e30d9713 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:03.996093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd10a57f-f85f-4ce7-b034-b041e30d9713 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:03.996795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd10a57f-f85f-4ce7-b034-b041e30d9713 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:03.997245 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd10a57f-f85f-4ce7-b034-b041e30d9713 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:03.997730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd10a57f-f85f-4ce7-b034-b041e30d9713 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.034599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fd10a57f-f85f-4ce7-b034-b041e30d9713 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048109 Sep 13 20:15:04.034599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 801/1686] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:15:03 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:15:04.100967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6200bea8-e545-4b32-8d66-08c41f0546ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:04.113829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6200bea8-e545-4b32-8d66-08c41f0546ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.162891 Sep 13 20:15:04.114602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 886/1687] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:03 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:04.984386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-52715090-2d73-4a6f-9d67-4758df00f1bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:04.985353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-52715090-2d73-4a6f-9d67-4758df00f1bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:04.996294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52715090-2d73-4a6f-9d67-4758df00f1bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.997090 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52715090-2d73-4a6f-9d67-4758df00f1bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.997862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52715090-2d73-4a6f-9d67-4758df00f1bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.999089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52715090-2d73-4a6f-9d67-4758df00f1bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.999860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52715090-2d73-4a6f-9d67-4758df00f1bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:05.000567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52715090-2d73-4a6f-9d67-4758df00f1bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:05.044265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6b12ebeb-61f0-4c3b-bb8b-29e141a6db8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:05.047300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6b12ebeb-61f0-4c3b-bb8b-29e141a6db8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:05.053846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b12ebeb-61f0-4c3b-bb8b-29e141a6db8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:05.054319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b12ebeb-61f0-4c3b-bb8b-29e141a6db8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:05.054813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b12ebeb-61f0-4c3b-bb8b-29e141a6db8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:05.055519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b12ebeb-61f0-4c3b-bb8b-29e141a6db8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:05.055939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b12ebeb-61f0-4c3b-bb8b-29e141a6db8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:05.056398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b12ebeb-61f0-4c3b-bb8b-29e141a6db8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:05.083846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:05.092764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6b12ebeb-61f0-4c3b-bb8b-29e141a6db8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054280 Sep 13 20:15:05.093608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 887/1688] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:15:05 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:15:05.137495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b3ae75e2-33b8-4a72-85ce-99a18b4b88fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:05.138107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b3ae75e2-33b8-4a72-85ce-99a18b4b88fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:05.144543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3ae75e2-33b8-4a72-85ce-99a18b4b88fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:05.145027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3ae75e2-33b8-4a72-85ce-99a18b4b88fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:05.145505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3ae75e2-33b8-4a72-85ce-99a18b4b88fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:05.146193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3ae75e2-33b8-4a72-85ce-99a18b4b88fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:05.146662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3ae75e2-33b8-4a72-85ce-99a18b4b88fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:05.147079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b3ae75e2-33b8-4a72-85ce-99a18b4b88fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:05.281927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b3ae75e2-33b8-4a72-85ce-99a18b4b88fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:05.290879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b3ae75e2-33b8-4a72-85ce-99a18b4b88fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.157305 Sep 13 20:15:05.291433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 888/1689] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:05 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:15:05.399470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-52715090-2d73-4a6f-9d67-4758df00f1bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:05.408207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-52715090-2d73-4a6f-9d67-4758df00f1bf tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.430983 Sep 13 20:15:05.408770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 802/1690] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:04 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:06.109776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a465f38e-ce92-4798-93e7-126342d8ae8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:06.112253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a465f38e-ce92-4798-93e7-126342d8ae8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:06.118633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a465f38e-ce92-4798-93e7-126342d8ae8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:06.119112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a465f38e-ce92-4798-93e7-126342d8ae8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:06.119531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a465f38e-ce92-4798-93e7-126342d8ae8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:06.120214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a465f38e-ce92-4798-93e7-126342d8ae8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:06.120646 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a465f38e-ce92-4798-93e7-126342d8ae8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:06.121056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a465f38e-ce92-4798-93e7-126342d8ae8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:06.151018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a465f38e-ce92-4798-93e7-126342d8ae8c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047904 Sep 13 20:15:06.151569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 889/1691] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:15:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:15:06.319101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c4ecd29b-6e81-41b2-b630-44b25ff2fe8b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:06.320139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c4ecd29b-6e81-41b2-b630-44b25ff2fe8b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:06.330785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4ecd29b-6e81-41b2-b630-44b25ff2fe8b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:06.331268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4ecd29b-6e81-41b2-b630-44b25ff2fe8b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:06.331714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4ecd29b-6e81-41b2-b630-44b25ff2fe8b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:06.332427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4ecd29b-6e81-41b2-b630-44b25ff2fe8b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:06.332908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4ecd29b-6e81-41b2-b630-44b25ff2fe8b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:06.333340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c4ecd29b-6e81-41b2-b630-44b25ff2fe8b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:06.431690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f19df4e0-4e8e-45b7-b963-279daee251e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:06.432307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f19df4e0-4e8e-45b7-b963-279daee251e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:06.438698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f19df4e0-4e8e-45b7-b963-279daee251e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:06.439186 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f19df4e0-4e8e-45b7-b963-279daee251e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:06.439639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f19df4e0-4e8e-45b7-b963-279daee251e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:06.440319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f19df4e0-4e8e-45b7-b963-279daee251e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:06.440767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f19df4e0-4e8e-45b7-b963-279daee251e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:06.441192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f19df4e0-4e8e-45b7-b963-279daee251e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:06.472759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c4ecd29b-6e81-41b2-b630-44b25ff2fe8b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:06.481584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c4ecd29b-6e81-41b2-b630-44b25ff2fe8b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168998 Sep 13 20:15:06.482243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 803/1692] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:06 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:06.573180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f19df4e0-4e8e-45b7-b963-279daee251e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:06.581570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f19df4e0-4e8e-45b7-b963-279daee251e1 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.153937 Sep 13 20:15:06.582169 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 890/1693] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:06 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:07.167494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-24cdfc7d-4378-4f76-8c79-78b59e7e6af7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:07.170569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-24cdfc7d-4378-4f76-8c79-78b59e7e6af7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:07.178172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24cdfc7d-4378-4f76-8c79-78b59e7e6af7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:07.178695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24cdfc7d-4378-4f76-8c79-78b59e7e6af7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:07.179122 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24cdfc7d-4378-4f76-8c79-78b59e7e6af7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:07.179823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24cdfc7d-4378-4f76-8c79-78b59e7e6af7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:07.180259 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24cdfc7d-4378-4f76-8c79-78b59e7e6af7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:07.180681 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24cdfc7d-4378-4f76-8c79-78b59e7e6af7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:07.210968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-24cdfc7d-4378-4f76-8c79-78b59e7e6af7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050560 Sep 13 20:15:07.211528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 804/1694] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:15:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:15:07.508667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-464c1f8c-db2c-4abf-b504-4d398dbb63d5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:07.509664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-464c1f8c-db2c-4abf-b504-4d398dbb63d5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:07.520439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-464c1f8c-db2c-4abf-b504-4d398dbb63d5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:07.521274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-464c1f8c-db2c-4abf-b504-4d398dbb63d5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:07.521970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-464c1f8c-db2c-4abf-b504-4d398dbb63d5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:07.523160 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-464c1f8c-db2c-4abf-b504-4d398dbb63d5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:07.524097 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-464c1f8c-db2c-4abf-b504-4d398dbb63d5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:07.524784 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-464c1f8c-db2c-4abf-b504-4d398dbb63d5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:07.605270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9713a548-ef7c-4d41-bf4e-f56dc9dd1d5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:07.605925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9713a548-ef7c-4d41-bf4e-f56dc9dd1d5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:07.612456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9713a548-ef7c-4d41-bf4e-f56dc9dd1d5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:07.613272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9713a548-ef7c-4d41-bf4e-f56dc9dd1d5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:07.613705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9713a548-ef7c-4d41-bf4e-f56dc9dd1d5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:07.614397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9713a548-ef7c-4d41-bf4e-f56dc9dd1d5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:07.614866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9713a548-ef7c-4d41-bf4e-f56dc9dd1d5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:07.615284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9713a548-ef7c-4d41-bf4e-f56dc9dd1d5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:07.663687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-464c1f8c-db2c-4abf-b504-4d398dbb63d5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:07.672034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-464c1f8c-db2c-4abf-b504-4d398dbb63d5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.170069 Sep 13 20:15:07.672584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 891/1695] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:07 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:07.748384 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9713a548-ef7c-4d41-bf4e-f56dc9dd1d5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:07.757368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9713a548-ef7c-4d41-bf4e-f56dc9dd1d5d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156025 Sep 13 20:15:07.757908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 805/1696] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:07 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:08.226733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9f915dd4-cb82-4419-b03e-ae5357108231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:08.230255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9f915dd4-cb82-4419-b03e-ae5357108231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:08.240805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f915dd4-cb82-4419-b03e-ae5357108231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:08.243599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f915dd4-cb82-4419-b03e-ae5357108231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:08.243599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f915dd4-cb82-4419-b03e-ae5357108231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:08.243599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f915dd4-cb82-4419-b03e-ae5357108231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:08.244183 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f915dd4-cb82-4419-b03e-ae5357108231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:08.244893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9f915dd4-cb82-4419-b03e-ae5357108231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:08.278514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9f915dd4-cb82-4419-b03e-ae5357108231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058202 Sep 13 20:15:08.279087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 892/1697] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:15:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:15:08.699765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-04bc3d19-546d-44c8-b8e5-941613a21eef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:08.700881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-04bc3d19-546d-44c8-b8e5-941613a21eef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:08.710025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04bc3d19-546d-44c8-b8e5-941613a21eef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:08.710546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04bc3d19-546d-44c8-b8e5-941613a21eef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:08.710986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04bc3d19-546d-44c8-b8e5-941613a21eef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:08.712056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04bc3d19-546d-44c8-b8e5-941613a21eef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:08.712506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04bc3d19-546d-44c8-b8e5-941613a21eef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:08.712925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04bc3d19-546d-44c8-b8e5-941613a21eef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:08.781309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-928dd377-e5cc-4320-a434-d551ce1b889a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:08.781914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-928dd377-e5cc-4320-a434-d551ce1b889a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:08.788806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-928dd377-e5cc-4320-a434-d551ce1b889a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:08.789286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-928dd377-e5cc-4320-a434-d551ce1b889a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:08.789718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-928dd377-e5cc-4320-a434-d551ce1b889a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:08.790399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-928dd377-e5cc-4320-a434-d551ce1b889a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:08.790901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-928dd377-e5cc-4320-a434-d551ce1b889a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:08.791319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-928dd377-e5cc-4320-a434-d551ce1b889a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:08.850667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-04bc3d19-546d-44c8-b8e5-941613a21eef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:08.859353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-04bc3d19-546d-44c8-b8e5-941613a21eef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166230 Sep 13 20:15:08.859927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 806/1698] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:08 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:08.922064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-928dd377-e5cc-4320-a434-d551ce1b889a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:08.930836 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-928dd377-e5cc-4320-a434-d551ce1b889a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.153439 Sep 13 20:15:08.931419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 893/1699] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:08 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:09.292551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5e574542-8ed1-480f-8673-2ae1b81aba88 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:15:09.294902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5e574542-8ed1-480f-8673-2ae1b81aba88 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:09.301873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e574542-8ed1-480f-8673-2ae1b81aba88 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:09.302317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e574542-8ed1-480f-8673-2ae1b81aba88 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:09.302783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e574542-8ed1-480f-8673-2ae1b81aba88 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:09.303473 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e574542-8ed1-480f-8673-2ae1b81aba88 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:09.303930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e574542-8ed1-480f-8673-2ae1b81aba88 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:09.304353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e574542-8ed1-480f-8673-2ae1b81aba88 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:09.388305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5e574542-8ed1-480f-8673-2ae1b81aba88 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "POST /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/action" status: 200 len: 76168 microversion: 2.1 time: 0.100462 Sep 13 20:15:09.389004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 807/1700] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 13 20:15:09 2022] POST /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e/action => generated 76168 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:15:09.887109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4c87d587-145b-4403-9329-b348eed4f7ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:09.887995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4c87d587-145b-4403-9329-b348eed4f7ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:09.898857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c87d587-145b-4403-9329-b348eed4f7ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:09.899650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c87d587-145b-4403-9329-b348eed4f7ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:09.900357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c87d587-145b-4403-9329-b348eed4f7ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:09.901493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c87d587-145b-4403-9329-b348eed4f7ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:09.902236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c87d587-145b-4403-9329-b348eed4f7ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:09.902969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c87d587-145b-4403-9329-b348eed4f7ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:09.955329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-08a09837-759e-43be-a54d-d7ca8ce7cdde tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:09.962158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-08a09837-759e-43be-a54d-d7ca8ce7cdde tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:09.970044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-08a09837-759e-43be-a54d-d7ca8ce7cdde tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:09.970815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-08a09837-759e-43be-a54d-d7ca8ce7cdde tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:09.971325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-08a09837-759e-43be-a54d-d7ca8ce7cdde tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:09.972112 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-08a09837-759e-43be-a54d-d7ca8ce7cdde tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:09.972851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-08a09837-759e-43be-a54d-d7ca8ce7cdde tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:09.973314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-08a09837-759e-43be-a54d-d7ca8ce7cdde tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:10.044024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4c87d587-145b-4403-9329-b348eed4f7ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:10.052697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4c87d587-145b-4403-9329-b348eed4f7ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.172222 Sep 13 20:15:10.053272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 894/1701] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:09 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:10.110574 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-08a09837-759e-43be-a54d-d7ca8ce7cdde tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:10.119446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-08a09837-759e-43be-a54d-d7ca8ce7cdde tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.168842 Sep 13 20:15:10.120033 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 808/1702] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:09 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:11.076245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-553e3be8-26e1-432c-b1f9-cb3b577b0f8f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:11.076890 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-553e3be8-26e1-432c-b1f9-cb3b577b0f8f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:11.083637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-553e3be8-26e1-432c-b1f9-cb3b577b0f8f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:11.084128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-553e3be8-26e1-432c-b1f9-cb3b577b0f8f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:11.084550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-553e3be8-26e1-432c-b1f9-cb3b577b0f8f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:11.085240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-553e3be8-26e1-432c-b1f9-cb3b577b0f8f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:11.085694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-553e3be8-26e1-432c-b1f9-cb3b577b0f8f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:11.086111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-553e3be8-26e1-432c-b1f9-cb3b577b0f8f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:11.142883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-30ce9424-e66b-4957-a1c7-d7ade1becb29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:11.143527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-30ce9424-e66b-4957-a1c7-d7ade1becb29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:11.150243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30ce9424-e66b-4957-a1c7-d7ade1becb29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:11.150763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30ce9424-e66b-4957-a1c7-d7ade1becb29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:11.151203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30ce9424-e66b-4957-a1c7-d7ade1becb29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:11.151895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30ce9424-e66b-4957-a1c7-d7ade1becb29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:11.152346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30ce9424-e66b-4957-a1c7-d7ade1becb29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:11.152769 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30ce9424-e66b-4957-a1c7-d7ade1becb29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:11.155568 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:11.223218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-553e3be8-26e1-432c-b1f9-cb3b577b0f8f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:11.232043 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-553e3be8-26e1-432c-b1f9-cb3b577b0f8f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.159810 Sep 13 20:15:11.232618 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 895/1703] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:11 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:11.283531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-30ce9424-e66b-4957-a1c7-d7ade1becb29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:11.292492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-30ce9424-e66b-4957-a1c7-d7ade1becb29 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.153517 Sep 13 20:15:11.293067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 809/1704] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:11 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:15:12.269367 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-967a9e00-f63f-4fb3-9209-af046c0b5232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:12.269975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-967a9e00-f63f-4fb3-9209-af046c0b5232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:12.276929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-967a9e00-f63f-4fb3-9209-af046c0b5232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:12.277432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-967a9e00-f63f-4fb3-9209-af046c0b5232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:12.277842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-967a9e00-f63f-4fb3-9209-af046c0b5232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:12.278570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-967a9e00-f63f-4fb3-9209-af046c0b5232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:12.279023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-967a9e00-f63f-4fb3-9209-af046c0b5232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:12.279440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-967a9e00-f63f-4fb3-9209-af046c0b5232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:12.315481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-14b182ca-da9a-459e-966c-6f1dac01dc07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:12.316055 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-14b182ca-da9a-459e-966c-6f1dac01dc07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:12.324109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14b182ca-da9a-459e-966c-6f1dac01dc07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:12.324592 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14b182ca-da9a-459e-966c-6f1dac01dc07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:12.325072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14b182ca-da9a-459e-966c-6f1dac01dc07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:12.325793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14b182ca-da9a-459e-966c-6f1dac01dc07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:12.326238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14b182ca-da9a-459e-966c-6f1dac01dc07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:12.326695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14b182ca-da9a-459e-966c-6f1dac01dc07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:12.411301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-967a9e00-f63f-4fb3-9209-af046c0b5232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:12.419977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-967a9e00-f63f-4fb3-9209-af046c0b5232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.157262 Sep 13 20:15:12.420570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 896/1705] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:12 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:12.455271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-14b182ca-da9a-459e-966c-6f1dac01dc07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:12.464283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-14b182ca-da9a-459e-966c-6f1dac01dc07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.152740 Sep 13 20:15:12.464853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 810/1706] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:12 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:13.445563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-176094a4-413d-4a3d-8e79-c3186a9dc1f2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:13.446196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-176094a4-413d-4a3d-8e79-c3186a9dc1f2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:13.452910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-176094a4-413d-4a3d-8e79-c3186a9dc1f2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:13.453407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-176094a4-413d-4a3d-8e79-c3186a9dc1f2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:13.453852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-176094a4-413d-4a3d-8e79-c3186a9dc1f2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:13.454604 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-176094a4-413d-4a3d-8e79-c3186a9dc1f2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:13.455068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-176094a4-413d-4a3d-8e79-c3186a9dc1f2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:13.455503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-176094a4-413d-4a3d-8e79-c3186a9dc1f2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:13.487627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a93861c3-5e8b-42ca-9a7f-598f92506829 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:13.488357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a93861c3-5e8b-42ca-9a7f-598f92506829 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:13.495340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a93861c3-5e8b-42ca-9a7f-598f92506829 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:13.495828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a93861c3-5e8b-42ca-9a7f-598f92506829 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:13.496263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a93861c3-5e8b-42ca-9a7f-598f92506829 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:13.496966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a93861c3-5e8b-42ca-9a7f-598f92506829 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:13.497419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a93861c3-5e8b-42ca-9a7f-598f92506829 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:13.497845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a93861c3-5e8b-42ca-9a7f-598f92506829 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:13.601179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-176094a4-413d-4a3d-8e79-c3186a9dc1f2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:13.609432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-176094a4-413d-4a3d-8e79-c3186a9dc1f2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168648 Sep 13 20:15:13.609989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 897/1707] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:13 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:13.638966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a93861c3-5e8b-42ca-9a7f-598f92506829 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:13.647522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a93861c3-5e8b-42ca-9a7f-598f92506829 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.163803 Sep 13 20:15:13.648086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 811/1708] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:13 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:14.633285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-55900260-ac3f-49a0-8d4a-fd3b640d9ff4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:14.633882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-55900260-ac3f-49a0-8d4a-fd3b640d9ff4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:14.641049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55900260-ac3f-49a0-8d4a-fd3b640d9ff4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:14.641519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55900260-ac3f-49a0-8d4a-fd3b640d9ff4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:14.641938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55900260-ac3f-49a0-8d4a-fd3b640d9ff4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:14.642644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55900260-ac3f-49a0-8d4a-fd3b640d9ff4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:14.643078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55900260-ac3f-49a0-8d4a-fd3b640d9ff4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:14.643484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55900260-ac3f-49a0-8d4a-fd3b640d9ff4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:14.670309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ac93e261-6540-4302-88b3-8f23d597a077 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:14.671084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ac93e261-6540-4302-88b3-8f23d597a077 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:14.678026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ac93e261-6540-4302-88b3-8f23d597a077 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:14.678625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ac93e261-6540-4302-88b3-8f23d597a077 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:14.679191 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ac93e261-6540-4302-88b3-8f23d597a077 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:14.679952 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ac93e261-6540-4302-88b3-8f23d597a077 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:14.680469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ac93e261-6540-4302-88b3-8f23d597a077 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:14.680959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ac93e261-6540-4302-88b3-8f23d597a077 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:14.775842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-55900260-ac3f-49a0-8d4a-fd3b640d9ff4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:14.784153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-55900260-ac3f-49a0-8d4a-fd3b640d9ff4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.154754 Sep 13 20:15:14.784727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 898/1709] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:14 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:14.817338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ac93e261-6540-4302-88b3-8f23d597a077 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:14.825531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ac93e261-6540-4302-88b3-8f23d597a077 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.159119 Sep 13 20:15:14.826094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 812/1710] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:14 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:15.807733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e14627bf-a719-4c97-8fe6-6fc32d66802e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:15.808969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e14627bf-a719-4c97-8fe6-6fc32d66802e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:15.815852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e14627bf-a719-4c97-8fe6-6fc32d66802e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:15.816465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e14627bf-a719-4c97-8fe6-6fc32d66802e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:15.816885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e14627bf-a719-4c97-8fe6-6fc32d66802e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:15.818083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e14627bf-a719-4c97-8fe6-6fc32d66802e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:15.818562 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e14627bf-a719-4c97-8fe6-6fc32d66802e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:15.818969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e14627bf-a719-4c97-8fe6-6fc32d66802e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:15.849176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-545474a9-57dd-4939-a63a-16567557ac6d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:15.849797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-545474a9-57dd-4939-a63a-16567557ac6d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:15.856642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-545474a9-57dd-4939-a63a-16567557ac6d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:15.857127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-545474a9-57dd-4939-a63a-16567557ac6d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:15.857565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-545474a9-57dd-4939-a63a-16567557ac6d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:15.858243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-545474a9-57dd-4939-a63a-16567557ac6d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:15.858719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-545474a9-57dd-4939-a63a-16567557ac6d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:15.859143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-545474a9-57dd-4939-a63a-16567557ac6d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:15.949855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e14627bf-a719-4c97-8fe6-6fc32d66802e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:15.958173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e14627bf-a719-4c97-8fe6-6fc32d66802e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.154389 Sep 13 20:15:15.958780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 899/1711] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:15 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:15.993176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-545474a9-57dd-4939-a63a-16567557ac6d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:16.001680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-545474a9-57dd-4939-a63a-16567557ac6d tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156517 Sep 13 20:15:16.002283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 813/1712] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:15 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:16.985806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-009b5528-4e73-404b-af68-2a7672583f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:16.986430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-009b5528-4e73-404b-af68-2a7672583f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:16.993872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-009b5528-4e73-404b-af68-2a7672583f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:16.994339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-009b5528-4e73-404b-af68-2a7672583f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:16.994786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-009b5528-4e73-404b-af68-2a7672583f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:16.995463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-009b5528-4e73-404b-af68-2a7672583f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:16.995899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-009b5528-4e73-404b-af68-2a7672583f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:16.996307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-009b5528-4e73-404b-af68-2a7672583f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:17.024983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9207b5a7-6f85-49a3-b2b5-f58b1711bcb7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:17.025610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9207b5a7-6f85-49a3-b2b5-f58b1711bcb7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:17.032510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9207b5a7-6f85-49a3-b2b5-f58b1711bcb7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:17.032995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9207b5a7-6f85-49a3-b2b5-f58b1711bcb7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:17.033438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9207b5a7-6f85-49a3-b2b5-f58b1711bcb7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:17.034134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9207b5a7-6f85-49a3-b2b5-f58b1711bcb7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:17.034629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9207b5a7-6f85-49a3-b2b5-f58b1711bcb7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:17.035055 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9207b5a7-6f85-49a3-b2b5-f58b1711bcb7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:17.125580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-009b5528-4e73-404b-af68-2a7672583f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:17.133905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-009b5528-4e73-404b-af68-2a7672583f3c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.154506 Sep 13 20:15:17.134498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 900/1713] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:16 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:17.164948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9207b5a7-6f85-49a3-b2b5-f58b1711bcb7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:17.173377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9207b5a7-6f85-49a3-b2b5-f58b1711bcb7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.152226 Sep 13 20:15:17.173920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 814/1714] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:17 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:18.160977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bfecf8a9-1cca-46ea-b1c0-55f41dd57efb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:18.161831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bfecf8a9-1cca-46ea-b1c0-55f41dd57efb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:18.172666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfecf8a9-1cca-46ea-b1c0-55f41dd57efb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:18.173488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfecf8a9-1cca-46ea-b1c0-55f41dd57efb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:18.174156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfecf8a9-1cca-46ea-b1c0-55f41dd57efb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:18.175343 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfecf8a9-1cca-46ea-b1c0-55f41dd57efb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:18.176082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfecf8a9-1cca-46ea-b1c0-55f41dd57efb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:18.176826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfecf8a9-1cca-46ea-b1c0-55f41dd57efb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:18.197492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d01e5ec7-dc23-414b-bd56-255f5a5ec3f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:18.198100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d01e5ec7-dc23-414b-bd56-255f5a5ec3f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:18.204917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d01e5ec7-dc23-414b-bd56-255f5a5ec3f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:18.205401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d01e5ec7-dc23-414b-bd56-255f5a5ec3f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:18.205834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d01e5ec7-dc23-414b-bd56-255f5a5ec3f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:18.206642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d01e5ec7-dc23-414b-bd56-255f5a5ec3f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:18.207093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d01e5ec7-dc23-414b-bd56-255f5a5ec3f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:18.207544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d01e5ec7-dc23-414b-bd56-255f5a5ec3f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:18.316410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bfecf8a9-1cca-46ea-b1c0-55f41dd57efb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:18.325737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bfecf8a9-1cca-46ea-b1c0-55f41dd57efb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.171488 Sep 13 20:15:18.327231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 901/1715] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:18 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:18.347327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d01e5ec7-dc23-414b-bd56-255f5a5ec3f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:18.355755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d01e5ec7-dc23-414b-bd56-255f5a5ec3f5 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.162234 Sep 13 20:15:18.356321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 815/1716] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:18 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:19.352351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bfc65511-8148-416c-be65-df3054135876 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:19.353152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bfc65511-8148-416c-be65-df3054135876 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:19.362049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfc65511-8148-416c-be65-df3054135876 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:19.362737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfc65511-8148-416c-be65-df3054135876 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:19.363434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfc65511-8148-416c-be65-df3054135876 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:19.364119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfc65511-8148-416c-be65-df3054135876 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:19.364570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfc65511-8148-416c-be65-df3054135876 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:19.364987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfc65511-8148-416c-be65-df3054135876 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:19.379156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c5872f78-b208-47f4-b828-abca0dbca9e8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:19.379758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c5872f78-b208-47f4-b828-abca0dbca9e8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:19.386602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5872f78-b208-47f4-b828-abca0dbca9e8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:19.387094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5872f78-b208-47f4-b828-abca0dbca9e8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:19.387531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5872f78-b208-47f4-b828-abca0dbca9e8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:19.388225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5872f78-b208-47f4-b828-abca0dbca9e8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:19.388675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5872f78-b208-47f4-b828-abca0dbca9e8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:19.389099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5872f78-b208-47f4-b828-abca0dbca9e8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:19.494334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bfc65511-8148-416c-be65-df3054135876 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:19.503439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bfc65511-8148-416c-be65-df3054135876 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.156273 Sep 13 20:15:19.504027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 902/1717] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:19 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:19.524514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c5872f78-b208-47f4-b828-abca0dbca9e8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:19.533397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c5872f78-b208-47f4-b828-abca0dbca9e8 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.158214 Sep 13 20:15:19.533959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 816/1718] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:19 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:20.530904 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-731f79f2-170f-4ae1-805e-d4f13f291cc0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:20.531927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-731f79f2-170f-4ae1-805e-d4f13f291cc0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:20.543163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-731f79f2-170f-4ae1-805e-d4f13f291cc0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:20.543926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-731f79f2-170f-4ae1-805e-d4f13f291cc0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:20.544685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-731f79f2-170f-4ae1-805e-d4f13f291cc0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:20.545882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-731f79f2-170f-4ae1-805e-d4f13f291cc0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:20.546688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-731f79f2-170f-4ae1-805e-d4f13f291cc0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:20.547397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-731f79f2-170f-4ae1-805e-d4f13f291cc0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:20.557239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-345fedd8-6d60-4ec2-b829-340869043b5a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:20.558494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-345fedd8-6d60-4ec2-b829-340869043b5a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:20.565142 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-345fedd8-6d60-4ec2-b829-340869043b5a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:20.565631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-345fedd8-6d60-4ec2-b829-340869043b5a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:20.566078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-345fedd8-6d60-4ec2-b829-340869043b5a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:20.566812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-345fedd8-6d60-4ec2-b829-340869043b5a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:20.567274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-345fedd8-6d60-4ec2-b829-340869043b5a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:20.567699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-345fedd8-6d60-4ec2-b829-340869043b5a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:20.699368 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-731f79f2-170f-4ae1-805e-d4f13f291cc0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:20.700763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-345fedd8-6d60-4ec2-b829-340869043b5a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:20.709390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-345fedd8-6d60-4ec2-b829-340869043b5a tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.155979 Sep 13 20:15:20.709975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 817/1719] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:20 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:20.710141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-731f79f2-170f-4ae1-805e-d4f13f291cc0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.185616 Sep 13 20:15:20.710555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 903/1720] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:20 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:21.733049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-37d64d4f-4bfd-4c8e-b91d-24a6dd5b9c79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:21.733776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4637fb0e-6ba1-4611-8207-94e20e2368df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:21.734151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-37d64d4f-4bfd-4c8e-b91d-24a6dd5b9c79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:21.734286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4637fb0e-6ba1-4611-8207-94e20e2368df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:21.740225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37d64d4f-4bfd-4c8e-b91d-24a6dd5b9c79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:21.740408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4637fb0e-6ba1-4611-8207-94e20e2368df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:21.740711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37d64d4f-4bfd-4c8e-b91d-24a6dd5b9c79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:21.740844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4637fb0e-6ba1-4611-8207-94e20e2368df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:21.741142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37d64d4f-4bfd-4c8e-b91d-24a6dd5b9c79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:21.741279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4637fb0e-6ba1-4611-8207-94e20e2368df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:21.741839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37d64d4f-4bfd-4c8e-b91d-24a6dd5b9c79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:21.741965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4637fb0e-6ba1-4611-8207-94e20e2368df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:21.742284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37d64d4f-4bfd-4c8e-b91d-24a6dd5b9c79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:21.742489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4637fb0e-6ba1-4611-8207-94e20e2368df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:21.742730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37d64d4f-4bfd-4c8e-b91d-24a6dd5b9c79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:21.742849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4637fb0e-6ba1-4611-8207-94e20e2368df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:21.758056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:21.876227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-37d64d4f-4bfd-4c8e-b91d-24a6dd5b9c79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:21.877297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4637fb0e-6ba1-4611-8207-94e20e2368df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:21.884949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-37d64d4f-4bfd-4c8e-b91d-24a6dd5b9c79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.155705 Sep 13 20:15:21.885511 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4637fb0e-6ba1-4611-8207-94e20e2368df tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.156382 Sep 13 20:15:21.886229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 904/1721] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:21 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:21.886464 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 818/1722] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:21 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:22.912117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f13c2a5c-b777-4843-92c5-558a87eb6a15 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:22.912970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-34ff6134-46a2-4366-8da6-5d10229fcb88 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:22.913606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f13c2a5c-b777-4843-92c5-558a87eb6a15 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:22.913777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-34ff6134-46a2-4366-8da6-5d10229fcb88 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:22.923870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34ff6134-46a2-4366-8da6-5d10229fcb88 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:22.924176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f13c2a5c-b777-4843-92c5-558a87eb6a15 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:22.924674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34ff6134-46a2-4366-8da6-5d10229fcb88 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:22.924959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f13c2a5c-b777-4843-92c5-558a87eb6a15 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:22.925326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34ff6134-46a2-4366-8da6-5d10229fcb88 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:22.925745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f13c2a5c-b777-4843-92c5-558a87eb6a15 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:22.926508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34ff6134-46a2-4366-8da6-5d10229fcb88 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:22.926906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f13c2a5c-b777-4843-92c5-558a87eb6a15 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:22.927319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34ff6134-46a2-4366-8da6-5d10229fcb88 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:22.927525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f13c2a5c-b777-4843-92c5-558a87eb6a15 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:22.927736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34ff6134-46a2-4366-8da6-5d10229fcb88 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:22.927944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f13c2a5c-b777-4843-92c5-558a87eb6a15 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:23.055288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f13c2a5c-b777-4843-92c5-558a87eb6a15 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:23.057593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-34ff6134-46a2-4366-8da6-5d10229fcb88 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:23.064510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f13c2a5c-b777-4843-92c5-558a87eb6a15 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158274 Sep 13 20:15:23.065248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 905/1723] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:22 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:23.066582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-34ff6134-46a2-4366-8da6-5d10229fcb88 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.160544 Sep 13 20:15:23.070799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 819/1724] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:22 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:24.092500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-79f73488-644f-4386-9925-bc143010e68e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:24.093520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-79f73488-644f-4386-9925-bc143010e68e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:24.094631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4d0091ca-4fab-4edb-9cfe-4f2a4ed13651 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:24.095641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4d0091ca-4fab-4edb-9cfe-4f2a4ed13651 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 3f881820-7e22-41c7-b39e-9f204af9a23c] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:24.102584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79f73488-644f-4386-9925-bc143010e68e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:24.103054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79f73488-644f-4386-9925-bc143010e68e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:24.103425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d0091ca-4fab-4edb-9cfe-4f2a4ed13651 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:24.103542 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79f73488-644f-4386-9925-bc143010e68e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:24.103910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d0091ca-4fab-4edb-9cfe-4f2a4ed13651 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:24.104238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79f73488-644f-4386-9925-bc143010e68e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:24.104352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d0091ca-4fab-4edb-9cfe-4f2a4ed13651 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:24.104721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79f73488-644f-4386-9925-bc143010e68e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:24.105110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d0091ca-4fab-4edb-9cfe-4f2a4ed13651 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:24.105217 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79f73488-644f-4386-9925-bc143010e68e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:24.105575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d0091ca-4fab-4edb-9cfe-4f2a4ed13651 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:24.105988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d0091ca-4fab-4edb-9cfe-4f2a4ed13651 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:24.245453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4d0091ca-4fab-4edb-9cfe-4f2a4ed13651 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:24.249625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-79f73488-644f-4386-9925-bc143010e68e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:24.253839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4d0091ca-4fab-4edb-9cfe-4f2a4ed13651 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c" status: 200 len: 1735 microversion: 2.1 time: 0.166165 Sep 13 20:15:24.254476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 820/1725] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:24 2022] GET /compute/v2.1/servers/3f881820-7e22-41c7-b39e-9f204af9a23c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:24.258233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-79f73488-644f-4386-9925-bc143010e68e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.172838 Sep 13 20:15:24.259470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 906/1726] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:24 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:24.275680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-84a3c9e8-3e20-4226-af79-df6c3cce90f2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '.version_select at 0x7f984691f550>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:24.299273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-84a3c9e8-3e20-4226-af79-df6c3cce90f2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161829303" status: 202 len: 0 microversion: 2.1 time: 0.027365 Sep 13 20:15:24.299832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 821/1727] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 13 20:15:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161829303 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:15:25.282866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-17d9b39b-2b2e-4d0a-a2cf-3b96865a47a4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:25.283575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-17d9b39b-2b2e-4d0a-a2cf-3b96865a47a4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:25.290162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d9b39b-2b2e-4d0a-a2cf-3b96865a47a4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:25.290668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d9b39b-2b2e-4d0a-a2cf-3b96865a47a4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:25.291106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d9b39b-2b2e-4d0a-a2cf-3b96865a47a4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:25.291783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d9b39b-2b2e-4d0a-a2cf-3b96865a47a4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:25.292226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d9b39b-2b2e-4d0a-a2cf-3b96865a47a4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:25.292644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d9b39b-2b2e-4d0a-a2cf-3b96865a47a4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:25.504834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17d9b39b-2b2e-4d0a-a2cf-3b96865a47a4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:25.518512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-17d9b39b-2b2e-4d0a-a2cf-3b96865a47a4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.239434 Sep 13 20:15:25.520136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 907/1728] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:25 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:25.625470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-0652561d-13e0-4060-b931-a798a64a2ff6 req-52b5d77b-2905-403e-8d98-389405be88a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f881820-7e22-41c7-b39e-9f204af9a23c", "tag": "3ba9501e-1d87-4e9c-919d-9db2338fa99d"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:15:25.636711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0652561d-13e0-4060-b931-a798a64a2ff6 req-52b5d77b-2905-403e-8d98-389405be88a9 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:25.637197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0652561d-13e0-4060-b931-a798a64a2ff6 req-52b5d77b-2905-403e-8d98-389405be88a9 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:25.637712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0652561d-13e0-4060-b931-a798a64a2ff6 req-52b5d77b-2905-403e-8d98-389405be88a9 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:25.662922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-0652561d-13e0-4060-b931-a798a64a2ff6 req-52b5d77b-2905-403e-8d98-389405be88a9 service nova] Creating event network-changed:3ba9501e-1d87-4e9c-919d-9db2338fa99d for instance 3f881820-7e22-41c7-b39e-9f204af9a23c on hv-cinder-85427 Sep 13 20:15:25.671001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-0652561d-13e0-4060-b931-a798a64a2ff6 req-52b5d77b-2905-403e-8d98-389405be88a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109807 Sep 13 20:15:25.672483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 822/1729] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:15:26.543768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ef00ebd7-c148-4d10-a277-3ab32f93d879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:26.544772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ef00ebd7-c148-4d10-a277-3ab32f93d879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:26.554408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef00ebd7-c148-4d10-a277-3ab32f93d879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:26.555110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef00ebd7-c148-4d10-a277-3ab32f93d879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:26.555705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef00ebd7-c148-4d10-a277-3ab32f93d879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:26.556588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef00ebd7-c148-4d10-a277-3ab32f93d879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:26.557336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef00ebd7-c148-4d10-a277-3ab32f93d879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:26.558168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef00ebd7-c148-4d10-a277-3ab32f93d879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:26.570107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-5c64f17b-b7b2-45cf-ae03-834fe729d6e5 req-06ffcf73-0a79-45e5-888a-cc8b4db95d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f881820-7e22-41c7-b39e-9f204af9a23c", "name": "network-vif-deleted", "tag": "3ba9501e-1d87-4e9c-919d-9db2338fa99d"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:15:26.590716 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-5c64f17b-b7b2-45cf-ae03-834fe729d6e5 req-06ffcf73-0a79-45e5-888a-cc8b4db95d19 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:26.591188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-5c64f17b-b7b2-45cf-ae03-834fe729d6e5 req-06ffcf73-0a79-45e5-888a-cc8b4db95d19 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:26.591606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-5c64f17b-b7b2-45cf-ae03-834fe729d6e5 req-06ffcf73-0a79-45e5-888a-cc8b4db95d19 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:26.605336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-5c64f17b-b7b2-45cf-ae03-834fe729d6e5 req-06ffcf73-0a79-45e5-888a-cc8b4db95d19 service nova] Creating event network-vif-deleted:3ba9501e-1d87-4e9c-919d-9db2338fa99d for instance 3f881820-7e22-41c7-b39e-9f204af9a23c on hv-cinder-85427 Sep 13 20:15:26.609380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR oslo.messaging._drivers.impl_rabbit [req-5c64f17b-b7b2-45cf-ae03-834fe729d6e5 req-06ffcf73-0a79-45e5-888a-cc8b4db95d19 service nova] [a118af4a-3fce-4635-a129-ce73a2ce12b8] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 20:15:26.706626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ef00ebd7-c148-4d10-a277-3ab32f93d879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:26.716170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ef00ebd7-c148-4d10-a277-3ab32f93d879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.177003 Sep 13 20:15:26.717007 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 823/1730] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:26 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:15:27.370444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-75da686c-07b8-4e24-a89a-a696a3e68be1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:27.370886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-75da686c-07b8-4e24-a89a-a696a3e68be1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:27.377281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-75da686c-07b8-4e24-a89a-a696a3e68be1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:27.377813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-75da686c-07b8-4e24-a89a-a696a3e68be1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:27.378246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-75da686c-07b8-4e24-a89a-a696a3e68be1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:27.379000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-75da686c-07b8-4e24-a89a-a696a3e68be1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:27.379487 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-75da686c-07b8-4e24-a89a-a696a3e68be1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:27.379893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-75da686c-07b8-4e24-a89a-a696a3e68be1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:27.405444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-75da686c-07b8-4e24-a89a-a696a3e68be1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Going to try to terminate instance {{(pid=120845) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:15:27.484863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-75da686c-07b8-4e24-a89a-a696a3e68be1 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 204 len: 0 microversion: 2.1 time: 0.118070 Sep 13 20:15:27.485525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 824/1731] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:15:27 2022] DELETE /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:15:27.494534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-25a6c511-734c-4ee5-8dc0-003266d8de96 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:27.495270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-25a6c511-734c-4ee5-8dc0-003266d8de96 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:27.501658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25a6c511-734c-4ee5-8dc0-003266d8de96 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:27.502139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25a6c511-734c-4ee5-8dc0-003266d8de96 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:27.502613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25a6c511-734c-4ee5-8dc0-003266d8de96 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:27.503313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25a6c511-734c-4ee5-8dc0-003266d8de96 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:27.503763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25a6c511-734c-4ee5-8dc0-003266d8de96 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:27.504173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25a6c511-734c-4ee5-8dc0-003266d8de96 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:27.618099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [req-5c64f17b-b7b2-45cf-ae03-834fe729d6e5 req-06ffcf73-0a79-45e5-888a-cc8b4db95d19 service nova] [a118af4a-3fce-4635-a129-ce73a2ce12b8] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 52114. Sep 13 20:15:27.622220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-5c64f17b-b7b2-45cf-ae03-834fe729d6e5 req-06ffcf73-0a79-45e5-888a-cc8b4db95d19 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.151708 Sep 13 20:15:27.623577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 908/1732] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:15:27.642007 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-25a6c511-734c-4ee5-8dc0-003266d8de96 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:27.645240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:27.653626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-25a6c511-734c-4ee5-8dc0-003266d8de96 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1554 microversion: 2.1 time: 0.163154 Sep 13 20:15:27.654232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 825/1733] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:27 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:15:27.740417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c16925d7-9589-4885-8851-849f0b546dc3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:27.741321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c16925d7-9589-4885-8851-849f0b546dc3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:27.748778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c16925d7-9589-4885-8851-849f0b546dc3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:27.749251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c16925d7-9589-4885-8851-849f0b546dc3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:27.749679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c16925d7-9589-4885-8851-849f0b546dc3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:27.750379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c16925d7-9589-4885-8851-849f0b546dc3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:27.750814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c16925d7-9589-4885-8851-849f0b546dc3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:27.751225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c16925d7-9589-4885-8851-849f0b546dc3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:27.887352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c16925d7-9589-4885-8851-849f0b546dc3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:27.895743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c16925d7-9589-4885-8851-849f0b546dc3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.160214 Sep 13 20:15:27.896309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 909/1734] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:27 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:28.681777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:28.682554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:28.686019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:28.692495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:28.692988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:28.693468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:28.694268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:28.694751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:28.695176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:28.728600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:28.729081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:28.729514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:28.729961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.objects.instance [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lazy-loading 'fault' on Instance uuid 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e {{(pid=120845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:15:28.771348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b7e2cda35c473597343822e622a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c401b957669e43bdabf08fa232b461be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:28.779391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9aba65c3-f886-4cd6-8438-9a0a059d50f2 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 200 len: 1348 microversion: 2.1 time: 0.102240 Sep 13 20:15:28.779968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 826/1735] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:28 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:28.920221 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-79a9ad93-e14b-495a-bfa8-4c12d507e7c8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:28.920771 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-79a9ad93-e14b-495a-bfa8-4c12d507e7c8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:28.923264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=62 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:28.929263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79a9ad93-e14b-495a-bfa8-4c12d507e7c8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:28.929991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79a9ad93-e14b-495a-bfa8-4c12d507e7c8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:28.930652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79a9ad93-e14b-495a-bfa8-4c12d507e7c8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:28.931348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79a9ad93-e14b-495a-bfa8-4c12d507e7c8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:28.931792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79a9ad93-e14b-495a-bfa8-4c12d507e7c8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:28.932213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-79a9ad93-e14b-495a-bfa8-4c12d507e7c8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:29.098826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-79a9ad93-e14b-495a-bfa8-4c12d507e7c8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:29.107614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-79a9ad93-e14b-495a-bfa8-4c12d507e7c8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.191414 Sep 13 20:15:29.108194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 910/1736] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:28 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:29.645176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-64f75c31-10e8-4051-b571-e3ada39374b6 req-4fd409b4-534f-4289-a1ca-42e7c2af0ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e", "name": "network-vif-deleted", "tag": "bdaedf1b-a56e-4be7-a8ed-5597bad3622d"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:15:29.656088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-64f75c31-10e8-4051-b571-e3ada39374b6 req-4fd409b4-534f-4289-a1ca-42e7c2af0ac7 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:29.656557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-64f75c31-10e8-4051-b571-e3ada39374b6 req-4fd409b4-534f-4289-a1ca-42e7c2af0ac7 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:29.656978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-64f75c31-10e8-4051-b571-e3ada39374b6 req-4fd409b4-534f-4289-a1ca-42e7c2af0ac7 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:29.668054 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-64f75c31-10e8-4051-b571-e3ada39374b6 req-4fd409b4-534f-4289-a1ca-42e7c2af0ac7 service nova] Creating event network-vif-deleted:bdaedf1b-a56e-4be7-a8ed-5597bad3622d for instance 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e on hv-cinder-85427 Sep 13 20:15:29.673085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-64f75c31-10e8-4051-b571-e3ada39374b6 req-4fd409b4-534f-4289-a1ca-42e7c2af0ac7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034459 Sep 13 20:15:29.674048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 827/1737] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:15:29.803105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6e60ece1-0e63-4e0f-afd6-b88962a2f130 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:29.804057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6e60ece1-0e63-4e0f-afd6-b88962a2f130 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] [instance: 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:29.810564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e60ece1-0e63-4e0f-afd6-b88962a2f130 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:29.811187 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e60ece1-0e63-4e0f-afd6-b88962a2f130 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:29.811706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e60ece1-0e63-4e0f-afd6-b88962a2f130 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:29.812491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e60ece1-0e63-4e0f-afd6-b88962a2f130 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:29.813047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e60ece1-0e63-4e0f-afd6-b88962a2f130 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:29.813537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e60ece1-0e63-4e0f-afd6-b88962a2f130 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:29.828492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-6e60ece1-0e63-4e0f-afd6-b88962a2f130 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] HTTP exception thrown: Instance 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e could not be found. Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6e60ece1-0e63-4e0f-afd6-b88962a2f130 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Request method failure captured: Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e HTTP/1.1 Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOGU6HpndxIO_1oCw_YT7nuUjX49eW9zWXKR1Sl5f2kJkdOscB3rvLhHKKqqb9X2lHVZdMK47FT_2-TQa4vIGm_2vQr92AF8R4A_xxsqXq_K6FwAtIiVG03c5rXlHfz-IeRLjIjcEK0b9U9iNGVUGKqiZrWnJSr4brhuUp-xK2Jel7g Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: c401b957669e43bdabf08fa232b461be Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-TestMinimumBasicScenario-763110492 Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:15:29.830655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:15:29.832385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c401b957669e43bdabf08fa232b461be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c401b957669e43bdabf08fa232b461be", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c401b957669e43bdabf08fa232b461be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c401b957669e43bdabf08fa232b461be"}]}] Sep 13 20:15:29.832385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-TestMinimumBasicScenario-763110492 Sep 13 20:15:29.832385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: c401b957669e43bdabf08fa232b461be Sep 13 20:15:29.832385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-TestMinimumBasicScenario-763110492 Sep 13 20:15:29.832385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-TestMinimumBasicScenario-763110492-project Sep 13 20:15:29.832385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:15:29.832385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:15:29.832385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 66b7e2cda35c473597343822e622a3bd Sep 13 20:15:29.832385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-TestMinimumBasicScenario-763110492-project Sep 13 20:15:29.832385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:15:29.832385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e could not be found. Sep 13 20:15:29.832385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e'} Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e could not be found. Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:15:29.833540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e could not be found. Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e could not be found. Sep 13 20:15:29.835234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:15:29.837809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6e60ece1-0e63-4e0f-afd6-b88962a2f130 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Returning 404 to user: Instance 0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:15:29.838709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6e60ece1-0e63-4e0f-afd6-b88962a2f130 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e" status: 404 len: 111 microversion: 2.1 time: 0.039694 Sep 13 20:15:29.839412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 911/1738] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:29 2022] GET /compute/v2.1/servers/0233c5fd-d1ef-424b-95c2-dbb0f3a9b04e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:15:29.848283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7cd41e37-db88-43f5-86a8-fc20df669038 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] Calling method '.version_select at 0x7f98467c6c10>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:29.871336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7cd41e37-db88-43f5-86a8-fc20df669038 tempest-TestMinimumBasicScenario-763110492 tempest-TestMinimumBasicScenario-763110492-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-947354718" status: 202 len: 0 microversion: 2.1 time: 0.027295 Sep 13 20:15:29.872347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 828/1739] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 13 20:15:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-947354718 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:15:30.131255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a95c8554-733e-4bbe-936d-a95dfdf4065a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:30.131867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a95c8554-733e-4bbe-936d-a95dfdf4065a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:30.138207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a95c8554-733e-4bbe-936d-a95dfdf4065a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:30.138717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a95c8554-733e-4bbe-936d-a95dfdf4065a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:30.139139 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a95c8554-733e-4bbe-936d-a95dfdf4065a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:30.139819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a95c8554-733e-4bbe-936d-a95dfdf4065a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:30.140256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a95c8554-733e-4bbe-936d-a95dfdf4065a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:30.140671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a95c8554-733e-4bbe-936d-a95dfdf4065a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:30.285538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a95c8554-733e-4bbe-936d-a95dfdf4065a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:30.294185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a95c8554-733e-4bbe-936d-a95dfdf4065a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166790 Sep 13 20:15:30.294812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 912/1740] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:30 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:31.317659 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dc1aef55-604a-4ccf-bdd1-3b24ba5e1879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:31.319146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dc1aef55-604a-4ccf-bdd1-3b24ba5e1879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:31.325850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc1aef55-604a-4ccf-bdd1-3b24ba5e1879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:31.326308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc1aef55-604a-4ccf-bdd1-3b24ba5e1879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:31.326774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc1aef55-604a-4ccf-bdd1-3b24ba5e1879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:31.327431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc1aef55-604a-4ccf-bdd1-3b24ba5e1879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:31.328048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc1aef55-604a-4ccf-bdd1-3b24ba5e1879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:31.328629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dc1aef55-604a-4ccf-bdd1-3b24ba5e1879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:31.537934 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dc1aef55-604a-4ccf-bdd1-3b24ba5e1879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:31.551746 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dc1aef55-604a-4ccf-bdd1-3b24ba5e1879 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.238306 Sep 13 20:15:31.552306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 829/1741] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:31 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:32.575783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7ccabd0e-8f74-4605-ae13-c342d785aa94 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:32.579133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7ccabd0e-8f74-4605-ae13-c342d785aa94 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:32.583721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7ccabd0e-8f74-4605-ae13-c342d785aa94 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:32.584214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7ccabd0e-8f74-4605-ae13-c342d785aa94 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:32.584800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7ccabd0e-8f74-4605-ae13-c342d785aa94 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:32.585501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7ccabd0e-8f74-4605-ae13-c342d785aa94 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:32.585949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7ccabd0e-8f74-4605-ae13-c342d785aa94 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:32.586460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7ccabd0e-8f74-4605-ae13-c342d785aa94 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:32.727749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7ccabd0e-8f74-4605-ae13-c342d785aa94 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:32.736287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7ccabd0e-8f74-4605-ae13-c342d785aa94 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164478 Sep 13 20:15:32.736841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 913/1742] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:32 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:33.760380 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-78113e30-872d-4d34-841d-9ae66a24bf6b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:33.761081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-78113e30-872d-4d34-841d-9ae66a24bf6b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:33.769515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78113e30-872d-4d34-841d-9ae66a24bf6b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:33.770002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78113e30-872d-4d34-841d-9ae66a24bf6b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:33.770461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78113e30-872d-4d34-841d-9ae66a24bf6b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:33.771337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78113e30-872d-4d34-841d-9ae66a24bf6b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:33.771978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78113e30-872d-4d34-841d-9ae66a24bf6b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:33.772571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78113e30-872d-4d34-841d-9ae66a24bf6b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:33.937287 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-78113e30-872d-4d34-841d-9ae66a24bf6b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:33.948636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-78113e30-872d-4d34-841d-9ae66a24bf6b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.191795 Sep 13 20:15:33.949750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 830/1743] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:33 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:34.972782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0d85d1da-8ffe-43f9-a1e3-c5e3a12a0a8e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:34.973982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0d85d1da-8ffe-43f9-a1e3-c5e3a12a0a8e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:34.980668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d85d1da-8ffe-43f9-a1e3-c5e3a12a0a8e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:34.981124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d85d1da-8ffe-43f9-a1e3-c5e3a12a0a8e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:34.981542 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d85d1da-8ffe-43f9-a1e3-c5e3a12a0a8e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:34.982305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d85d1da-8ffe-43f9-a1e3-c5e3a12a0a8e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:34.982741 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d85d1da-8ffe-43f9-a1e3-c5e3a12a0a8e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:34.983423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d85d1da-8ffe-43f9-a1e3-c5e3a12a0a8e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:35.120717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0d85d1da-8ffe-43f9-a1e3-c5e3a12a0a8e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:35.129386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0d85d1da-8ffe-43f9-a1e3-c5e3a12a0a8e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.160520 Sep 13 20:15:35.129927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 914/1744] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:34 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:36.155043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5e2f7996-1245-4ca2-9492-eb93cc2975b5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:36.155833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5e2f7996-1245-4ca2-9492-eb93cc2975b5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:36.162731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e2f7996-1245-4ca2-9492-eb93cc2975b5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:36.163320 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e2f7996-1245-4ca2-9492-eb93cc2975b5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:36.163851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e2f7996-1245-4ca2-9492-eb93cc2975b5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:36.164660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e2f7996-1245-4ca2-9492-eb93cc2975b5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:36.165212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e2f7996-1245-4ca2-9492-eb93cc2975b5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:36.165723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e2f7996-1245-4ca2-9492-eb93cc2975b5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:36.651210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5e2f7996-1245-4ca2-9492-eb93cc2975b5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:36.664933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5e2f7996-1245-4ca2-9492-eb93cc2975b5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.513836 Sep 13 20:15:36.665894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 831/1745] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:36 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:37.689098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5d291642-9731-40c0-8736-14895db6337c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:37.689920 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5d291642-9731-40c0-8736-14895db6337c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:37.696671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d291642-9731-40c0-8736-14895db6337c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:37.697447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d291642-9731-40c0-8736-14895db6337c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:37.697968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d291642-9731-40c0-8736-14895db6337c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:37.699201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d291642-9731-40c0-8736-14895db6337c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:37.699730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d291642-9731-40c0-8736-14895db6337c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:37.700221 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d291642-9731-40c0-8736-14895db6337c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:37.857409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5d291642-9731-40c0-8736-14895db6337c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:37.866735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5d291642-9731-40c0-8736-14895db6337c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.181535 Sep 13 20:15:37.867630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 915/1746] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:37 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:38.889684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6167ba5e-f212-4c85-9e62-bef727929f68 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:38.890246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6167ba5e-f212-4c85-9e62-bef727929f68 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:38.896889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6167ba5e-f212-4c85-9e62-bef727929f68 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:38.897393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6167ba5e-f212-4c85-9e62-bef727929f68 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:38.897824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6167ba5e-f212-4c85-9e62-bef727929f68 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:38.898537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6167ba5e-f212-4c85-9e62-bef727929f68 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:38.898983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6167ba5e-f212-4c85-9e62-bef727929f68 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:38.899403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6167ba5e-f212-4c85-9e62-bef727929f68 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:39.041232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6167ba5e-f212-4c85-9e62-bef727929f68 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:39.050477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6167ba5e-f212-4c85-9e62-bef727929f68 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165039 Sep 13 20:15:39.051039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 832/1747] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:38 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:15:40.074445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-efce53cc-bedc-49fb-a033-03b6a8f08319 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:40.075108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-efce53cc-bedc-49fb-a033-03b6a8f08319 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:40.081946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efce53cc-bedc-49fb-a033-03b6a8f08319 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:40.082416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efce53cc-bedc-49fb-a033-03b6a8f08319 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:40.082867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efce53cc-bedc-49fb-a033-03b6a8f08319 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:40.083549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efce53cc-bedc-49fb-a033-03b6a8f08319 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:40.083986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efce53cc-bedc-49fb-a033-03b6a8f08319 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:40.084395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efce53cc-bedc-49fb-a033-03b6a8f08319 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:40.228329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-efce53cc-bedc-49fb-a033-03b6a8f08319 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:40.236867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-efce53cc-bedc-49fb-a033-03b6a8f08319 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166395 Sep 13 20:15:40.237438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 916/1748] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:40 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:41.264685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-94ea6043-9ed0-4b01-a137-5c16278fab33 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:41.265652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-94ea6043-9ed0-4b01-a137-5c16278fab33 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:41.276480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-94ea6043-9ed0-4b01-a137-5c16278fab33 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:41.277273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-94ea6043-9ed0-4b01-a137-5c16278fab33 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:41.277988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-94ea6043-9ed0-4b01-a137-5c16278fab33 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:41.279168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-94ea6043-9ed0-4b01-a137-5c16278fab33 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:41.279902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-94ea6043-9ed0-4b01-a137-5c16278fab33 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:41.280590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-94ea6043-9ed0-4b01-a137-5c16278fab33 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:41.420076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-94ea6043-9ed0-4b01-a137-5c16278fab33 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:41.428586 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-94ea6043-9ed0-4b01-a137-5c16278fab33 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.170543 Sep 13 20:15:41.429281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 833/1749] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:41 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:42.454592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-69f0331f-4a5e-4afa-a3a7-7c818593cc54 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:42.455246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-69f0331f-4a5e-4afa-a3a7-7c818593cc54 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:42.463907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69f0331f-4a5e-4afa-a3a7-7c818593cc54 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:42.464382 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69f0331f-4a5e-4afa-a3a7-7c818593cc54 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:42.464809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69f0331f-4a5e-4afa-a3a7-7c818593cc54 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:42.465506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69f0331f-4a5e-4afa-a3a7-7c818593cc54 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:42.465949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69f0331f-4a5e-4afa-a3a7-7c818593cc54 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:42.466386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69f0331f-4a5e-4afa-a3a7-7c818593cc54 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:42.603978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-69f0331f-4a5e-4afa-a3a7-7c818593cc54 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:42.612721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-69f0331f-4a5e-4afa-a3a7-7c818593cc54 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164351 Sep 13 20:15:42.613294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 917/1750] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:42 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:43.639713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-270c92b3-b4df-4933-b2ce-edad1ace68e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:43.640649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-270c92b3-b4df-4933-b2ce-edad1ace68e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:43.650776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-270c92b3-b4df-4933-b2ce-edad1ace68e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:43.651503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-270c92b3-b4df-4933-b2ce-edad1ace68e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:43.652169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-270c92b3-b4df-4933-b2ce-edad1ace68e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:43.653230 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-270c92b3-b4df-4933-b2ce-edad1ace68e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:43.653917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-270c92b3-b4df-4933-b2ce-edad1ace68e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:43.654618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-270c92b3-b4df-4933-b2ce-edad1ace68e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:43.794695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-270c92b3-b4df-4933-b2ce-edad1ace68e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:43.806571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-270c92b3-b4df-4933-b2ce-edad1ace68e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.172927 Sep 13 20:15:43.807145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 834/1751] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:43 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:44.835221 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a7811420-d7bf-4c90-afd7-57d8a942e646 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:44.835861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a7811420-d7bf-4c90-afd7-57d8a942e646 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:44.846226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a7811420-d7bf-4c90-afd7-57d8a942e646 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:44.847076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a7811420-d7bf-4c90-afd7-57d8a942e646 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:44.847791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a7811420-d7bf-4c90-afd7-57d8a942e646 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:44.848923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a7811420-d7bf-4c90-afd7-57d8a942e646 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:44.849672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a7811420-d7bf-4c90-afd7-57d8a942e646 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:44.850432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a7811420-d7bf-4c90-afd7-57d8a942e646 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:44.983767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a7811420-d7bf-4c90-afd7-57d8a942e646 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:44.992260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a7811420-d7bf-4c90-afd7-57d8a942e646 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164737 Sep 13 20:15:44.992820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 918/1752] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:44 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:46.020290 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9e7ceee9-1ac5-4855-bab7-699f7793ad10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:46.021295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9e7ceee9-1ac5-4855-bab7-699f7793ad10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:46.028885 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e7ceee9-1ac5-4855-bab7-699f7793ad10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:46.029362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e7ceee9-1ac5-4855-bab7-699f7793ad10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:46.029797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e7ceee9-1ac5-4855-bab7-699f7793ad10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:46.030510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e7ceee9-1ac5-4855-bab7-699f7793ad10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:46.030949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e7ceee9-1ac5-4855-bab7-699f7793ad10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:46.031364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e7ceee9-1ac5-4855-bab7-699f7793ad10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:46.166844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9e7ceee9-1ac5-4855-bab7-699f7793ad10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:46.175197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9e7ceee9-1ac5-4855-bab7-699f7793ad10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161885 Sep 13 20:15:46.175736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 835/1753] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:46 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:47.205145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-51498ab4-2e4e-4780-a71c-71e00290fa29 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:47.206010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-51498ab4-2e4e-4780-a71c-71e00290fa29 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:47.217256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-51498ab4-2e4e-4780-a71c-71e00290fa29 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:47.218044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-51498ab4-2e4e-4780-a71c-71e00290fa29 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:47.218824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-51498ab4-2e4e-4780-a71c-71e00290fa29 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:47.219967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-51498ab4-2e4e-4780-a71c-71e00290fa29 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:47.220712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-51498ab4-2e4e-4780-a71c-71e00290fa29 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:47.221411 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-51498ab4-2e4e-4780-a71c-71e00290fa29 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:47.356798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-51498ab4-2e4e-4780-a71c-71e00290fa29 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:47.366228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-51498ab4-2e4e-4780-a71c-71e00290fa29 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167710 Sep 13 20:15:47.366837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 919/1754] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:47 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:48.391050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-34e6df47-f3a5-4137-b0d8-e562aa455c19 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:48.391663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-34e6df47-f3a5-4137-b0d8-e562aa455c19 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:48.399335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34e6df47-f3a5-4137-b0d8-e562aa455c19 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:48.399823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34e6df47-f3a5-4137-b0d8-e562aa455c19 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:48.400256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34e6df47-f3a5-4137-b0d8-e562aa455c19 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:48.400958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34e6df47-f3a5-4137-b0d8-e562aa455c19 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:48.401410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34e6df47-f3a5-4137-b0d8-e562aa455c19 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:48.401836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34e6df47-f3a5-4137-b0d8-e562aa455c19 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:48.536261 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-34e6df47-f3a5-4137-b0d8-e562aa455c19 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:48.545327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-34e6df47-f3a5-4137-b0d8-e562aa455c19 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158144 Sep 13 20:15:48.545917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 836/1755] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:48 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:49.568709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7557241d-f19a-4f64-944e-009d3ff1c4d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:49.569288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7557241d-f19a-4f64-944e-009d3ff1c4d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:49.576433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7557241d-f19a-4f64-944e-009d3ff1c4d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:49.576905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7557241d-f19a-4f64-944e-009d3ff1c4d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:49.577324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7557241d-f19a-4f64-944e-009d3ff1c4d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:49.578015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7557241d-f19a-4f64-944e-009d3ff1c4d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:49.578482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7557241d-f19a-4f64-944e-009d3ff1c4d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:49.578896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7557241d-f19a-4f64-944e-009d3ff1c4d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:49.709991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7557241d-f19a-4f64-944e-009d3ff1c4d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:49.719251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7557241d-f19a-4f64-944e-009d3ff1c4d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.154499 Sep 13 20:15:49.719817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 920/1756] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:49 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:50.758349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ae336c83-7ffb-4814-ab99-95749d9d89fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:50.759327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ae336c83-7ffb-4814-ab99-95749d9d89fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:50.769328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae336c83-7ffb-4814-ab99-95749d9d89fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:50.770142 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae336c83-7ffb-4814-ab99-95749d9d89fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:50.770925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae336c83-7ffb-4814-ab99-95749d9d89fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:50.772132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae336c83-7ffb-4814-ab99-95749d9d89fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:50.773051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae336c83-7ffb-4814-ab99-95749d9d89fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:50.773484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae336c83-7ffb-4814-ab99-95749d9d89fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:50.912335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ae336c83-7ffb-4814-ab99-95749d9d89fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:50.921615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ae336c83-7ffb-4814-ab99-95749d9d89fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169999 Sep 13 20:15:50.922196 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 837/1757] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:50 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:51.949449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cde390f2-729c-4e52-83a7-f2fe8f1ce927 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:51.950524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cde390f2-729c-4e52-83a7-f2fe8f1ce927 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:51.953913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:15:51.954188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:15:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 (ip 10.222.0.52) !!! Sep 13 20:15:51.965015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cde390f2-729c-4e52-83a7-f2fe8f1ce927 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:51.965501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cde390f2-729c-4e52-83a7-f2fe8f1ce927 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:51.965935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cde390f2-729c-4e52-83a7-f2fe8f1ce927 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:51.966658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cde390f2-729c-4e52-83a7-f2fe8f1ce927 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:51.967087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cde390f2-729c-4e52-83a7-f2fe8f1ce927 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:51.967509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cde390f2-729c-4e52-83a7-f2fe8f1ce927 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:51.970843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=92 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:52.105495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cde390f2-729c-4e52-83a7-f2fe8f1ce927 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:52.117794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cde390f2-729c-4e52-83a7-f2fe8f1ce927 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.174859 Sep 13 20:15:52.118333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 921/1758] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:51 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:53.153042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-78521c26-6618-4bec-ab42-6d1debcabf23 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:53.153844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-78521c26-6618-4bec-ab42-6d1debcabf23 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:53.157718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:15:53.157883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:15:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 (ip 10.222.0.52) !!! Sep 13 20:15:53.167539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78521c26-6618-4bec-ab42-6d1debcabf23 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:53.168026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78521c26-6618-4bec-ab42-6d1debcabf23 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:53.168451 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78521c26-6618-4bec-ab42-6d1debcabf23 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:53.169142 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78521c26-6618-4bec-ab42-6d1debcabf23 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:53.169590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78521c26-6618-4bec-ab42-6d1debcabf23 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:53.170010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-78521c26-6618-4bec-ab42-6d1debcabf23 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:53.311806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-78521c26-6618-4bec-ab42-6d1debcabf23 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:53.320368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-78521c26-6618-4bec-ab42-6d1debcabf23 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.173873 Sep 13 20:15:53.320923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 838/1759] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:53 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:54.343327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9a067955-08ed-4682-994f-ad8db1acfc5c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:54.343883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9a067955-08ed-4682-994f-ad8db1acfc5c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:54.350702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a067955-08ed-4682-994f-ad8db1acfc5c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:54.351167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a067955-08ed-4682-994f-ad8db1acfc5c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:54.351587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a067955-08ed-4682-994f-ad8db1acfc5c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:54.352261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a067955-08ed-4682-994f-ad8db1acfc5c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:54.352700 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a067955-08ed-4682-994f-ad8db1acfc5c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:54.353108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a067955-08ed-4682-994f-ad8db1acfc5c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:54.484332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9a067955-08ed-4682-994f-ad8db1acfc5c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:54.492953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9a067955-08ed-4682-994f-ad8db1acfc5c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.153493 Sep 13 20:15:54.493519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 922/1760] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:54 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:55.516673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bedc01b2-26bd-489b-90f7-dce65b51eff5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:55.517234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bedc01b2-26bd-489b-90f7-dce65b51eff5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:55.524002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bedc01b2-26bd-489b-90f7-dce65b51eff5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:55.524479 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bedc01b2-26bd-489b-90f7-dce65b51eff5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:55.524912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bedc01b2-26bd-489b-90f7-dce65b51eff5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:55.525597 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bedc01b2-26bd-489b-90f7-dce65b51eff5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:55.526042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bedc01b2-26bd-489b-90f7-dce65b51eff5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:55.526495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bedc01b2-26bd-489b-90f7-dce65b51eff5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:55.662496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bedc01b2-26bd-489b-90f7-dce65b51eff5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:55.674508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bedc01b2-26bd-489b-90f7-dce65b51eff5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161427 Sep 13 20:15:55.675340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 839/1761] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:55 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:56.703111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e71e4fe3-2850-482f-a609-ac336ce5656f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:56.704129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e71e4fe3-2850-482f-a609-ac336ce5656f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:56.713849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e71e4fe3-2850-482f-a609-ac336ce5656f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:56.714329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e71e4fe3-2850-482f-a609-ac336ce5656f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:56.714793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e71e4fe3-2850-482f-a609-ac336ce5656f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:56.715484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e71e4fe3-2850-482f-a609-ac336ce5656f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:56.715969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e71e4fe3-2850-482f-a609-ac336ce5656f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:56.716384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e71e4fe3-2850-482f-a609-ac336ce5656f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:56.847030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e71e4fe3-2850-482f-a609-ac336ce5656f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:56.855593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e71e4fe3-2850-482f-a609-ac336ce5656f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.159158 Sep 13 20:15:56.856135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 923/1762] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:56 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:57.883015 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-17ad4bcf-e73e-4e9b-ae40-38539952adad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:57.883632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-17ad4bcf-e73e-4e9b-ae40-38539952adad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:57.890908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17ad4bcf-e73e-4e9b-ae40-38539952adad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:57.891409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17ad4bcf-e73e-4e9b-ae40-38539952adad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:57.891857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17ad4bcf-e73e-4e9b-ae40-38539952adad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:57.892577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17ad4bcf-e73e-4e9b-ae40-38539952adad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:57.893043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17ad4bcf-e73e-4e9b-ae40-38539952adad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:57.893478 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17ad4bcf-e73e-4e9b-ae40-38539952adad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:58.033484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-17ad4bcf-e73e-4e9b-ae40-38539952adad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:58.042682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-17ad4bcf-e73e-4e9b-ae40-38539952adad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166086 Sep 13 20:15:58.043266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 840/1763] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:57 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:59.073478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-be861852-bcbe-49ce-88e2-2070e8dc25f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:59.074623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-be861852-bcbe-49ce-88e2-2070e8dc25f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:59.078232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=28 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:59.087807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be861852-bcbe-49ce-88e2-2070e8dc25f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:59.088597 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be861852-bcbe-49ce-88e2-2070e8dc25f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:59.089305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be861852-bcbe-49ce-88e2-2070e8dc25f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:59.090518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be861852-bcbe-49ce-88e2-2070e8dc25f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:59.091266 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be861852-bcbe-49ce-88e2-2070e8dc25f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:59.091965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be861852-bcbe-49ce-88e2-2070e8dc25f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:59.229366 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-be861852-bcbe-49ce-88e2-2070e8dc25f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:59.239869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-be861852-bcbe-49ce-88e2-2070e8dc25f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.173028 Sep 13 20:15:59.240464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 924/1764] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:59 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:00.269913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c81c4d4c-c10c-40c8-9e2d-95e1020e04a9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:00.270507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c81c4d4c-c10c-40c8-9e2d-95e1020e04a9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:00.272448 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:16:00.277993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c81c4d4c-c10c-40c8-9e2d-95e1020e04a9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:00.278503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c81c4d4c-c10c-40c8-9e2d-95e1020e04a9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:00.278939 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c81c4d4c-c10c-40c8-9e2d-95e1020e04a9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:00.279626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c81c4d4c-c10c-40c8-9e2d-95e1020e04a9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:00.280071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c81c4d4c-c10c-40c8-9e2d-95e1020e04a9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:00.280493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c81c4d4c-c10c-40c8-9e2d-95e1020e04a9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:00.284175 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=84 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:16:00.412472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c81c4d4c-c10c-40c8-9e2d-95e1020e04a9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:00.425527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c81c4d4c-c10c-40c8-9e2d-95e1020e04a9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.159416 Sep 13 20:16:00.426356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 841/1765] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:00 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:01.452618 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-33251829-a373-4ec3-bb33-88b070d1a40d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:01.453442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-33251829-a373-4ec3-bb33-88b070d1a40d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:01.463558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33251829-a373-4ec3-bb33-88b070d1a40d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:01.464239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33251829-a373-4ec3-bb33-88b070d1a40d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:01.465008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33251829-a373-4ec3-bb33-88b070d1a40d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:01.465991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33251829-a373-4ec3-bb33-88b070d1a40d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:01.466906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33251829-a373-4ec3-bb33-88b070d1a40d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:01.467579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33251829-a373-4ec3-bb33-88b070d1a40d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:01.607995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-33251829-a373-4ec3-bb33-88b070d1a40d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:01.619531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-33251829-a373-4ec3-bb33-88b070d1a40d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.172540 Sep 13 20:16:01.620128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 925/1766] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:01 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:02.647458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e3fc25ad-fcbe-429d-8207-0544c5ebd232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:02.648418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e3fc25ad-fcbe-429d-8207-0544c5ebd232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:02.656158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3fc25ad-fcbe-429d-8207-0544c5ebd232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:02.656701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3fc25ad-fcbe-429d-8207-0544c5ebd232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:02.657198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3fc25ad-fcbe-429d-8207-0544c5ebd232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:02.657952 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3fc25ad-fcbe-429d-8207-0544c5ebd232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:02.658508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3fc25ad-fcbe-429d-8207-0544c5ebd232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:02.658969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e3fc25ad-fcbe-429d-8207-0544c5ebd232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:02.799061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e3fc25ad-fcbe-429d-8207-0544c5ebd232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:02.809280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e3fc25ad-fcbe-429d-8207-0544c5ebd232 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168447 Sep 13 20:16:02.809845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 842/1767] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:02 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:03.832563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0f857c94-9965-4c20-8021-313ac53ca4af tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:03.833161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0f857c94-9965-4c20-8021-313ac53ca4af tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:03.840827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f857c94-9965-4c20-8021-313ac53ca4af tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:03.841340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f857c94-9965-4c20-8021-313ac53ca4af tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:03.841788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f857c94-9965-4c20-8021-313ac53ca4af tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:03.842514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f857c94-9965-4c20-8021-313ac53ca4af tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:03.842959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f857c94-9965-4c20-8021-313ac53ca4af tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:03.843374 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f857c94-9965-4c20-8021-313ac53ca4af tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:03.978179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0f857c94-9965-4c20-8021-313ac53ca4af tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:03.990882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0f857c94-9965-4c20-8021-313ac53ca4af tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161974 Sep 13 20:16:03.991635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 926/1768] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:03 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:05.017156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-de2d4a75-6003-454b-b746-0f050509bffa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:05.017808 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-de2d4a75-6003-454b-b746-0f050509bffa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:05.025469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de2d4a75-6003-454b-b746-0f050509bffa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:05.025957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de2d4a75-6003-454b-b746-0f050509bffa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:05.026406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de2d4a75-6003-454b-b746-0f050509bffa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:05.027109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de2d4a75-6003-454b-b746-0f050509bffa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:05.027556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de2d4a75-6003-454b-b746-0f050509bffa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:05.027976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de2d4a75-6003-454b-b746-0f050509bffa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:05.165372 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-de2d4a75-6003-454b-b746-0f050509bffa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:05.178547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-de2d4a75-6003-454b-b746-0f050509bffa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165274 Sep 13 20:16:05.179382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 843/1769] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:05 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:06.206580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a998f6ec-06d3-4614-b851-1459def77778 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:06.207485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a998f6ec-06d3-4614-b851-1459def77778 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:06.218825 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a998f6ec-06d3-4614-b851-1459def77778 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:06.219615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a998f6ec-06d3-4614-b851-1459def77778 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:06.220316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a998f6ec-06d3-4614-b851-1459def77778 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:06.221520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a998f6ec-06d3-4614-b851-1459def77778 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:06.222258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a998f6ec-06d3-4614-b851-1459def77778 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:06.222986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a998f6ec-06d3-4614-b851-1459def77778 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:06.373280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a998f6ec-06d3-4614-b851-1459def77778 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:06.383977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a998f6ec-06d3-4614-b851-1459def77778 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.183723 Sep 13 20:16:06.384791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 927/1770] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:06 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:07.413661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a1e2697b-1e3b-475b-94db-887a5649ff0c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:07.414712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a1e2697b-1e3b-475b-94db-887a5649ff0c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:07.425572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a1e2697b-1e3b-475b-94db-887a5649ff0c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:07.426429 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a1e2697b-1e3b-475b-94db-887a5649ff0c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:07.427157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a1e2697b-1e3b-475b-94db-887a5649ff0c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:07.428289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a1e2697b-1e3b-475b-94db-887a5649ff0c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:07.429037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a1e2697b-1e3b-475b-94db-887a5649ff0c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:07.429740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a1e2697b-1e3b-475b-94db-887a5649ff0c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:07.575744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a1e2697b-1e3b-475b-94db-887a5649ff0c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:07.584310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a1e2697b-1e3b-475b-94db-887a5649ff0c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.177177 Sep 13 20:16:07.584866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 844/1771] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:07 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:07.721551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b28c6195-7cb9-4206-824c-9065b46f2a35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:07.722135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b28c6195-7cb9-4206-824c-9065b46f2a35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:07.729220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b28c6195-7cb9-4206-824c-9065b46f2a35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:07.729695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b28c6195-7cb9-4206-824c-9065b46f2a35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:07.730126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b28c6195-7cb9-4206-824c-9065b46f2a35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:07.730854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b28c6195-7cb9-4206-824c-9065b46f2a35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:07.731309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b28c6195-7cb9-4206-824c-9065b46f2a35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:07.731728 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b28c6195-7cb9-4206-824c-9065b46f2a35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:07.758526 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b28c6195-7cb9-4206-824c-9065b46f2a35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Going to try to terminate instance {{(pid=120844) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:16:07.843665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b28c6195-7cb9-4206-824c-9065b46f2a35 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 204 len: 0 microversion: 2.20 time: 0.125834 Sep 13 20:16:07.844252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 928/1772] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 13 20:16:07 2022] DELETE /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 20:16:07.852712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-76b38c44-aff2-4a14-8737-1e886b6b6c76 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:07.853415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-76b38c44-aff2-4a14-8737-1e886b6b6c76 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:07.859505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-76b38c44-aff2-4a14-8737-1e886b6b6c76 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:07.859980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-76b38c44-aff2-4a14-8737-1e886b6b6c76 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:07.860408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-76b38c44-aff2-4a14-8737-1e886b6b6c76 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:07.861088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-76b38c44-aff2-4a14-8737-1e886b6b6c76 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:07.861528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-76b38c44-aff2-4a14-8737-1e886b6b6c76 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:07.861945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-76b38c44-aff2-4a14-8737-1e886b6b6c76 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:07.998647 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-76b38c44-aff2-4a14-8737-1e886b6b6c76 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:08.009385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-76b38c44-aff2-4a14-8737-1e886b6b6c76 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:08.011116 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-76b38c44-aff2-4a14-8737-1e886b6b6c76 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:08.012291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-76b38c44-aff2-4a14-8737-1e886b6b6c76 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.163577 Sep 13 20:16:08.012826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 845/1773] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:08.609454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a1a96828-804a-4e85-9d4a-1606551f7447 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:08.610085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a1a96828-804a-4e85-9d4a-1606551f7447 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:08.616557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1a96828-804a-4e85-9d4a-1606551f7447 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:08.617041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1a96828-804a-4e85-9d4a-1606551f7447 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:08.617474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1a96828-804a-4e85-9d4a-1606551f7447 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:08.618164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1a96828-804a-4e85-9d4a-1606551f7447 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:08.618661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1a96828-804a-4e85-9d4a-1606551f7447 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:08.619083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1a96828-804a-4e85-9d4a-1606551f7447 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:08.757185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a1a96828-804a-4e85-9d4a-1606551f7447 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:08.769741 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a1a96828-804a-4e85-9d4a-1606551f7447 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164442 Sep 13 20:16:08.770484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 929/1774] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:08 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:09.042652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2b258ae4-ddf5-4e1f-bfd9-562307f3ff1d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:09.043615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2b258ae4-ddf5-4e1f-bfd9-562307f3ff1d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:09.054470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b258ae4-ddf5-4e1f-bfd9-562307f3ff1d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:09.055296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b258ae4-ddf5-4e1f-bfd9-562307f3ff1d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:09.056015 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b258ae4-ddf5-4e1f-bfd9-562307f3ff1d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:09.057288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b258ae4-ddf5-4e1f-bfd9-562307f3ff1d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:09.057732 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b258ae4-ddf5-4e1f-bfd9-562307f3ff1d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:09.058162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2b258ae4-ddf5-4e1f-bfd9-562307f3ff1d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:09.194229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2b258ae4-ddf5-4e1f-bfd9-562307f3ff1d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:09.203375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2b258ae4-ddf5-4e1f-bfd9-562307f3ff1d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:09.204800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2b258ae4-ddf5-4e1f-bfd9-562307f3ff1d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:09.205953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2b258ae4-ddf5-4e1f-bfd9-562307f3ff1d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169871 Sep 13 20:16:09.206505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 846/1775] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:09.799632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d9578ce5-4b23-44f8-90b7-962048c3f51f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:09.800608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d9578ce5-4b23-44f8-90b7-962048c3f51f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:09.810103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d9578ce5-4b23-44f8-90b7-962048c3f51f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:09.810619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d9578ce5-4b23-44f8-90b7-962048c3f51f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:09.811045 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d9578ce5-4b23-44f8-90b7-962048c3f51f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:09.811732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d9578ce5-4b23-44f8-90b7-962048c3f51f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:09.812185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d9578ce5-4b23-44f8-90b7-962048c3f51f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:09.812601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d9578ce5-4b23-44f8-90b7-962048c3f51f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:09.951523 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d9578ce5-4b23-44f8-90b7-962048c3f51f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:09.960124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d9578ce5-4b23-44f8-90b7-962048c3f51f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167175 Sep 13 20:16:09.960704 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 930/1776] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:09 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:10.232450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2983ae62-8f2e-4443-9e87-02b98432afdb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:10.233087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2983ae62-8f2e-4443-9e87-02b98432afdb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:10.239788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2983ae62-8f2e-4443-9e87-02b98432afdb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:10.240261 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2983ae62-8f2e-4443-9e87-02b98432afdb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:10.240685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2983ae62-8f2e-4443-9e87-02b98432afdb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:10.241365 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2983ae62-8f2e-4443-9e87-02b98432afdb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:10.241799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2983ae62-8f2e-4443-9e87-02b98432afdb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:10.242213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2983ae62-8f2e-4443-9e87-02b98432afdb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:10.377077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2983ae62-8f2e-4443-9e87-02b98432afdb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:10.390891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2983ae62-8f2e-4443-9e87-02b98432afdb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:10.393123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2983ae62-8f2e-4443-9e87-02b98432afdb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:10.394992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2983ae62-8f2e-4443-9e87-02b98432afdb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166178 Sep 13 20:16:10.395821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 847/1777] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:10.984703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2c5c3336-51af-4fd3-9e48-fbc8fa8b70a1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:10.985299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2c5c3336-51af-4fd3-9e48-fbc8fa8b70a1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:10.992134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c5c3336-51af-4fd3-9e48-fbc8fa8b70a1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:10.992607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c5c3336-51af-4fd3-9e48-fbc8fa8b70a1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:10.993036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c5c3336-51af-4fd3-9e48-fbc8fa8b70a1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:10.993743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c5c3336-51af-4fd3-9e48-fbc8fa8b70a1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:10.994159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c5c3336-51af-4fd3-9e48-fbc8fa8b70a1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:10.994672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2c5c3336-51af-4fd3-9e48-fbc8fa8b70a1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:11.132146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2c5c3336-51af-4fd3-9e48-fbc8fa8b70a1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:11.144711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2c5c3336-51af-4fd3-9e48-fbc8fa8b70a1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.163657 Sep 13 20:16:11.145462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 931/1778] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:10 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:11.422544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d1b7cb11-7ebb-48f9-a720-8927fb1c1656 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:11.423158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d1b7cb11-7ebb-48f9-a720-8927fb1c1656 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:11.429615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1b7cb11-7ebb-48f9-a720-8927fb1c1656 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:11.430096 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1b7cb11-7ebb-48f9-a720-8927fb1c1656 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:11.430575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1b7cb11-7ebb-48f9-a720-8927fb1c1656 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:11.431263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1b7cb11-7ebb-48f9-a720-8927fb1c1656 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:11.431712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1b7cb11-7ebb-48f9-a720-8927fb1c1656 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:11.432136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1b7cb11-7ebb-48f9-a720-8927fb1c1656 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:11.565110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1b7cb11-7ebb-48f9-a720-8927fb1c1656 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:11.574798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1b7cb11-7ebb-48f9-a720-8927fb1c1656 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:11.576234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1b7cb11-7ebb-48f9-a720-8927fb1c1656 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:11.577410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d1b7cb11-7ebb-48f9-a720-8927fb1c1656 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158839 Sep 13 20:16:11.577979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 848/1779] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:11 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:12.173607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-78d6ba2d-33d7-4dca-b166-fb149daf89b8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:12.174776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-78d6ba2d-33d7-4dca-b166-fb149daf89b8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:12.185883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-78d6ba2d-33d7-4dca-b166-fb149daf89b8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:12.186760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-78d6ba2d-33d7-4dca-b166-fb149daf89b8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:12.187491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-78d6ba2d-33d7-4dca-b166-fb149daf89b8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:12.188645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-78d6ba2d-33d7-4dca-b166-fb149daf89b8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:12.189392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-78d6ba2d-33d7-4dca-b166-fb149daf89b8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:12.190087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-78d6ba2d-33d7-4dca-b166-fb149daf89b8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:12.327344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-78d6ba2d-33d7-4dca-b166-fb149daf89b8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:12.334490 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-78d6ba2d-33d7-4dca-b166-fb149daf89b8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167303 Sep 13 20:16:12.335140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 932/1780] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:12 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:12.605859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c71b46ba-f605-4047-977c-423678ef6eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:12.606668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c71b46ba-f605-4047-977c-423678ef6eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:12.615266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c71b46ba-f605-4047-977c-423678ef6eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:12.615867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c71b46ba-f605-4047-977c-423678ef6eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:12.616537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c71b46ba-f605-4047-977c-423678ef6eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:12.617279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c71b46ba-f605-4047-977c-423678ef6eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:12.617841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c71b46ba-f605-4047-977c-423678ef6eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:12.618400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c71b46ba-f605-4047-977c-423678ef6eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:12.756272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c71b46ba-f605-4047-977c-423678ef6eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:12.770245 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c71b46ba-f605-4047-977c-423678ef6eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:12.772483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c71b46ba-f605-4047-977c-423678ef6eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:12.774231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c71b46ba-f605-4047-977c-423678ef6eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173083 Sep 13 20:16:12.775014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 849/1781] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:13.359051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-42658bf2-7a20-4d3e-bf80-cc906a40071e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:13.359662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-42658bf2-7a20-4d3e-bf80-cc906a40071e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:13.366031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42658bf2-7a20-4d3e-bf80-cc906a40071e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:13.366513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42658bf2-7a20-4d3e-bf80-cc906a40071e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:13.366971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42658bf2-7a20-4d3e-bf80-cc906a40071e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:13.367620 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42658bf2-7a20-4d3e-bf80-cc906a40071e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:13.368085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42658bf2-7a20-4d3e-bf80-cc906a40071e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:13.368480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-42658bf2-7a20-4d3e-bf80-cc906a40071e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:13.494501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-42658bf2-7a20-4d3e-bf80-cc906a40071e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:13.503284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-42658bf2-7a20-4d3e-bf80-cc906a40071e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.148116 Sep 13 20:16:13.503822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 933/1782] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:13 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:13.804272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-aac738a1-caa2-4517-bab8-b353ddaf8ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:13.805335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-aac738a1-caa2-4517-bab8-b353ddaf8ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:13.816246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aac738a1-caa2-4517-bab8-b353ddaf8ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:13.817040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aac738a1-caa2-4517-bab8-b353ddaf8ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:13.817772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aac738a1-caa2-4517-bab8-b353ddaf8ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:13.818967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aac738a1-caa2-4517-bab8-b353ddaf8ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:13.819723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aac738a1-caa2-4517-bab8-b353ddaf8ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:13.820436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aac738a1-caa2-4517-bab8-b353ddaf8ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:13.952570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-aac738a1-caa2-4517-bab8-b353ddaf8ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:13.963539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-aac738a1-caa2-4517-bab8-b353ddaf8ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:13.965060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-aac738a1-caa2-4517-bab8-b353ddaf8ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:13.966220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-aac738a1-caa2-4517-bab8-b353ddaf8ce9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168662 Sep 13 20:16:13.966836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 850/1783] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:14.527141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ba22bb49-d716-46ff-a19e-6f1a44ed3560 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:14.527714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ba22bb49-d716-46ff-a19e-6f1a44ed3560 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:14.534581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba22bb49-d716-46ff-a19e-6f1a44ed3560 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:14.535058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba22bb49-d716-46ff-a19e-6f1a44ed3560 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:14.535484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba22bb49-d716-46ff-a19e-6f1a44ed3560 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:14.536171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba22bb49-d716-46ff-a19e-6f1a44ed3560 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:14.536616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba22bb49-d716-46ff-a19e-6f1a44ed3560 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:14.537036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba22bb49-d716-46ff-a19e-6f1a44ed3560 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:14.678497 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ba22bb49-d716-46ff-a19e-6f1a44ed3560 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:14.687075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ba22bb49-d716-46ff-a19e-6f1a44ed3560 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.163809 Sep 13 20:16:14.687645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 934/1784] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:14 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:14.995478 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1b3cfbb7-1612-4cb7-b7c8-70c1898d4c09 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:14.996089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1b3cfbb7-1612-4cb7-b7c8-70c1898d4c09 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:15.002976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1b3cfbb7-1612-4cb7-b7c8-70c1898d4c09 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:15.003451 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1b3cfbb7-1612-4cb7-b7c8-70c1898d4c09 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:15.003876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1b3cfbb7-1612-4cb7-b7c8-70c1898d4c09 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:15.004559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1b3cfbb7-1612-4cb7-b7c8-70c1898d4c09 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:15.004996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1b3cfbb7-1612-4cb7-b7c8-70c1898d4c09 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:15.005412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1b3cfbb7-1612-4cb7-b7c8-70c1898d4c09 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:15.145390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1b3cfbb7-1612-4cb7-b7c8-70c1898d4c09 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:15.154734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1b3cfbb7-1612-4cb7-b7c8-70c1898d4c09 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:15.156168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1b3cfbb7-1612-4cb7-b7c8-70c1898d4c09 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:15.157334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1b3cfbb7-1612-4cb7-b7c8-70c1898d4c09 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168391 Sep 13 20:16:15.157890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 851/1785] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:15.715133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ebbb3dc9-f954-4742-b104-01beb648795a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:15.716146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ebbb3dc9-f954-4742-b104-01beb648795a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:15.727031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ebbb3dc9-f954-4742-b104-01beb648795a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:15.727826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ebbb3dc9-f954-4742-b104-01beb648795a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:15.728546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ebbb3dc9-f954-4742-b104-01beb648795a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:15.729686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ebbb3dc9-f954-4742-b104-01beb648795a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:15.730435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ebbb3dc9-f954-4742-b104-01beb648795a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:15.731172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ebbb3dc9-f954-4742-b104-01beb648795a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:15.873880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ebbb3dc9-f954-4742-b104-01beb648795a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:15.882289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ebbb3dc9-f954-4742-b104-01beb648795a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.174085 Sep 13 20:16:15.882887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 935/1786] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:15 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:16.187545 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c05719ef-42ac-4a71-97fb-0a79567e31a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:16.188410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c05719ef-42ac-4a71-97fb-0a79567e31a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:16.198690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c05719ef-42ac-4a71-97fb-0a79567e31a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:16.199169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c05719ef-42ac-4a71-97fb-0a79567e31a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:16.199603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c05719ef-42ac-4a71-97fb-0a79567e31a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:16.200288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c05719ef-42ac-4a71-97fb-0a79567e31a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:16.200730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c05719ef-42ac-4a71-97fb-0a79567e31a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:16.201150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c05719ef-42ac-4a71-97fb-0a79567e31a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:16.338311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c05719ef-42ac-4a71-97fb-0a79567e31a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:16.347495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c05719ef-42ac-4a71-97fb-0a79567e31a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:16.348949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c05719ef-42ac-4a71-97fb-0a79567e31a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:16.350120 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c05719ef-42ac-4a71-97fb-0a79567e31a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169338 Sep 13 20:16:16.350722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 852/1787] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:16 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:16.909441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-554e90d0-6fc5-4392-a562-ee9027758cb1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:16.910340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-554e90d0-6fc5-4392-a562-ee9027758cb1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:16.919870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-554e90d0-6fc5-4392-a562-ee9027758cb1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:16.920343 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-554e90d0-6fc5-4392-a562-ee9027758cb1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:16.920768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-554e90d0-6fc5-4392-a562-ee9027758cb1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:16.921444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-554e90d0-6fc5-4392-a562-ee9027758cb1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:16.921884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-554e90d0-6fc5-4392-a562-ee9027758cb1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:16.922291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-554e90d0-6fc5-4392-a562-ee9027758cb1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:16.924912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:16:17.059922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-554e90d0-6fc5-4392-a562-ee9027758cb1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:17.068833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-554e90d0-6fc5-4392-a562-ee9027758cb1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166050 Sep 13 20:16:17.069402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 936/1788] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:16 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:17.380081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8e318c58-ccc1-4b64-b46d-2f972d5607db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:17.381005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8e318c58-ccc1-4b64-b46d-2f972d5607db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:17.389962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e318c58-ccc1-4b64-b46d-2f972d5607db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:17.390473 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e318c58-ccc1-4b64-b46d-2f972d5607db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:17.390905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e318c58-ccc1-4b64-b46d-2f972d5607db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:17.391619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e318c58-ccc1-4b64-b46d-2f972d5607db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:17.392067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e318c58-ccc1-4b64-b46d-2f972d5607db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:17.392485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e318c58-ccc1-4b64-b46d-2f972d5607db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:17.522178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8e318c58-ccc1-4b64-b46d-2f972d5607db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:17.535859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8e318c58-ccc1-4b64-b46d-2f972d5607db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:17.538013 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8e318c58-ccc1-4b64-b46d-2f972d5607db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:17.539776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8e318c58-ccc1-4b64-b46d-2f972d5607db tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166114 Sep 13 20:16:17.540543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 853/1789] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:17 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:18.096999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5b246a90-b8d2-4320-98ab-8912c09f2001 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:18.098019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5b246a90-b8d2-4320-98ab-8912c09f2001 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:18.107587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b246a90-b8d2-4320-98ab-8912c09f2001 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:18.108068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b246a90-b8d2-4320-98ab-8912c09f2001 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:18.108498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b246a90-b8d2-4320-98ab-8912c09f2001 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:18.109223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b246a90-b8d2-4320-98ab-8912c09f2001 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:18.109667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b246a90-b8d2-4320-98ab-8912c09f2001 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:18.110086 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b246a90-b8d2-4320-98ab-8912c09f2001 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:18.245461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5b246a90-b8d2-4320-98ab-8912c09f2001 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:18.257876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5b246a90-b8d2-4320-98ab-8912c09f2001 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167516 Sep 13 20:16:18.258469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 937/1790] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:18 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:18.567174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9b1c5c3a-efd3-4b90-bcb4-9ec558044ff3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:18.567792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9b1c5c3a-efd3-4b90-bcb4-9ec558044ff3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:18.575566 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b1c5c3a-efd3-4b90-bcb4-9ec558044ff3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:18.576096 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b1c5c3a-efd3-4b90-bcb4-9ec558044ff3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:18.576570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b1c5c3a-efd3-4b90-bcb4-9ec558044ff3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:18.577332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b1c5c3a-efd3-4b90-bcb4-9ec558044ff3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:18.577825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b1c5c3a-efd3-4b90-bcb4-9ec558044ff3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:18.578293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b1c5c3a-efd3-4b90-bcb4-9ec558044ff3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:18.713003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9b1c5c3a-efd3-4b90-bcb4-9ec558044ff3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:18.721945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9b1c5c3a-efd3-4b90-bcb4-9ec558044ff3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:18.723417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9b1c5c3a-efd3-4b90-bcb4-9ec558044ff3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:18.724576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9b1c5c3a-efd3-4b90-bcb4-9ec558044ff3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161849 Sep 13 20:16:18.725575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 854/1791] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:19.282317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-88b4fd3c-bd15-4400-86a9-42161451c887 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:19.282984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-88b4fd3c-bd15-4400-86a9-42161451c887 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:19.290066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88b4fd3c-bd15-4400-86a9-42161451c887 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:19.290603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88b4fd3c-bd15-4400-86a9-42161451c887 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:19.291032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88b4fd3c-bd15-4400-86a9-42161451c887 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:19.291720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88b4fd3c-bd15-4400-86a9-42161451c887 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:19.292167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88b4fd3c-bd15-4400-86a9-42161451c887 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:19.292583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88b4fd3c-bd15-4400-86a9-42161451c887 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:19.418999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-88b4fd3c-bd15-4400-86a9-42161451c887 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:19.427256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-88b4fd3c-bd15-4400-86a9-42161451c887 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.148938 Sep 13 20:16:19.427838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 938/1792] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:19 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:19.754215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-74c1baa2-7f2e-4900-83b4-4c2321e6aabe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:19.755466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-74c1baa2-7f2e-4900-83b4-4c2321e6aabe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:19.764211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74c1baa2-7f2e-4900-83b4-4c2321e6aabe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:19.764673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74c1baa2-7f2e-4900-83b4-4c2321e6aabe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:19.765450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74c1baa2-7f2e-4900-83b4-4c2321e6aabe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:19.766140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74c1baa2-7f2e-4900-83b4-4c2321e6aabe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:19.766615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74c1baa2-7f2e-4900-83b4-4c2321e6aabe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:19.767036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74c1baa2-7f2e-4900-83b4-4c2321e6aabe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:19.896764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-74c1baa2-7f2e-4900-83b4-4c2321e6aabe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:19.906057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-74c1baa2-7f2e-4900-83b4-4c2321e6aabe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:19.907549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-74c1baa2-7f2e-4900-83b4-4c2321e6aabe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:19.908701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-74c1baa2-7f2e-4900-83b4-4c2321e6aabe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161064 Sep 13 20:16:19.909255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 855/1793] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:20.455011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-58bba463-5ec7-416a-9b1a-5e6481773915 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:20.455951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-58bba463-5ec7-416a-9b1a-5e6481773915 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:20.467109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-58bba463-5ec7-416a-9b1a-5e6481773915 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:20.467891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-58bba463-5ec7-416a-9b1a-5e6481773915 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:20.468589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-58bba463-5ec7-416a-9b1a-5e6481773915 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:20.469708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-58bba463-5ec7-416a-9b1a-5e6481773915 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:20.470428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-58bba463-5ec7-416a-9b1a-5e6481773915 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:20.471201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-58bba463-5ec7-416a-9b1a-5e6481773915 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:20.609392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-58bba463-5ec7-416a-9b1a-5e6481773915 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:20.617971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-58bba463-5ec7-416a-9b1a-5e6481773915 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169531 Sep 13 20:16:20.618652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 939/1794] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:20 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:20.935085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a5ea5f21-c135-4b8c-a00f-db7cc35bbe63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:20.935673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a5ea5f21-c135-4b8c-a00f-db7cc35bbe63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:20.942278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5ea5f21-c135-4b8c-a00f-db7cc35bbe63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:20.942788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5ea5f21-c135-4b8c-a00f-db7cc35bbe63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:20.943221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5ea5f21-c135-4b8c-a00f-db7cc35bbe63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:20.943903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5ea5f21-c135-4b8c-a00f-db7cc35bbe63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:20.944354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5ea5f21-c135-4b8c-a00f-db7cc35bbe63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:20.944823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a5ea5f21-c135-4b8c-a00f-db7cc35bbe63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:21.092382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a5ea5f21-c135-4b8c-a00f-db7cc35bbe63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:21.101391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a5ea5f21-c135-4b8c-a00f-db7cc35bbe63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:21.102863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a5ea5f21-c135-4b8c-a00f-db7cc35bbe63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:21.104024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a5ea5f21-c135-4b8c-a00f-db7cc35bbe63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172914 Sep 13 20:16:21.104581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 856/1795] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:21.649910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f1514450-08fa-4d0c-92d7-df4a8e77816c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:21.651020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f1514450-08fa-4d0c-92d7-df4a8e77816c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:21.657923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1514450-08fa-4d0c-92d7-df4a8e77816c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:21.658410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1514450-08fa-4d0c-92d7-df4a8e77816c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:21.658857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1514450-08fa-4d0c-92d7-df4a8e77816c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:21.659572 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1514450-08fa-4d0c-92d7-df4a8e77816c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:21.660016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1514450-08fa-4d0c-92d7-df4a8e77816c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:21.660431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1514450-08fa-4d0c-92d7-df4a8e77816c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:21.796259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f1514450-08fa-4d0c-92d7-df4a8e77816c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:21.804866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f1514450-08fa-4d0c-92d7-df4a8e77816c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165527 Sep 13 20:16:21.805441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 940/1796] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:21 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:22.133674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-935ce597-a924-4d31-b6b5-5a67683bded5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:22.134544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-935ce597-a924-4d31-b6b5-5a67683bded5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:22.142198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-935ce597-a924-4d31-b6b5-5a67683bded5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:22.142709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-935ce597-a924-4d31-b6b5-5a67683bded5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:22.143144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-935ce597-a924-4d31-b6b5-5a67683bded5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:22.143841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-935ce597-a924-4d31-b6b5-5a67683bded5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:22.144292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-935ce597-a924-4d31-b6b5-5a67683bded5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:22.144717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-935ce597-a924-4d31-b6b5-5a67683bded5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:22.296850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-935ce597-a924-4d31-b6b5-5a67683bded5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:22.299114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:16:22.306945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-935ce597-a924-4d31-b6b5-5a67683bded5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:22.308474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-935ce597-a924-4d31-b6b5-5a67683bded5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:22.309610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-935ce597-a924-4d31-b6b5-5a67683bded5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.182300 Sep 13 20:16:22.310193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 857/1797] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:22 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:22.832895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8c0c1e70-8246-4aaa-83c3-2cc503c157d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:22.833766 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8c0c1e70-8246-4aaa-83c3-2cc503c157d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:22.845042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c0c1e70-8246-4aaa-83c3-2cc503c157d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:22.845852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c0c1e70-8246-4aaa-83c3-2cc503c157d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:22.846619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c0c1e70-8246-4aaa-83c3-2cc503c157d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:22.847753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c0c1e70-8246-4aaa-83c3-2cc503c157d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:22.848476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c0c1e70-8246-4aaa-83c3-2cc503c157d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:22.849184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c0c1e70-8246-4aaa-83c3-2cc503c157d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:22.984957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8c0c1e70-8246-4aaa-83c3-2cc503c157d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:22.993382 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8c0c1e70-8246-4aaa-83c3-2cc503c157d0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167294 Sep 13 20:16:22.994419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 941/1798] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:22 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:23.338699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-00984e03-b585-4ee5-84b7-29841fce1cbd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:23.339710 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-00984e03-b585-4ee5-84b7-29841fce1cbd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:23.350842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00984e03-b585-4ee5-84b7-29841fce1cbd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:23.351614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00984e03-b585-4ee5-84b7-29841fce1cbd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:23.352366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00984e03-b585-4ee5-84b7-29841fce1cbd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:23.353508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00984e03-b585-4ee5-84b7-29841fce1cbd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:23.354260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00984e03-b585-4ee5-84b7-29841fce1cbd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:23.355029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00984e03-b585-4ee5-84b7-29841fce1cbd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:23.496618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-00984e03-b585-4ee5-84b7-29841fce1cbd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:23.505652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-00984e03-b585-4ee5-84b7-29841fce1cbd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:23.507140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-00984e03-b585-4ee5-84b7-29841fce1cbd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:23.508315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-00984e03-b585-4ee5-84b7-29841fce1cbd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.176708 Sep 13 20:16:23.508918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 858/1799] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:23 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:24.021239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8ae1b81b-4030-41a0-b445-0106a1b48ae9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:24.022261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8ae1b81b-4030-41a0-b445-0106a1b48ae9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:24.031546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ae1b81b-4030-41a0-b445-0106a1b48ae9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:24.032015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ae1b81b-4030-41a0-b445-0106a1b48ae9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:24.032433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ae1b81b-4030-41a0-b445-0106a1b48ae9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:24.033142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ae1b81b-4030-41a0-b445-0106a1b48ae9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:24.033581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ae1b81b-4030-41a0-b445-0106a1b48ae9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:24.033994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ae1b81b-4030-41a0-b445-0106a1b48ae9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:24.170791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8ae1b81b-4030-41a0-b445-0106a1b48ae9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:24.179240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8ae1b81b-4030-41a0-b445-0106a1b48ae9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164489 Sep 13 20:16:24.179790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 942/1800] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:24 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:24.537573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7f55d63c-9421-4eff-8b0c-a607c06c143c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:24.538559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7f55d63c-9421-4eff-8b0c-a607c06c143c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:24.549594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f55d63c-9421-4eff-8b0c-a607c06c143c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:24.550432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f55d63c-9421-4eff-8b0c-a607c06c143c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:24.551179 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f55d63c-9421-4eff-8b0c-a607c06c143c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:24.552334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f55d63c-9421-4eff-8b0c-a607c06c143c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:24.553074 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f55d63c-9421-4eff-8b0c-a607c06c143c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:24.553778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f55d63c-9421-4eff-8b0c-a607c06c143c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:24.686402 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7f55d63c-9421-4eff-8b0c-a607c06c143c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:24.695389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7f55d63c-9421-4eff-8b0c-a607c06c143c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:24.696845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7f55d63c-9421-4eff-8b0c-a607c06c143c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:24.698005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7f55d63c-9421-4eff-8b0c-a607c06c143c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167026 Sep 13 20:16:24.698595 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 859/1801] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:25.202940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-711596f9-25ba-4436-ad9f-10c8fd0d9b1a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:25.203499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-711596f9-25ba-4436-ad9f-10c8fd0d9b1a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:25.210336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-711596f9-25ba-4436-ad9f-10c8fd0d9b1a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:25.210851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-711596f9-25ba-4436-ad9f-10c8fd0d9b1a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:25.211637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-711596f9-25ba-4436-ad9f-10c8fd0d9b1a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:25.212344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-711596f9-25ba-4436-ad9f-10c8fd0d9b1a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:25.212784 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-711596f9-25ba-4436-ad9f-10c8fd0d9b1a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:25.213191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-711596f9-25ba-4436-ad9f-10c8fd0d9b1a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:25.353509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-711596f9-25ba-4436-ad9f-10c8fd0d9b1a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:25.366358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-711596f9-25ba-4436-ad9f-10c8fd0d9b1a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166979 Sep 13 20:16:25.367274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 943/1802] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:25 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:25.728044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-aea2f990-dd71-4754-9ccc-9d16e23d1803 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:25.729077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-aea2f990-dd71-4754-9ccc-9d16e23d1803 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:25.736822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aea2f990-dd71-4754-9ccc-9d16e23d1803 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:25.737302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aea2f990-dd71-4754-9ccc-9d16e23d1803 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:25.737737 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aea2f990-dd71-4754-9ccc-9d16e23d1803 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:25.738467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aea2f990-dd71-4754-9ccc-9d16e23d1803 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:25.738913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aea2f990-dd71-4754-9ccc-9d16e23d1803 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:25.739333 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-aea2f990-dd71-4754-9ccc-9d16e23d1803 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:25.875607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-aea2f990-dd71-4754-9ccc-9d16e23d1803 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:25.884409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-aea2f990-dd71-4754-9ccc-9d16e23d1803 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:25.885844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-aea2f990-dd71-4754-9ccc-9d16e23d1803 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:25.887037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-aea2f990-dd71-4754-9ccc-9d16e23d1803 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165677 Sep 13 20:16:25.887730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 860/1803] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:26.394071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b1bbf0c5-9c0d-4bea-a909-65fe2c6bd859 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:26.395140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b1bbf0c5-9c0d-4bea-a909-65fe2c6bd859 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:26.406593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1bbf0c5-9c0d-4bea-a909-65fe2c6bd859 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:26.407332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1bbf0c5-9c0d-4bea-a909-65fe2c6bd859 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:26.408043 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1bbf0c5-9c0d-4bea-a909-65fe2c6bd859 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:26.409344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1bbf0c5-9c0d-4bea-a909-65fe2c6bd859 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:26.410091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1bbf0c5-9c0d-4bea-a909-65fe2c6bd859 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:26.410862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b1bbf0c5-9c0d-4bea-a909-65fe2c6bd859 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:26.555002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b1bbf0c5-9c0d-4bea-a909-65fe2c6bd859 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:26.563611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b1bbf0c5-9c0d-4bea-a909-65fe2c6bd859 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.175838 Sep 13 20:16:26.563927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 944/1804] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:26 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:26.912822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-060d9357-39b3-48e1-be5b-e15f2ebebdfe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:26.913405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-060d9357-39b3-48e1-be5b-e15f2ebebdfe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:26.920023 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-060d9357-39b3-48e1-be5b-e15f2ebebdfe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:26.920580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-060d9357-39b3-48e1-be5b-e15f2ebebdfe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:26.920944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-060d9357-39b3-48e1-be5b-e15f2ebebdfe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:26.921623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-060d9357-39b3-48e1-be5b-e15f2ebebdfe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:26.922063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-060d9357-39b3-48e1-be5b-e15f2ebebdfe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:26.922510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-060d9357-39b3-48e1-be5b-e15f2ebebdfe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:27.063597 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-060d9357-39b3-48e1-be5b-e15f2ebebdfe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:27.072878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-060d9357-39b3-48e1-be5b-e15f2ebebdfe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:27.074301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-060d9357-39b3-48e1-be5b-e15f2ebebdfe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:27.075531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-060d9357-39b3-48e1-be5b-e15f2ebebdfe tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166731 Sep 13 20:16:27.076123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 861/1805] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:27.588617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d0fe17c8-9347-4f77-a2d3-acab69e36d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:27.589238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d0fe17c8-9347-4f77-a2d3-acab69e36d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:27.596303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0fe17c8-9347-4f77-a2d3-acab69e36d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:27.596781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0fe17c8-9347-4f77-a2d3-acab69e36d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:27.597205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0fe17c8-9347-4f77-a2d3-acab69e36d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:27.597888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0fe17c8-9347-4f77-a2d3-acab69e36d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:27.598332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0fe17c8-9347-4f77-a2d3-acab69e36d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:27.598783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0fe17c8-9347-4f77-a2d3-acab69e36d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:27.728777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d0fe17c8-9347-4f77-a2d3-acab69e36d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:27.741029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d0fe17c8-9347-4f77-a2d3-acab69e36d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.156401 Sep 13 20:16:27.741682 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 945/1806] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:27 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:28.105725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e84257c4-8fea-4fe5-8f1e-ee322826c014 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:28.106695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e84257c4-8fea-4fe5-8f1e-ee322826c014 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:28.113882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e84257c4-8fea-4fe5-8f1e-ee322826c014 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:28.114382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e84257c4-8fea-4fe5-8f1e-ee322826c014 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:28.114881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e84257c4-8fea-4fe5-8f1e-ee322826c014 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:28.115615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e84257c4-8fea-4fe5-8f1e-ee322826c014 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:28.116088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e84257c4-8fea-4fe5-8f1e-ee322826c014 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:28.116546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e84257c4-8fea-4fe5-8f1e-ee322826c014 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:28.257311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e84257c4-8fea-4fe5-8f1e-ee322826c014 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:28.266320 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e84257c4-8fea-4fe5-8f1e-ee322826c014 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:28.267859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e84257c4-8fea-4fe5-8f1e-ee322826c014 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:28.269021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e84257c4-8fea-4fe5-8f1e-ee322826c014 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.170077 Sep 13 20:16:28.269633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 862/1807] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:28.770893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-13cdeb88-08f5-4046-9a66-1d773f9e0267 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:28.771858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-13cdeb88-08f5-4046-9a66-1d773f9e0267 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:28.782860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-13cdeb88-08f5-4046-9a66-1d773f9e0267 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:28.783648 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-13cdeb88-08f5-4046-9a66-1d773f9e0267 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:28.784355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-13cdeb88-08f5-4046-9a66-1d773f9e0267 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:28.785478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-13cdeb88-08f5-4046-9a66-1d773f9e0267 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:28.786212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-13cdeb88-08f5-4046-9a66-1d773f9e0267 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:28.786953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-13cdeb88-08f5-4046-9a66-1d773f9e0267 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:28.923181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-13cdeb88-08f5-4046-9a66-1d773f9e0267 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:28.931826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-13cdeb88-08f5-4046-9a66-1d773f9e0267 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167644 Sep 13 20:16:28.932413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 946/1808] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:28 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:29.299513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d28d13ba-b1bc-47ac-bcfe-9bab31a05819 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:29.300896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d28d13ba-b1bc-47ac-bcfe-9bab31a05819 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:29.311756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d28d13ba-b1bc-47ac-bcfe-9bab31a05819 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:29.312550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d28d13ba-b1bc-47ac-bcfe-9bab31a05819 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:29.313266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d28d13ba-b1bc-47ac-bcfe-9bab31a05819 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:29.314442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d28d13ba-b1bc-47ac-bcfe-9bab31a05819 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:29.315190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d28d13ba-b1bc-47ac-bcfe-9bab31a05819 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:29.315888 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d28d13ba-b1bc-47ac-bcfe-9bab31a05819 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:29.452651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d28d13ba-b1bc-47ac-bcfe-9bab31a05819 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:29.461935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d28d13ba-b1bc-47ac-bcfe-9bab31a05819 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:29.463403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d28d13ba-b1bc-47ac-bcfe-9bab31a05819 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:29.464557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d28d13ba-b1bc-47ac-bcfe-9bab31a05819 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.171955 Sep 13 20:16:29.465127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 863/1809] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:29 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:29.959655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-59260181-871c-4a52-944c-6b83cdacd550 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:29.960500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-59260181-871c-4a52-944c-6b83cdacd550 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:29.964614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:16:29.971508 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59260181-871c-4a52-944c-6b83cdacd550 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:29.971982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59260181-871c-4a52-944c-6b83cdacd550 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:29.972409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59260181-871c-4a52-944c-6b83cdacd550 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:29.973095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59260181-871c-4a52-944c-6b83cdacd550 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:29.973541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59260181-871c-4a52-944c-6b83cdacd550 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:29.973956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-59260181-871c-4a52-944c-6b83cdacd550 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:30.112262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-59260181-871c-4a52-944c-6b83cdacd550 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:30.120688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-59260181-871c-4a52-944c-6b83cdacd550 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167700 Sep 13 20:16:30.121257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 947/1810] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:29 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:30.495701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-529e9d76-c231-430b-95ba-e3896c1d7c65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:30.496305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-529e9d76-c231-430b-95ba-e3896c1d7c65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:30.498185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=46 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:16:30.503606 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-529e9d76-c231-430b-95ba-e3896c1d7c65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:30.504076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-529e9d76-c231-430b-95ba-e3896c1d7c65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:30.504503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-529e9d76-c231-430b-95ba-e3896c1d7c65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:30.505183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-529e9d76-c231-430b-95ba-e3896c1d7c65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:30.505621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-529e9d76-c231-430b-95ba-e3896c1d7c65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:30.506036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-529e9d76-c231-430b-95ba-e3896c1d7c65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:30.639948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-529e9d76-c231-430b-95ba-e3896c1d7c65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:30.649155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-529e9d76-c231-430b-95ba-e3896c1d7c65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:30.650542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-529e9d76-c231-430b-95ba-e3896c1d7c65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:30.651694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-529e9d76-c231-430b-95ba-e3896c1d7c65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.160152 Sep 13 20:16:30.652287 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 864/1811] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:30 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:31.155122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-57ccab8d-0cee-470d-81ff-f67176d5ddba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:31.155753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-57ccab8d-0cee-470d-81ff-f67176d5ddba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:31.162579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-57ccab8d-0cee-470d-81ff-f67176d5ddba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:31.163057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-57ccab8d-0cee-470d-81ff-f67176d5ddba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:31.163494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-57ccab8d-0cee-470d-81ff-f67176d5ddba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:31.164188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-57ccab8d-0cee-470d-81ff-f67176d5ddba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:31.164640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-57ccab8d-0cee-470d-81ff-f67176d5ddba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:31.165057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-57ccab8d-0cee-470d-81ff-f67176d5ddba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:31.307812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-57ccab8d-0cee-470d-81ff-f67176d5ddba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:31.316698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-57ccab8d-0cee-470d-81ff-f67176d5ddba tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168417 Sep 13 20:16:31.317272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 948/1812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:31 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:31.681932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-22fff294-deae-4589-a49d-e7c3524fa801 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:31.682980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-22fff294-deae-4589-a49d-e7c3524fa801 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:31.693973 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22fff294-deae-4589-a49d-e7c3524fa801 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:31.694806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22fff294-deae-4589-a49d-e7c3524fa801 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:31.695538 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22fff294-deae-4589-a49d-e7c3524fa801 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:31.696662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22fff294-deae-4589-a49d-e7c3524fa801 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:31.697432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22fff294-deae-4589-a49d-e7c3524fa801 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:31.698135 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22fff294-deae-4589-a49d-e7c3524fa801 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:31.832482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-22fff294-deae-4589-a49d-e7c3524fa801 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:31.844809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-22fff294-deae-4589-a49d-e7c3524fa801 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:31.847268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-22fff294-deae-4589-a49d-e7c3524fa801 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:31.849107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-22fff294-deae-4589-a49d-e7c3524fa801 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173399 Sep 13 20:16:31.849999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 865/1813] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:32.344599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f0223dc2-d1e6-4257-b295-4e45cb0e3251 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:32.345587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f0223dc2-d1e6-4257-b295-4e45cb0e3251 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:32.356415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0223dc2-d1e6-4257-b295-4e45cb0e3251 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:32.357230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0223dc2-d1e6-4257-b295-4e45cb0e3251 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:32.358045 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0223dc2-d1e6-4257-b295-4e45cb0e3251 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:32.358789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0223dc2-d1e6-4257-b295-4e45cb0e3251 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:32.359237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0223dc2-d1e6-4257-b295-4e45cb0e3251 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:32.359656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0223dc2-d1e6-4257-b295-4e45cb0e3251 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:32.497244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f0223dc2-d1e6-4257-b295-4e45cb0e3251 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:32.506213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f0223dc2-d1e6-4257-b295-4e45cb0e3251 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168356 Sep 13 20:16:32.506838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 949/1814] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:32 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:32.881614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f50edd1c-2f66-4766-9099-3f4b1ab0363d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:32.882594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f50edd1c-2f66-4766-9099-3f4b1ab0363d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:32.898946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f50edd1c-2f66-4766-9099-3f4b1ab0363d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:32.898946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f50edd1c-2f66-4766-9099-3f4b1ab0363d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:32.898946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f50edd1c-2f66-4766-9099-3f4b1ab0363d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:32.898946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f50edd1c-2f66-4766-9099-3f4b1ab0363d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:32.899998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f50edd1c-2f66-4766-9099-3f4b1ab0363d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:32.899998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f50edd1c-2f66-4766-9099-3f4b1ab0363d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:33.032315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f50edd1c-2f66-4766-9099-3f4b1ab0363d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:33.041044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f50edd1c-2f66-4766-9099-3f4b1ab0363d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:33.042524 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f50edd1c-2f66-4766-9099-3f4b1ab0363d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:33.043686 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f50edd1c-2f66-4766-9099-3f4b1ab0363d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168764 Sep 13 20:16:33.044253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 866/1815] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:33.530987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-08962ceb-2ebf-4c7f-b930-a4465df4437c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:33.531696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-08962ceb-2ebf-4c7f-b930-a4465df4437c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:33.539849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08962ceb-2ebf-4c7f-b930-a4465df4437c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:33.540407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08962ceb-2ebf-4c7f-b930-a4465df4437c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:33.540907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08962ceb-2ebf-4c7f-b930-a4465df4437c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:33.541711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08962ceb-2ebf-4c7f-b930-a4465df4437c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:33.542235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08962ceb-2ebf-4c7f-b930-a4465df4437c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:33.542773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08962ceb-2ebf-4c7f-b930-a4465df4437c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:33.679908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-08962ceb-2ebf-4c7f-b930-a4465df4437c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:33.688606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-08962ceb-2ebf-4c7f-b930-a4465df4437c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.162385 Sep 13 20:16:33.689173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 950/1816] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:33 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:34.072941 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-547338fd-f5e0-4f70-9877-c6561caf95a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:34.073926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-547338fd-f5e0-4f70-9877-c6561caf95a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:34.081808 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-547338fd-f5e0-4f70-9877-c6561caf95a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:34.082256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-547338fd-f5e0-4f70-9877-c6561caf95a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:34.082737 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-547338fd-f5e0-4f70-9877-c6561caf95a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:34.083421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-547338fd-f5e0-4f70-9877-c6561caf95a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:34.083862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-547338fd-f5e0-4f70-9877-c6561caf95a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:34.084278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-547338fd-f5e0-4f70-9877-c6561caf95a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:34.217551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-547338fd-f5e0-4f70-9877-c6561caf95a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:34.226299 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-547338fd-f5e0-4f70-9877-c6561caf95a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:34.227743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-547338fd-f5e0-4f70-9877-c6561caf95a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:34.228902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-547338fd-f5e0-4f70-9877-c6561caf95a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162668 Sep 13 20:16:34.229463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 867/1817] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:34 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:34.713304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0e4a876e-8bf9-491c-9b35-3f1371e7a515 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:34.713916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0e4a876e-8bf9-491c-9b35-3f1371e7a515 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:34.722304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e4a876e-8bf9-491c-9b35-3f1371e7a515 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:34.722826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e4a876e-8bf9-491c-9b35-3f1371e7a515 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:34.723357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e4a876e-8bf9-491c-9b35-3f1371e7a515 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:34.724423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e4a876e-8bf9-491c-9b35-3f1371e7a515 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:34.725025 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e4a876e-8bf9-491c-9b35-3f1371e7a515 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:34.725482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e4a876e-8bf9-491c-9b35-3f1371e7a515 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:34.857405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0e4a876e-8bf9-491c-9b35-3f1371e7a515 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:34.866733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0e4a876e-8bf9-491c-9b35-3f1371e7a515 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158202 Sep 13 20:16:34.867307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 951/1818] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:34 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:35.258177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-09b8d834-e855-4e1e-af96-514f82f82c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:35.259226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-09b8d834-e855-4e1e-af96-514f82f82c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:35.268309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09b8d834-e855-4e1e-af96-514f82f82c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:35.268799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09b8d834-e855-4e1e-af96-514f82f82c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:35.269242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09b8d834-e855-4e1e-af96-514f82f82c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:35.269940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09b8d834-e855-4e1e-af96-514f82f82c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:35.270396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09b8d834-e855-4e1e-af96-514f82f82c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:35.270841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-09b8d834-e855-4e1e-af96-514f82f82c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:35.406437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-09b8d834-e855-4e1e-af96-514f82f82c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:35.419213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-09b8d834-e855-4e1e-af96-514f82f82c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:35.420849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-09b8d834-e855-4e1e-af96-514f82f82c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:35.422018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-09b8d834-e855-4e1e-af96-514f82f82c28 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.170509 Sep 13 20:16:35.422632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 868/1819] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:35 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:35.892419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8ebfebfb-775a-4b6c-8317-1411e4ca8576 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:35.893101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8ebfebfb-775a-4b6c-8317-1411e4ca8576 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:35.902033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ebfebfb-775a-4b6c-8317-1411e4ca8576 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:35.902751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ebfebfb-775a-4b6c-8317-1411e4ca8576 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:35.903353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ebfebfb-775a-4b6c-8317-1411e4ca8576 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:35.904267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ebfebfb-775a-4b6c-8317-1411e4ca8576 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:35.904947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ebfebfb-775a-4b6c-8317-1411e4ca8576 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:35.905360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ebfebfb-775a-4b6c-8317-1411e4ca8576 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:36.041133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8ebfebfb-775a-4b6c-8317-1411e4ca8576 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:36.043378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:16:36.050697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8ebfebfb-775a-4b6c-8317-1411e4ca8576 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.163655 Sep 13 20:16:36.051268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 952/1820] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:35 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:36.452496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-33d686ee-43ee-40ec-86d1-65fdf677abe0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:36.453544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-33d686ee-43ee-40ec-86d1-65fdf677abe0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:36.464690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33d686ee-43ee-40ec-86d1-65fdf677abe0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:36.465510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33d686ee-43ee-40ec-86d1-65fdf677abe0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:36.466288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33d686ee-43ee-40ec-86d1-65fdf677abe0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:36.467558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33d686ee-43ee-40ec-86d1-65fdf677abe0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:36.468009 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33d686ee-43ee-40ec-86d1-65fdf677abe0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:36.468434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33d686ee-43ee-40ec-86d1-65fdf677abe0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:36.604528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-33d686ee-43ee-40ec-86d1-65fdf677abe0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:36.613287 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-33d686ee-43ee-40ec-86d1-65fdf677abe0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:36.614773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-33d686ee-43ee-40ec-86d1-65fdf677abe0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:36.615978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-33d686ee-43ee-40ec-86d1-65fdf677abe0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.170592 Sep 13 20:16:36.616505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 869/1821] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:37.074473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-210927f8-175d-46e6-997a-9c238ff087d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:37.074972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-210927f8-175d-46e6-997a-9c238ff087d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:37.082358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-210927f8-175d-46e6-997a-9c238ff087d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:37.082993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-210927f8-175d-46e6-997a-9c238ff087d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:37.083428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-210927f8-175d-46e6-997a-9c238ff087d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:37.084124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-210927f8-175d-46e6-997a-9c238ff087d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:37.084575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-210927f8-175d-46e6-997a-9c238ff087d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:37.084994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-210927f8-175d-46e6-997a-9c238ff087d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:37.218032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-210927f8-175d-46e6-997a-9c238ff087d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:37.227080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-210927f8-175d-46e6-997a-9c238ff087d3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.156658 Sep 13 20:16:37.227658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 953/1822] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:37 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:37.643215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ee5cb5e9-b907-4cc9-b7db-60dd1f052469 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:37.643814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ee5cb5e9-b907-4cc9-b7db-60dd1f052469 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:37.651019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee5cb5e9-b907-4cc9-b7db-60dd1f052469 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:37.651513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee5cb5e9-b907-4cc9-b7db-60dd1f052469 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:37.651952 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee5cb5e9-b907-4cc9-b7db-60dd1f052469 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:37.652666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee5cb5e9-b907-4cc9-b7db-60dd1f052469 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:37.653114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee5cb5e9-b907-4cc9-b7db-60dd1f052469 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:37.653580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee5cb5e9-b907-4cc9-b7db-60dd1f052469 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:37.794345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ee5cb5e9-b907-4cc9-b7db-60dd1f052469 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:37.803209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ee5cb5e9-b907-4cc9-b7db-60dd1f052469 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:37.804635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ee5cb5e9-b907-4cc9-b7db-60dd1f052469 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:37.805805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ee5cb5e9-b907-4cc9-b7db-60dd1f052469 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167055 Sep 13 20:16:37.806347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 870/1823] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:38.255418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-939bf2f2-9bb9-4485-b72d-132fe6b6980d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:38.256593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-939bf2f2-9bb9-4485-b72d-132fe6b6980d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:38.266408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-939bf2f2-9bb9-4485-b72d-132fe6b6980d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:38.267040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-939bf2f2-9bb9-4485-b72d-132fe6b6980d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:38.267466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-939bf2f2-9bb9-4485-b72d-132fe6b6980d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:38.268154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-939bf2f2-9bb9-4485-b72d-132fe6b6980d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:38.268601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-939bf2f2-9bb9-4485-b72d-132fe6b6980d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:38.269016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-939bf2f2-9bb9-4485-b72d-132fe6b6980d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:38.405120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-939bf2f2-9bb9-4485-b72d-132fe6b6980d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:38.414305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-939bf2f2-9bb9-4485-b72d-132fe6b6980d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166041 Sep 13 20:16:38.415058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 954/1824] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:38 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:38.835275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5138c9d8-6705-4434-be18-9fa6ee5bec08 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:38.836542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5138c9d8-6705-4434-be18-9fa6ee5bec08 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:38.845792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5138c9d8-6705-4434-be18-9fa6ee5bec08 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:38.846279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5138c9d8-6705-4434-be18-9fa6ee5bec08 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:38.846749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5138c9d8-6705-4434-be18-9fa6ee5bec08 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:38.847440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5138c9d8-6705-4434-be18-9fa6ee5bec08 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:38.847891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5138c9d8-6705-4434-be18-9fa6ee5bec08 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:38.848313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5138c9d8-6705-4434-be18-9fa6ee5bec08 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:38.978616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5138c9d8-6705-4434-be18-9fa6ee5bec08 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:38.987465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5138c9d8-6705-4434-be18-9fa6ee5bec08 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:38.988869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5138c9d8-6705-4434-be18-9fa6ee5bec08 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:38.990028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5138c9d8-6705-4434-be18-9fa6ee5bec08 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161473 Sep 13 20:16:38.990577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 871/1825] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:39.439915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d7f751e1-76be-48e2-99ec-6d8ddc309b1e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:39.440537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d7f751e1-76be-48e2-99ec-6d8ddc309b1e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:39.447562 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7f751e1-76be-48e2-99ec-6d8ddc309b1e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:39.448048 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7f751e1-76be-48e2-99ec-6d8ddc309b1e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:39.448478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7f751e1-76be-48e2-99ec-6d8ddc309b1e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:39.449183 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7f751e1-76be-48e2-99ec-6d8ddc309b1e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:39.449635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7f751e1-76be-48e2-99ec-6d8ddc309b1e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:39.450081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7f751e1-76be-48e2-99ec-6d8ddc309b1e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:39.593956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d7f751e1-76be-48e2-99ec-6d8ddc309b1e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:39.602984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d7f751e1-76be-48e2-99ec-6d8ddc309b1e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167127 Sep 13 20:16:39.603565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 955/1826] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:39 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:40.017945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0060e08f-78c1-469d-be33-9ac679f411d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:40.018581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0060e08f-78c1-469d-be33-9ac679f411d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:40.025557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0060e08f-78c1-469d-be33-9ac679f411d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:40.026043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0060e08f-78c1-469d-be33-9ac679f411d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:40.026516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0060e08f-78c1-469d-be33-9ac679f411d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:40.027203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0060e08f-78c1-469d-be33-9ac679f411d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:40.027648 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0060e08f-78c1-469d-be33-9ac679f411d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:40.028076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0060e08f-78c1-469d-be33-9ac679f411d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:40.172313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0060e08f-78c1-469d-be33-9ac679f411d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:40.186274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0060e08f-78c1-469d-be33-9ac679f411d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:40.188399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0060e08f-78c1-469d-be33-9ac679f411d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:40.189575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0060e08f-78c1-469d-be33-9ac679f411d1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.176114 Sep 13 20:16:40.190109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 872/1827] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:40.630557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9df002ce-1b70-4f47-8e60-2cc68e1099d6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:40.631560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9df002ce-1b70-4f47-8e60-2cc68e1099d6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:40.641549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9df002ce-1b70-4f47-8e60-2cc68e1099d6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:40.642038 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9df002ce-1b70-4f47-8e60-2cc68e1099d6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:40.642511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9df002ce-1b70-4f47-8e60-2cc68e1099d6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:40.643195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9df002ce-1b70-4f47-8e60-2cc68e1099d6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:40.643643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9df002ce-1b70-4f47-8e60-2cc68e1099d6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:40.644064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9df002ce-1b70-4f47-8e60-2cc68e1099d6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:40.791883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9df002ce-1b70-4f47-8e60-2cc68e1099d6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:40.800782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9df002ce-1b70-4f47-8e60-2cc68e1099d6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.176741 Sep 13 20:16:40.801354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 956/1828] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:40 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:41.219349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a06d3675-b029-49a5-9ebb-cf24e5d68e77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:41.219940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a06d3675-b029-49a5-9ebb-cf24e5d68e77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:41.227809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a06d3675-b029-49a5-9ebb-cf24e5d68e77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:41.228359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a06d3675-b029-49a5-9ebb-cf24e5d68e77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:41.228851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a06d3675-b029-49a5-9ebb-cf24e5d68e77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:41.229631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a06d3675-b029-49a5-9ebb-cf24e5d68e77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:41.230161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a06d3675-b029-49a5-9ebb-cf24e5d68e77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:41.230803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a06d3675-b029-49a5-9ebb-cf24e5d68e77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:41.367510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a06d3675-b029-49a5-9ebb-cf24e5d68e77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:41.380912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a06d3675-b029-49a5-9ebb-cf24e5d68e77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:41.382785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a06d3675-b029-49a5-9ebb-cf24e5d68e77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:41.384557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a06d3675-b029-49a5-9ebb-cf24e5d68e77 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.170907 Sep 13 20:16:41.385313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 873/1829] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:41 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:41.830516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-14192e4e-5786-4d58-bede-1ab907f79bc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:41.831422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-14192e4e-5786-4d58-bede-1ab907f79bc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:41.842742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14192e4e-5786-4d58-bede-1ab907f79bc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:41.843216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14192e4e-5786-4d58-bede-1ab907f79bc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:41.843638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14192e4e-5786-4d58-bede-1ab907f79bc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:41.844346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14192e4e-5786-4d58-bede-1ab907f79bc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:41.844786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14192e4e-5786-4d58-bede-1ab907f79bc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:41.845200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14192e4e-5786-4d58-bede-1ab907f79bc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:41.983911 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-14192e4e-5786-4d58-bede-1ab907f79bc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:41.992705 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-14192e4e-5786-4d58-bede-1ab907f79bc1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169904 Sep 13 20:16:41.993245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 957/1830] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:41 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:42.417056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fb7ae6de-3311-441a-8747-fffa2825408c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:42.417903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fb7ae6de-3311-441a-8747-fffa2825408c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:42.428932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb7ae6de-3311-441a-8747-fffa2825408c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:42.429744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb7ae6de-3311-441a-8747-fffa2825408c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:42.430522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb7ae6de-3311-441a-8747-fffa2825408c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:42.431657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb7ae6de-3311-441a-8747-fffa2825408c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:42.432406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb7ae6de-3311-441a-8747-fffa2825408c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:42.433106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb7ae6de-3311-441a-8747-fffa2825408c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:42.450031 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:16:42.581428 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fb7ae6de-3311-441a-8747-fffa2825408c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:42.590801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fb7ae6de-3311-441a-8747-fffa2825408c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:42.592237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fb7ae6de-3311-441a-8747-fffa2825408c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:42.593462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fb7ae6de-3311-441a-8747-fffa2825408c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.183206 Sep 13 20:16:42.594022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 874/1831] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:43.020575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1bc6bb6c-8bd4-49a2-9839-02af3f334614 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:43.021511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1bc6bb6c-8bd4-49a2-9839-02af3f334614 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:43.032699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bc6bb6c-8bd4-49a2-9839-02af3f334614 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:43.033513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bc6bb6c-8bd4-49a2-9839-02af3f334614 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:43.034227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bc6bb6c-8bd4-49a2-9839-02af3f334614 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:43.035424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bc6bb6c-8bd4-49a2-9839-02af3f334614 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:43.036174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bc6bb6c-8bd4-49a2-9839-02af3f334614 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:43.036868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1bc6bb6c-8bd4-49a2-9839-02af3f334614 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:43.174256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1bc6bb6c-8bd4-49a2-9839-02af3f334614 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:43.183345 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1bc6bb6c-8bd4-49a2-9839-02af3f334614 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169390 Sep 13 20:16:43.183912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 958/1832] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:43 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:43.622359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f67243b6-add2-4ded-85b2-fdc296d4d5f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:43.623435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f67243b6-add2-4ded-85b2-fdc296d4d5f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:43.634328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f67243b6-add2-4ded-85b2-fdc296d4d5f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:43.635168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f67243b6-add2-4ded-85b2-fdc296d4d5f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:43.635885 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f67243b6-add2-4ded-85b2-fdc296d4d5f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:43.637043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f67243b6-add2-4ded-85b2-fdc296d4d5f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:43.637784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f67243b6-add2-4ded-85b2-fdc296d4d5f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:43.638485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f67243b6-add2-4ded-85b2-fdc296d4d5f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:43.785200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f67243b6-add2-4ded-85b2-fdc296d4d5f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:43.797669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f67243b6-add2-4ded-85b2-fdc296d4d5f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:43.799139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f67243b6-add2-4ded-85b2-fdc296d4d5f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:43.800337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f67243b6-add2-4ded-85b2-fdc296d4d5f6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.184659 Sep 13 20:16:43.800948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 875/1833] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:44.211430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a7f5b7a5-0e23-4e3c-b27f-e81075785d66 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:44.212365 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a7f5b7a5-0e23-4e3c-b27f-e81075785d66 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:44.220972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a7f5b7a5-0e23-4e3c-b27f-e81075785d66 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:44.221447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a7f5b7a5-0e23-4e3c-b27f-e81075785d66 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:44.221904 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a7f5b7a5-0e23-4e3c-b27f-e81075785d66 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:44.222607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a7f5b7a5-0e23-4e3c-b27f-e81075785d66 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:44.223052 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a7f5b7a5-0e23-4e3c-b27f-e81075785d66 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:44.223466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a7f5b7a5-0e23-4e3c-b27f-e81075785d66 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:44.352138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a7f5b7a5-0e23-4e3c-b27f-e81075785d66 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:44.360694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a7f5b7a5-0e23-4e3c-b27f-e81075785d66 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.156362 Sep 13 20:16:44.361242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 959/1834] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:44 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:44.825514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-33f559d3-369a-4d80-a3bd-a1179b110229 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:44.826182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-33f559d3-369a-4d80-a3bd-a1179b110229 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:44.833348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33f559d3-369a-4d80-a3bd-a1179b110229 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:44.833820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33f559d3-369a-4d80-a3bd-a1179b110229 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:44.834256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33f559d3-369a-4d80-a3bd-a1179b110229 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:44.834992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33f559d3-369a-4d80-a3bd-a1179b110229 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:44.835437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33f559d3-369a-4d80-a3bd-a1179b110229 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:44.836222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33f559d3-369a-4d80-a3bd-a1179b110229 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:44.973989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-33f559d3-369a-4d80-a3bd-a1179b110229 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:44.986245 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-33f559d3-369a-4d80-a3bd-a1179b110229 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:44.987741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-33f559d3-369a-4d80-a3bd-a1179b110229 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:44.988889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-33f559d3-369a-4d80-a3bd-a1179b110229 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167391 Sep 13 20:16:44.989443 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 876/1835] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:45.384622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-002951ff-6113-4dc8-9807-11a0edb31a14 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:45.385240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-002951ff-6113-4dc8-9807-11a0edb31a14 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:45.393061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-002951ff-6113-4dc8-9807-11a0edb31a14 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:45.393545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-002951ff-6113-4dc8-9807-11a0edb31a14 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:45.393982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-002951ff-6113-4dc8-9807-11a0edb31a14 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:45.394700 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-002951ff-6113-4dc8-9807-11a0edb31a14 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:45.395190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-002951ff-6113-4dc8-9807-11a0edb31a14 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:45.395600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-002951ff-6113-4dc8-9807-11a0edb31a14 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:45.530585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-002951ff-6113-4dc8-9807-11a0edb31a14 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:45.539711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-002951ff-6113-4dc8-9807-11a0edb31a14 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158933 Sep 13 20:16:45.540275 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 960/1836] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:45 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:46.018899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b017a841-44e6-44eb-bcb0-7830fb6e54c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:46.019813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b017a841-44e6-44eb-bcb0-7830fb6e54c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:46.031822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b017a841-44e6-44eb-bcb0-7830fb6e54c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:46.032625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b017a841-44e6-44eb-bcb0-7830fb6e54c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:46.033345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b017a841-44e6-44eb-bcb0-7830fb6e54c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:46.034509 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b017a841-44e6-44eb-bcb0-7830fb6e54c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:46.035279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b017a841-44e6-44eb-bcb0-7830fb6e54c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:46.036039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b017a841-44e6-44eb-bcb0-7830fb6e54c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:46.173346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b017a841-44e6-44eb-bcb0-7830fb6e54c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:46.182226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b017a841-44e6-44eb-bcb0-7830fb6e54c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:46.183692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b017a841-44e6-44eb-bcb0-7830fb6e54c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:46.184854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b017a841-44e6-44eb-bcb0-7830fb6e54c2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172725 Sep 13 20:16:46.185417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 877/1837] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:46.562936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-21c9635e-2064-4062-8085-e8750b54025a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:46.563500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-21c9635e-2064-4062-8085-e8750b54025a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:46.571855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-21c9635e-2064-4062-8085-e8750b54025a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:46.572344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-21c9635e-2064-4062-8085-e8750b54025a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:46.572797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-21c9635e-2064-4062-8085-e8750b54025a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:46.573520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-21c9635e-2064-4062-8085-e8750b54025a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:46.573933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-21c9635e-2064-4062-8085-e8750b54025a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:46.574406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-21c9635e-2064-4062-8085-e8750b54025a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:46.705843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-21c9635e-2064-4062-8085-e8750b54025a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:46.714905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-21c9635e-2064-4062-8085-e8750b54025a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.155890 Sep 13 20:16:46.715476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 961/1838] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:46 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:47.215072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fd96d501-dcf9-458a-8784-a9ff6d6a4c29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:47.216119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fd96d501-dcf9-458a-8784-a9ff6d6a4c29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:47.224369 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd96d501-dcf9-458a-8784-a9ff6d6a4c29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:47.224829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd96d501-dcf9-458a-8784-a9ff6d6a4c29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:47.225290 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd96d501-dcf9-458a-8784-a9ff6d6a4c29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:47.225980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd96d501-dcf9-458a-8784-a9ff6d6a4c29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:47.226465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd96d501-dcf9-458a-8784-a9ff6d6a4c29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:47.226920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fd96d501-dcf9-458a-8784-a9ff6d6a4c29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:47.364481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fd96d501-dcf9-458a-8784-a9ff6d6a4c29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:47.373438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fd96d501-dcf9-458a-8784-a9ff6d6a4c29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:47.374884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fd96d501-dcf9-458a-8784-a9ff6d6a4c29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:47.376074 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fd96d501-dcf9-458a-8784-a9ff6d6a4c29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168135 Sep 13 20:16:47.376635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 878/1839] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:47 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:47.742466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-06a470a0-b2b8-40ca-9225-eff18d148d50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:47.743344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-06a470a0-b2b8-40ca-9225-eff18d148d50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:47.752856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06a470a0-b2b8-40ca-9225-eff18d148d50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:47.753329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06a470a0-b2b8-40ca-9225-eff18d148d50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:47.753750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06a470a0-b2b8-40ca-9225-eff18d148d50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:47.754462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06a470a0-b2b8-40ca-9225-eff18d148d50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:47.754892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06a470a0-b2b8-40ca-9225-eff18d148d50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:47.755303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-06a470a0-b2b8-40ca-9225-eff18d148d50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:47.892242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-06a470a0-b2b8-40ca-9225-eff18d148d50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:47.900544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-06a470a0-b2b8-40ca-9225-eff18d148d50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164880 Sep 13 20:16:47.901108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 962/1840] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:47 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:48.401636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-52d6d85c-3806-4049-9e0e-75e7c3988264 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:48.402192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-52d6d85c-3806-4049-9e0e-75e7c3988264 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:48.409256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52d6d85c-3806-4049-9e0e-75e7c3988264 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:48.409740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52d6d85c-3806-4049-9e0e-75e7c3988264 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:48.410175 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52d6d85c-3806-4049-9e0e-75e7c3988264 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:48.410905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52d6d85c-3806-4049-9e0e-75e7c3988264 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:48.411356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52d6d85c-3806-4049-9e0e-75e7c3988264 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:48.411781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52d6d85c-3806-4049-9e0e-75e7c3988264 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:48.542656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-52d6d85c-3806-4049-9e0e-75e7c3988264 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:48.552598 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-52d6d85c-3806-4049-9e0e-75e7c3988264 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:48.554077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-52d6d85c-3806-4049-9e0e-75e7c3988264 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:48.555331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-52d6d85c-3806-4049-9e0e-75e7c3988264 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.157704 Sep 13 20:16:48.555892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 879/1841] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:48 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:48.928226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-622cb9e6-4062-40af-b23e-02979383ef09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:48.929292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-622cb9e6-4062-40af-b23e-02979383ef09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:48.940110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-622cb9e6-4062-40af-b23e-02979383ef09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:48.940952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-622cb9e6-4062-40af-b23e-02979383ef09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:48.941660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-622cb9e6-4062-40af-b23e-02979383ef09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:48.942843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-622cb9e6-4062-40af-b23e-02979383ef09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:48.943587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-622cb9e6-4062-40af-b23e-02979383ef09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:48.944283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-622cb9e6-4062-40af-b23e-02979383ef09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:49.081020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-622cb9e6-4062-40af-b23e-02979383ef09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:49.090027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-622cb9e6-4062-40af-b23e-02979383ef09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168492 Sep 13 20:16:49.090637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 963/1842] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:48 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:49.582398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d1aabceb-97ff-496f-be8d-9400ae837854 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:49.583118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d1aabceb-97ff-496f-be8d-9400ae837854 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:49.590536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1aabceb-97ff-496f-be8d-9400ae837854 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:49.591052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1aabceb-97ff-496f-be8d-9400ae837854 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:49.591479 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1aabceb-97ff-496f-be8d-9400ae837854 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:49.592431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1aabceb-97ff-496f-be8d-9400ae837854 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:49.592878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1aabceb-97ff-496f-be8d-9400ae837854 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:49.593300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1aabceb-97ff-496f-be8d-9400ae837854 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:49.727449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1aabceb-97ff-496f-be8d-9400ae837854 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:49.736268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1aabceb-97ff-496f-be8d-9400ae837854 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:49.737638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1aabceb-97ff-496f-be8d-9400ae837854 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:49.738831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d1aabceb-97ff-496f-be8d-9400ae837854 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.160761 Sep 13 20:16:49.739393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 880/1843] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:50.117625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fde23ef8-6a32-4ca9-b221-7edf8f061fb4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:50.118510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fde23ef8-6a32-4ca9-b221-7edf8f061fb4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:50.128078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fde23ef8-6a32-4ca9-b221-7edf8f061fb4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:50.128556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fde23ef8-6a32-4ca9-b221-7edf8f061fb4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:50.128977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fde23ef8-6a32-4ca9-b221-7edf8f061fb4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:50.129659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fde23ef8-6a32-4ca9-b221-7edf8f061fb4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:50.130103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fde23ef8-6a32-4ca9-b221-7edf8f061fb4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:50.130545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fde23ef8-6a32-4ca9-b221-7edf8f061fb4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:50.273190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fde23ef8-6a32-4ca9-b221-7edf8f061fb4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:50.285800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fde23ef8-6a32-4ca9-b221-7edf8f061fb4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.174574 Sep 13 20:16:50.286622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 964/1844] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:50 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:50.764388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-29eb7afc-c2a6-4235-8226-89f59a4c44b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:50.764993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-29eb7afc-c2a6-4235-8226-89f59a4c44b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:50.771918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29eb7afc-c2a6-4235-8226-89f59a4c44b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:50.772405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29eb7afc-c2a6-4235-8226-89f59a4c44b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:50.772836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29eb7afc-c2a6-4235-8226-89f59a4c44b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:50.773528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29eb7afc-c2a6-4235-8226-89f59a4c44b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:50.773978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29eb7afc-c2a6-4235-8226-89f59a4c44b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:50.774409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29eb7afc-c2a6-4235-8226-89f59a4c44b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:50.904832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-29eb7afc-c2a6-4235-8226-89f59a4c44b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:50.914236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-29eb7afc-c2a6-4235-8226-89f59a4c44b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:50.915714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-29eb7afc-c2a6-4235-8226-89f59a4c44b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:50.916882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-29eb7afc-c2a6-4235-8226-89f59a4c44b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.156614 Sep 13 20:16:50.917453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 881/1845] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:51.316910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f0ecf4e5-e375-4d98-9d38-7848d037bfaa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:51.317838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f0ecf4e5-e375-4d98-9d38-7848d037bfaa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:51.328833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0ecf4e5-e375-4d98-9d38-7848d037bfaa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:51.329328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0ecf4e5-e375-4d98-9d38-7848d037bfaa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:51.329754 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0ecf4e5-e375-4d98-9d38-7848d037bfaa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:51.330475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0ecf4e5-e375-4d98-9d38-7848d037bfaa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:51.330948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0ecf4e5-e375-4d98-9d38-7848d037bfaa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:51.331370 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0ecf4e5-e375-4d98-9d38-7848d037bfaa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:51.467971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f0ecf4e5-e375-4d98-9d38-7848d037bfaa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:51.476431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f0ecf4e5-e375-4d98-9d38-7848d037bfaa tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166163 Sep 13 20:16:51.476999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 965/1846] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:51 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:51.946661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ff7418f9-c64e-44b5-b0c7-8184525ddb61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:51.947484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ff7418f9-c64e-44b5-b0c7-8184525ddb61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:51.960334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff7418f9-c64e-44b5-b0c7-8184525ddb61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:51.962056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff7418f9-c64e-44b5-b0c7-8184525ddb61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:51.962520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff7418f9-c64e-44b5-b0c7-8184525ddb61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:51.963213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff7418f9-c64e-44b5-b0c7-8184525ddb61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:51.963658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff7418f9-c64e-44b5-b0c7-8184525ddb61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:51.964073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff7418f9-c64e-44b5-b0c7-8184525ddb61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:52.113278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ff7418f9-c64e-44b5-b0c7-8184525ddb61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:52.122562 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ff7418f9-c64e-44b5-b0c7-8184525ddb61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:52.124010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ff7418f9-c64e-44b5-b0c7-8184525ddb61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:52.125292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ff7418f9-c64e-44b5-b0c7-8184525ddb61 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.185189 Sep 13 20:16:52.125851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 882/1847] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:52.503759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3ca78e60-7522-4379-87a0-c750ce21e983 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:52.504773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3ca78e60-7522-4379-87a0-c750ce21e983 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:52.515826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ca78e60-7522-4379-87a0-c750ce21e983 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:52.516272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ca78e60-7522-4379-87a0-c750ce21e983 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:52.516734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ca78e60-7522-4379-87a0-c750ce21e983 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:52.517419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ca78e60-7522-4379-87a0-c750ce21e983 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:52.517862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ca78e60-7522-4379-87a0-c750ce21e983 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:52.518278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ca78e60-7522-4379-87a0-c750ce21e983 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:52.648357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3ca78e60-7522-4379-87a0-c750ce21e983 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:52.664164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3ca78e60-7522-4379-87a0-c750ce21e983 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.163376 Sep 13 20:16:52.664164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 966/1848] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:52 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:53.155856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-37c8d5a2-565f-4e8e-9c09-93665df70523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:53.156796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-37c8d5a2-565f-4e8e-9c09-93665df70523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:53.164065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37c8d5a2-565f-4e8e-9c09-93665df70523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:53.164573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37c8d5a2-565f-4e8e-9c09-93665df70523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:53.165027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37c8d5a2-565f-4e8e-9c09-93665df70523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:53.165755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37c8d5a2-565f-4e8e-9c09-93665df70523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:53.166224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37c8d5a2-565f-4e8e-9c09-93665df70523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:53.166713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37c8d5a2-565f-4e8e-9c09-93665df70523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:53.297273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-37c8d5a2-565f-4e8e-9c09-93665df70523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:53.306456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-37c8d5a2-565f-4e8e-9c09-93665df70523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:53.307843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-37c8d5a2-565f-4e8e-9c09-93665df70523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:53.309059 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-37c8d5a2-565f-4e8e-9c09-93665df70523 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159925 Sep 13 20:16:53.309588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 883/1849] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:53 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:53.689068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4c681f4b-8c04-49e0-ba6f-b8c0182663d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:53.689877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4c681f4b-8c04-49e0-ba6f-b8c0182663d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:53.698731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c681f4b-8c04-49e0-ba6f-b8c0182663d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:53.699365 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c681f4b-8c04-49e0-ba6f-b8c0182663d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:53.699932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c681f4b-8c04-49e0-ba6f-b8c0182663d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:53.700835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c681f4b-8c04-49e0-ba6f-b8c0182663d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:53.701458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c681f4b-8c04-49e0-ba6f-b8c0182663d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:53.701978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c681f4b-8c04-49e0-ba6f-b8c0182663d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:53.848723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4c681f4b-8c04-49e0-ba6f-b8c0182663d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:53.857341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4c681f4b-8c04-49e0-ba6f-b8c0182663d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.174761 Sep 13 20:16:53.857915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 967/1850] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:53 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:54.343689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-05c11f4e-904a-4e51-9618-32096cfd09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:54.344600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-05c11f4e-904a-4e51-9618-32096cfd09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:54.351472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05c11f4e-904a-4e51-9618-32096cfd09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:54.351951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05c11f4e-904a-4e51-9618-32096cfd09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:54.352380 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05c11f4e-904a-4e51-9618-32096cfd09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:54.353068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05c11f4e-904a-4e51-9618-32096cfd09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:54.353515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05c11f4e-904a-4e51-9618-32096cfd09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:54.353937 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05c11f4e-904a-4e51-9618-32096cfd09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:54.483918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-05c11f4e-904a-4e51-9618-32096cfd09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:54.492899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-05c11f4e-904a-4e51-9618-32096cfd09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:54.494337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-05c11f4e-904a-4e51-9618-32096cfd09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:54.495522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-05c11f4e-904a-4e51-9618-32096cfd09f1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158440 Sep 13 20:16:54.496096 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 884/1851] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:54 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:54.884996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6288254b-4906-4df3-8fcf-9871fc6ab331 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:54.886014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6288254b-4906-4df3-8fcf-9871fc6ab331 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:54.889366 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:16:54.889648 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:16:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 (ip 10.222.0.52) !!! Sep 13 20:16:54.897197 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6288254b-4906-4df3-8fcf-9871fc6ab331 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:54.897682 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6288254b-4906-4df3-8fcf-9871fc6ab331 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:54.898112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6288254b-4906-4df3-8fcf-9871fc6ab331 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:54.898839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6288254b-4906-4df3-8fcf-9871fc6ab331 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:54.899292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6288254b-4906-4df3-8fcf-9871fc6ab331 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:54.899709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6288254b-4906-4df3-8fcf-9871fc6ab331 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:55.031626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6288254b-4906-4df3-8fcf-9871fc6ab331 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:55.044244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6288254b-4906-4df3-8fcf-9871fc6ab331 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165518 Sep 13 20:16:55.045025 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 968/1852] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:54 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:55.522652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fc90ef28-4862-4b01-aa84-c9a4ce08df4c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:55.523262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fc90ef28-4862-4b01-aa84-c9a4ce08df4c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:55.530004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc90ef28-4862-4b01-aa84-c9a4ce08df4c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:55.530519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc90ef28-4862-4b01-aa84-c9a4ce08df4c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:55.531162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc90ef28-4862-4b01-aa84-c9a4ce08df4c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:55.531854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc90ef28-4862-4b01-aa84-c9a4ce08df4c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:55.532306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc90ef28-4862-4b01-aa84-c9a4ce08df4c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:55.532729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc90ef28-4862-4b01-aa84-c9a4ce08df4c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:55.671537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fc90ef28-4862-4b01-aa84-c9a4ce08df4c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:55.680995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fc90ef28-4862-4b01-aa84-c9a4ce08df4c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:55.682740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fc90ef28-4862-4b01-aa84-c9a4ce08df4c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:55.683938 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fc90ef28-4862-4b01-aa84-c9a4ce08df4c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165578 Sep 13 20:16:55.684755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 885/1853] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:56.069178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9102b1b7-743b-48c0-9cc5-1029eb77b2e0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:56.069793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9102b1b7-743b-48c0-9cc5-1029eb77b2e0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:56.076545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9102b1b7-743b-48c0-9cc5-1029eb77b2e0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:56.077092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9102b1b7-743b-48c0-9cc5-1029eb77b2e0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:56.077531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9102b1b7-743b-48c0-9cc5-1029eb77b2e0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:56.078211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9102b1b7-743b-48c0-9cc5-1029eb77b2e0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:56.078684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9102b1b7-743b-48c0-9cc5-1029eb77b2e0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:56.079100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9102b1b7-743b-48c0-9cc5-1029eb77b2e0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:56.094072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:16:56.208240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9102b1b7-743b-48c0-9cc5-1029eb77b2e0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:56.220767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9102b1b7-743b-48c0-9cc5-1029eb77b2e0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.155208 Sep 13 20:16:56.221469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 969/1854] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:56 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:56.714213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-71cf95bb-abea-4dce-8a8c-1a7881838d74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:56.715270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-71cf95bb-abea-4dce-8a8c-1a7881838d74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:56.724100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-71cf95bb-abea-4dce-8a8c-1a7881838d74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:56.724585 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-71cf95bb-abea-4dce-8a8c-1a7881838d74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:56.725024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-71cf95bb-abea-4dce-8a8c-1a7881838d74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:56.725703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-71cf95bb-abea-4dce-8a8c-1a7881838d74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:56.726167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-71cf95bb-abea-4dce-8a8c-1a7881838d74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:56.726622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-71cf95bb-abea-4dce-8a8c-1a7881838d74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:56.858967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-71cf95bb-abea-4dce-8a8c-1a7881838d74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:56.868530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-71cf95bb-abea-4dce-8a8c-1a7881838d74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:56.870032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-71cf95bb-abea-4dce-8a8c-1a7881838d74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:56.871230 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-71cf95bb-abea-4dce-8a8c-1a7881838d74 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.164266 Sep 13 20:16:56.871763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 886/1855] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:57.252141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ef8f4a4f-7005-4efb-943a-d1186d27ddda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:57.252821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ef8f4a4f-7005-4efb-943a-d1186d27ddda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:57.263166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef8f4a4f-7005-4efb-943a-d1186d27ddda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:57.263828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef8f4a4f-7005-4efb-943a-d1186d27ddda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:57.264397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef8f4a4f-7005-4efb-943a-d1186d27ddda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:57.265397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef8f4a4f-7005-4efb-943a-d1186d27ddda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:57.266018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef8f4a4f-7005-4efb-943a-d1186d27ddda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:57.266596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef8f4a4f-7005-4efb-943a-d1186d27ddda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:57.609737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ef8f4a4f-7005-4efb-943a-d1186d27ddda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:57.618402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ef8f4a4f-7005-4efb-943a-d1186d27ddda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.372727 Sep 13 20:16:57.618992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 970/1856] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:57 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:57.901821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2a89002d-276c-44ca-8469-508fbd7d834d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:57.902523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2a89002d-276c-44ca-8469-508fbd7d834d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:57.909943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a89002d-276c-44ca-8469-508fbd7d834d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:57.910612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a89002d-276c-44ca-8469-508fbd7d834d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:57.911102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a89002d-276c-44ca-8469-508fbd7d834d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:57.911859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a89002d-276c-44ca-8469-508fbd7d834d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:57.912359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a89002d-276c-44ca-8469-508fbd7d834d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:57.912825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a89002d-276c-44ca-8469-508fbd7d834d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:58.045179 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2a89002d-276c-44ca-8469-508fbd7d834d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:58.054558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2a89002d-276c-44ca-8469-508fbd7d834d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:58.055985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2a89002d-276c-44ca-8469-508fbd7d834d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:58.057139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2a89002d-276c-44ca-8469-508fbd7d834d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159953 Sep 13 20:16:58.057696 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 887/1857] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:58.644025 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a517baf2-c442-4699-a97a-e7ce27ea06ad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:58.644746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a517baf2-c442-4699-a97a-e7ce27ea06ad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:58.652596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a517baf2-c442-4699-a97a-e7ce27ea06ad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:58.653222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a517baf2-c442-4699-a97a-e7ce27ea06ad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:58.653720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a517baf2-c442-4699-a97a-e7ce27ea06ad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:58.654591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a517baf2-c442-4699-a97a-e7ce27ea06ad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:58.655104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a517baf2-c442-4699-a97a-e7ce27ea06ad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:58.655589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a517baf2-c442-4699-a97a-e7ce27ea06ad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:58.794316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a517baf2-c442-4699-a97a-e7ce27ea06ad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:58.803042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a517baf2-c442-4699-a97a-e7ce27ea06ad tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164839 Sep 13 20:16:58.803614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 971/1858] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:58 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:16:59.086806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a14d8c4b-0a6d-42b2-8f6c-418c17f71955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:59.087731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a14d8c4b-0a6d-42b2-8f6c-418c17f71955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:59.097633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a14d8c4b-0a6d-42b2-8f6c-418c17f71955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:59.098102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a14d8c4b-0a6d-42b2-8f6c-418c17f71955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:59.098571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a14d8c4b-0a6d-42b2-8f6c-418c17f71955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:59.099258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a14d8c4b-0a6d-42b2-8f6c-418c17f71955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:59.099699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a14d8c4b-0a6d-42b2-8f6c-418c17f71955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:59.100115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a14d8c4b-0a6d-42b2-8f6c-418c17f71955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:59.233314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a14d8c4b-0a6d-42b2-8f6c-418c17f71955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:59.245348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a14d8c4b-0a6d-42b2-8f6c-418c17f71955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:59.246876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a14d8c4b-0a6d-42b2-8f6c-418c17f71955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:16:59.248243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a14d8c4b-0a6d-42b2-8f6c-418c17f71955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168563 Sep 13 20:16:59.248593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 888/1859] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:16:59 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:16:59.830688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f5353896-30b2-4ab2-a888-002ad4bf6539 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:16:59.831596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f5353896-30b2-4ab2-a888-002ad4bf6539 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:16:59.842880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5353896-30b2-4ab2-a888-002ad4bf6539 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:59.843672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5353896-30b2-4ab2-a888-002ad4bf6539 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:59.844379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5353896-30b2-4ab2-a888-002ad4bf6539 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:59.845606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5353896-30b2-4ab2-a888-002ad4bf6539 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:16:59.846177 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5353896-30b2-4ab2-a888-002ad4bf6539 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:16:59.846623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5353896-30b2-4ab2-a888-002ad4bf6539 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:16:59.993136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f5353896-30b2-4ab2-a888-002ad4bf6539 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:00.006134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f5353896-30b2-4ab2-a888-002ad4bf6539 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.181905 Sep 13 20:17:00.006993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 972/1860] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:16:59 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:00.273851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a0a8fdab-1460-4c6a-9337-2ce206196a12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:00.274444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a0a8fdab-1460-4c6a-9337-2ce206196a12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:00.281016 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a0a8fdab-1460-4c6a-9337-2ce206196a12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:00.281497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a0a8fdab-1460-4c6a-9337-2ce206196a12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:00.281929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a0a8fdab-1460-4c6a-9337-2ce206196a12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:00.282662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a0a8fdab-1460-4c6a-9337-2ce206196a12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:00.283111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a0a8fdab-1460-4c6a-9337-2ce206196a12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:00.283534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a0a8fdab-1460-4c6a-9337-2ce206196a12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:00.414617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a0a8fdab-1460-4c6a-9337-2ce206196a12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:00.428147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a0a8fdab-1460-4c6a-9337-2ce206196a12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:00.430428 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a0a8fdab-1460-4c6a-9337-2ce206196a12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:00.432233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a0a8fdab-1460-4c6a-9337-2ce206196a12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162060 Sep 13 20:17:00.433077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 889/1861] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:00 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:01.038462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-211d2e91-4083-4ba0-9c06-2db00eee12a3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:01.039549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-211d2e91-4083-4ba0-9c06-2db00eee12a3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:01.043267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:17:01.050915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-211d2e91-4083-4ba0-9c06-2db00eee12a3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:01.051407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-211d2e91-4083-4ba0-9c06-2db00eee12a3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:01.051829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-211d2e91-4083-4ba0-9c06-2db00eee12a3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:01.052518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-211d2e91-4083-4ba0-9c06-2db00eee12a3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:01.052989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-211d2e91-4083-4ba0-9c06-2db00eee12a3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:01.053382 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-211d2e91-4083-4ba0-9c06-2db00eee12a3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:01.188357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-211d2e91-4083-4ba0-9c06-2db00eee12a3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:01.197024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-211d2e91-4083-4ba0-9c06-2db00eee12a3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165184 Sep 13 20:17:01.197567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 973/1862] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:01 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:01.460796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d5185963-b50c-4ca5-b4c7-6726ae5192c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:01.461411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d5185963-b50c-4ca5-b4c7-6726ae5192c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:01.463984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=52 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:17:01.469773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d5185963-b50c-4ca5-b4c7-6726ae5192c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:01.470256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d5185963-b50c-4ca5-b4c7-6726ae5192c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:01.470719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d5185963-b50c-4ca5-b4c7-6726ae5192c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:01.471414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d5185963-b50c-4ca5-b4c7-6726ae5192c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:01.471864 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d5185963-b50c-4ca5-b4c7-6726ae5192c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:01.472285 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d5185963-b50c-4ca5-b4c7-6726ae5192c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:01.607898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d5185963-b50c-4ca5-b4c7-6726ae5192c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:01.616928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d5185963-b50c-4ca5-b4c7-6726ae5192c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:01.618353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d5185963-b50c-4ca5-b4c7-6726ae5192c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:01.619598 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d5185963-b50c-4ca5-b4c7-6726ae5192c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.163135 Sep 13 20:17:01.620158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 890/1863] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:02.231808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-07727411-4339-4c3f-b671-5fd9e10ac6d1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:02.232821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-07727411-4339-4c3f-b671-5fd9e10ac6d1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:02.241024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07727411-4339-4c3f-b671-5fd9e10ac6d1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:02.241501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07727411-4339-4c3f-b671-5fd9e10ac6d1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:02.241927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07727411-4339-4c3f-b671-5fd9e10ac6d1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:02.242658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07727411-4339-4c3f-b671-5fd9e10ac6d1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:02.243106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07727411-4339-4c3f-b671-5fd9e10ac6d1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:02.243521 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07727411-4339-4c3f-b671-5fd9e10ac6d1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:02.379439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-07727411-4339-4c3f-b671-5fd9e10ac6d1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:02.389241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-07727411-4339-4c3f-b671-5fd9e10ac6d1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.163993 Sep 13 20:17:02.389818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 974/1864] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:02 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:02.648647 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-797ac6b5-ceb6-421e-bfbf-07ba0407cb59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:02.649571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-797ac6b5-ceb6-421e-bfbf-07ba0407cb59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:02.659701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-797ac6b5-ceb6-421e-bfbf-07ba0407cb59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:02.660169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-797ac6b5-ceb6-421e-bfbf-07ba0407cb59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:02.660593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-797ac6b5-ceb6-421e-bfbf-07ba0407cb59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:02.661276 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-797ac6b5-ceb6-421e-bfbf-07ba0407cb59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:02.661711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-797ac6b5-ceb6-421e-bfbf-07ba0407cb59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:02.662127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-797ac6b5-ceb6-421e-bfbf-07ba0407cb59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:02.664742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:17:02.804049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-797ac6b5-ceb6-421e-bfbf-07ba0407cb59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:02.816714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-797ac6b5-ceb6-421e-bfbf-07ba0407cb59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:02.818165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-797ac6b5-ceb6-421e-bfbf-07ba0407cb59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:02.819353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-797ac6b5-ceb6-421e-bfbf-07ba0407cb59 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.176808 Sep 13 20:17:02.819915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 891/1865] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:03.416668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e69aa626-175e-4bf3-8cb5-c1d76a851209 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:03.417639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e69aa626-175e-4bf3-8cb5-c1d76a851209 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:03.428398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e69aa626-175e-4bf3-8cb5-c1d76a851209 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:03.429182 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e69aa626-175e-4bf3-8cb5-c1d76a851209 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:03.429878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e69aa626-175e-4bf3-8cb5-c1d76a851209 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:03.431054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e69aa626-175e-4bf3-8cb5-c1d76a851209 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:03.431799 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e69aa626-175e-4bf3-8cb5-c1d76a851209 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:03.432480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e69aa626-175e-4bf3-8cb5-c1d76a851209 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:03.576818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e69aa626-175e-4bf3-8cb5-c1d76a851209 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:03.585939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e69aa626-175e-4bf3-8cb5-c1d76a851209 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.175615 Sep 13 20:17:03.586545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 975/1866] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:03 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:03.850016 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5cd1526d-f3f9-471e-ae1e-3835fca07991 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:03.850920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5cd1526d-f3f9-471e-ae1e-3835fca07991 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:03.861723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cd1526d-f3f9-471e-ae1e-3835fca07991 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:03.862556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cd1526d-f3f9-471e-ae1e-3835fca07991 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:03.863266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cd1526d-f3f9-471e-ae1e-3835fca07991 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:03.864453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cd1526d-f3f9-471e-ae1e-3835fca07991 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:03.864895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cd1526d-f3f9-471e-ae1e-3835fca07991 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:03.865317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cd1526d-f3f9-471e-ae1e-3835fca07991 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:04.006882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5cd1526d-f3f9-471e-ae1e-3835fca07991 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:04.021115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5cd1526d-f3f9-471e-ae1e-3835fca07991 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:04.023253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5cd1526d-f3f9-471e-ae1e-3835fca07991 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:04.024898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5cd1526d-f3f9-471e-ae1e-3835fca07991 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.181423 Sep 13 20:17:04.026226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 892/1867] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:04.611556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a52880f9-35d9-4c55-8134-55fd8d2d9e96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:04.612219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a52880f9-35d9-4c55-8134-55fd8d2d9e96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:04.621304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a52880f9-35d9-4c55-8134-55fd8d2d9e96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:04.621795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a52880f9-35d9-4c55-8134-55fd8d2d9e96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:04.622217 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a52880f9-35d9-4c55-8134-55fd8d2d9e96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:04.622937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a52880f9-35d9-4c55-8134-55fd8d2d9e96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:04.623382 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a52880f9-35d9-4c55-8134-55fd8d2d9e96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:04.623796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a52880f9-35d9-4c55-8134-55fd8d2d9e96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:04.763591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a52880f9-35d9-4c55-8134-55fd8d2d9e96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:04.772226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a52880f9-35d9-4c55-8134-55fd8d2d9e96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166851 Sep 13 20:17:04.772794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 976/1868] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:04 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:05.058896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-05c6b703-8e03-406b-bde8-5ae38dcdc1a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:05.059887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-05c6b703-8e03-406b-bde8-5ae38dcdc1a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:05.069516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05c6b703-8e03-406b-bde8-5ae38dcdc1a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:05.069997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05c6b703-8e03-406b-bde8-5ae38dcdc1a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:05.070469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05c6b703-8e03-406b-bde8-5ae38dcdc1a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:05.071159 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05c6b703-8e03-406b-bde8-5ae38dcdc1a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:05.071614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05c6b703-8e03-406b-bde8-5ae38dcdc1a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:05.072033 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05c6b703-8e03-406b-bde8-5ae38dcdc1a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:05.202775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-05c6b703-8e03-406b-bde8-5ae38dcdc1a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:05.211941 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-05c6b703-8e03-406b-bde8-5ae38dcdc1a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:05.213365 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-05c6b703-8e03-406b-bde8-5ae38dcdc1a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:05.214550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-05c6b703-8e03-406b-bde8-5ae38dcdc1a2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162362 Sep 13 20:17:05.215116 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 893/1869] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:17:05.799684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d4908780-3098-41d5-b4e2-ada19d1bac85 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:05.800687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d4908780-3098-41d5-b4e2-ada19d1bac85 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:05.811736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4908780-3098-41d5-b4e2-ada19d1bac85 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:05.812524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4908780-3098-41d5-b4e2-ada19d1bac85 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:05.813233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4908780-3098-41d5-b4e2-ada19d1bac85 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:05.814358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4908780-3098-41d5-b4e2-ada19d1bac85 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:05.815145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4908780-3098-41d5-b4e2-ada19d1bac85 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:05.815867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4908780-3098-41d5-b4e2-ada19d1bac85 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:05.947850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d4908780-3098-41d5-b4e2-ada19d1bac85 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:05.956445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d4908780-3098-41d5-b4e2-ada19d1bac85 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.163241 Sep 13 20:17:05.957023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 977/1870] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:05 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:06.244100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ca3ec3da-15c5-4b71-b380-2a363c8831b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:06.245124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ca3ec3da-15c5-4b71-b380-2a363c8831b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:06.255753 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca3ec3da-15c5-4b71-b380-2a363c8831b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:06.256231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca3ec3da-15c5-4b71-b380-2a363c8831b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:06.256667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca3ec3da-15c5-4b71-b380-2a363c8831b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:06.257359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca3ec3da-15c5-4b71-b380-2a363c8831b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:06.257788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca3ec3da-15c5-4b71-b380-2a363c8831b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:06.258227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca3ec3da-15c5-4b71-b380-2a363c8831b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:06.405104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ca3ec3da-15c5-4b71-b380-2a363c8831b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:06.414184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ca3ec3da-15c5-4b71-b380-2a363c8831b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:06.415665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ca3ec3da-15c5-4b71-b380-2a363c8831b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:06.416839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ca3ec3da-15c5-4b71-b380-2a363c8831b2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.179481 Sep 13 20:17:06.417430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 894/1871] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:06 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:06.985193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6d05b46c-a678-428b-9b5b-ac1b507db032 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:06.986135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6d05b46c-a678-428b-9b5b-ac1b507db032 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:06.997335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d05b46c-a678-428b-9b5b-ac1b507db032 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:06.998125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d05b46c-a678-428b-9b5b-ac1b507db032 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:06.998930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d05b46c-a678-428b-9b5b-ac1b507db032 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:07.000132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d05b46c-a678-428b-9b5b-ac1b507db032 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:07.000929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d05b46c-a678-428b-9b5b-ac1b507db032 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:07.001632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6d05b46c-a678-428b-9b5b-ac1b507db032 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:07.135356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6d05b46c-a678-428b-9b5b-ac1b507db032 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:07.148667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6d05b46c-a678-428b-9b5b-ac1b507db032 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169748 Sep 13 20:17:07.149455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 978/1872] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:06 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:07.446770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bdaca1fa-e266-42aa-aafa-64c6181bf361 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:07.447643 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bdaca1fa-e266-42aa-aafa-64c6181bf361 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:07.458407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bdaca1fa-e266-42aa-aafa-64c6181bf361 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:07.458907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bdaca1fa-e266-42aa-aafa-64c6181bf361 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:07.459344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bdaca1fa-e266-42aa-aafa-64c6181bf361 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:07.460018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bdaca1fa-e266-42aa-aafa-64c6181bf361 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:07.460847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bdaca1fa-e266-42aa-aafa-64c6181bf361 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:07.461271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bdaca1fa-e266-42aa-aafa-64c6181bf361 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:07.604456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bdaca1fa-e266-42aa-aafa-64c6181bf361 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:07.615224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bdaca1fa-e266-42aa-aafa-64c6181bf361 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:07.616672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bdaca1fa-e266-42aa-aafa-64c6181bf361 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:07.617856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bdaca1fa-e266-42aa-aafa-64c6181bf361 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.177756 Sep 13 20:17:07.618476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 895/1873] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:08.180902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e81f2ad0-0a50-4139-b4e7-145580129e82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:08.181855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e81f2ad0-0a50-4139-b4e7-145580129e82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:08.192861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e81f2ad0-0a50-4139-b4e7-145580129e82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:08.193650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e81f2ad0-0a50-4139-b4e7-145580129e82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:08.194402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e81f2ad0-0a50-4139-b4e7-145580129e82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:08.195518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e81f2ad0-0a50-4139-b4e7-145580129e82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:08.196288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e81f2ad0-0a50-4139-b4e7-145580129e82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:08.196990 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e81f2ad0-0a50-4139-b4e7-145580129e82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:08.343480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e81f2ad0-0a50-4139-b4e7-145580129e82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:08.352477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e81f2ad0-0a50-4139-b4e7-145580129e82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.178090 Sep 13 20:17:08.353269 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 979/1874] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:08 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:08.645435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-74888288-6a41-4f85-a0b5-292a52175adc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:08.646036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-74888288-6a41-4f85-a0b5-292a52175adc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:08.653229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74888288-6a41-4f85-a0b5-292a52175adc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:08.654025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74888288-6a41-4f85-a0b5-292a52175adc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:08.654694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74888288-6a41-4f85-a0b5-292a52175adc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:08.655698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74888288-6a41-4f85-a0b5-292a52175adc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:08.656255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74888288-6a41-4f85-a0b5-292a52175adc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:08.656974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-74888288-6a41-4f85-a0b5-292a52175adc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:08.790929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-74888288-6a41-4f85-a0b5-292a52175adc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:08.800149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-74888288-6a41-4f85-a0b5-292a52175adc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:08.801684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-74888288-6a41-4f85-a0b5-292a52175adc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:08.802901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-74888288-6a41-4f85-a0b5-292a52175adc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161462 Sep 13 20:17:08.803458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 896/1875] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:09.378073 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-24e6f75d-ada7-4eea-a0a0-6745cbab97ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:09.379131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-24e6f75d-ada7-4eea-a0a0-6745cbab97ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:09.386387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-24e6f75d-ada7-4eea-a0a0-6745cbab97ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:09.386859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-24e6f75d-ada7-4eea-a0a0-6745cbab97ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:09.387290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-24e6f75d-ada7-4eea-a0a0-6745cbab97ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:09.388020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-24e6f75d-ada7-4eea-a0a0-6745cbab97ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:09.388465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-24e6f75d-ada7-4eea-a0a0-6745cbab97ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:09.388887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-24e6f75d-ada7-4eea-a0a0-6745cbab97ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:09.523088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-24e6f75d-ada7-4eea-a0a0-6745cbab97ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:09.531688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-24e6f75d-ada7-4eea-a0a0-6745cbab97ed tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158730 Sep 13 20:17:09.532240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 980/1876] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:09 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:09.831791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e9760e25-41cb-4a48-8ccf-418e258603cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:09.832850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e9760e25-41cb-4a48-8ccf-418e258603cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:09.839657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9760e25-41cb-4a48-8ccf-418e258603cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:09.840137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9760e25-41cb-4a48-8ccf-418e258603cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:09.840570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9760e25-41cb-4a48-8ccf-418e258603cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:09.841261 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9760e25-41cb-4a48-8ccf-418e258603cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:09.841704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9760e25-41cb-4a48-8ccf-418e258603cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:09.842109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9760e25-41cb-4a48-8ccf-418e258603cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:09.976172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e9760e25-41cb-4a48-8ccf-418e258603cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:09.989797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e9760e25-41cb-4a48-8ccf-418e258603cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:09.993016 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e9760e25-41cb-4a48-8ccf-418e258603cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:09.995545 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e9760e25-41cb-4a48-8ccf-418e258603cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169919 Sep 13 20:17:09.996618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 897/1877] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:10.556628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a9b46536-9f3f-4ed4-8aae-b1e284c0f396 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:10.557228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a9b46536-9f3f-4ed4-8aae-b1e284c0f396 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:10.564517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9b46536-9f3f-4ed4-8aae-b1e284c0f396 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:10.565000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9b46536-9f3f-4ed4-8aae-b1e284c0f396 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:10.565473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9b46536-9f3f-4ed4-8aae-b1e284c0f396 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:10.566208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9b46536-9f3f-4ed4-8aae-b1e284c0f396 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:10.566710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9b46536-9f3f-4ed4-8aae-b1e284c0f396 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:10.567201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9b46536-9f3f-4ed4-8aae-b1e284c0f396 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:10.698994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a9b46536-9f3f-4ed4-8aae-b1e284c0f396 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:10.708046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a9b46536-9f3f-4ed4-8aae-b1e284c0f396 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.155591 Sep 13 20:17:10.708624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 981/1878] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:10 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:11.025331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-19138099-718d-4c93-adbf-13725626974d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:11.025978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-19138099-718d-4c93-adbf-13725626974d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:11.032640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-19138099-718d-4c93-adbf-13725626974d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:11.033117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-19138099-718d-4c93-adbf-13725626974d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:11.033558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-19138099-718d-4c93-adbf-13725626974d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:11.034244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-19138099-718d-4c93-adbf-13725626974d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:11.034734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-19138099-718d-4c93-adbf-13725626974d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:11.035133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-19138099-718d-4c93-adbf-13725626974d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:11.172146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-19138099-718d-4c93-adbf-13725626974d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:11.181623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-19138099-718d-4c93-adbf-13725626974d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:11.183098 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-19138099-718d-4c93-adbf-13725626974d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:11.184272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-19138099-718d-4c93-adbf-13725626974d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.163014 Sep 13 20:17:11.184840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 898/1879] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:11 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:11.740876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-32f43a74-2e58-406d-b087-798c807b18b0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:11.741800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-32f43a74-2e58-406d-b087-798c807b18b0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:11.752590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-32f43a74-2e58-406d-b087-798c807b18b0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:11.753371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-32f43a74-2e58-406d-b087-798c807b18b0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:11.754066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-32f43a74-2e58-406d-b087-798c807b18b0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:11.755131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-32f43a74-2e58-406d-b087-798c807b18b0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:11.755565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-32f43a74-2e58-406d-b087-798c807b18b0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:11.755978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-32f43a74-2e58-406d-b087-798c807b18b0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:11.899498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-32f43a74-2e58-406d-b087-798c807b18b0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:11.908501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-32f43a74-2e58-406d-b087-798c807b18b0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.174198 Sep 13 20:17:11.909078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 982/1880] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:11 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:12.213652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f74e2da9-3805-490f-b8a3-961f21235f9d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:12.214742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f74e2da9-3805-490f-b8a3-961f21235f9d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:12.224987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f74e2da9-3805-490f-b8a3-961f21235f9d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:12.225462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f74e2da9-3805-490f-b8a3-961f21235f9d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:12.225889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f74e2da9-3805-490f-b8a3-961f21235f9d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:12.226616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f74e2da9-3805-490f-b8a3-961f21235f9d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:12.227050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f74e2da9-3805-490f-b8a3-961f21235f9d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:12.227467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f74e2da9-3805-490f-b8a3-961f21235f9d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:12.368716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f74e2da9-3805-490f-b8a3-961f21235f9d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:12.377642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f74e2da9-3805-490f-b8a3-961f21235f9d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:12.379119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f74e2da9-3805-490f-b8a3-961f21235f9d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:12.380339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f74e2da9-3805-490f-b8a3-961f21235f9d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173553 Sep 13 20:17:12.380893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 899/1881] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:12.936075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dfaacafc-8b68-447d-b2f1-8c3b02f4af9e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:12.936953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dfaacafc-8b68-447d-b2f1-8c3b02f4af9e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:12.947032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfaacafc-8b68-447d-b2f1-8c3b02f4af9e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:12.947691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfaacafc-8b68-447d-b2f1-8c3b02f4af9e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:12.948286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfaacafc-8b68-447d-b2f1-8c3b02f4af9e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:12.949304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfaacafc-8b68-447d-b2f1-8c3b02f4af9e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:12.949883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfaacafc-8b68-447d-b2f1-8c3b02f4af9e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:12.950334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfaacafc-8b68-447d-b2f1-8c3b02f4af9e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:13.090244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dfaacafc-8b68-447d-b2f1-8c3b02f4af9e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:13.098757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dfaacafc-8b68-447d-b2f1-8c3b02f4af9e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169343 Sep 13 20:17:13.099759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 983/1882] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:12 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:13.410991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3706d819-1734-416a-98c6-3617aacc357c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:13.411971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3706d819-1734-416a-98c6-3617aacc357c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:13.422795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3706d819-1734-416a-98c6-3617aacc357c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:13.423593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3706d819-1734-416a-98c6-3617aacc357c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:13.424295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3706d819-1734-416a-98c6-3617aacc357c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:13.425420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3706d819-1734-416a-98c6-3617aacc357c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:13.426148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3706d819-1734-416a-98c6-3617aacc357c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:13.426880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3706d819-1734-416a-98c6-3617aacc357c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:13.565515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3706d819-1734-416a-98c6-3617aacc357c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:13.574720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3706d819-1734-416a-98c6-3617aacc357c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:13.576170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3706d819-1734-416a-98c6-3617aacc357c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:13.577376 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3706d819-1734-416a-98c6-3617aacc357c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173196 Sep 13 20:17:13.577935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 900/1883] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:14.123223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f04a2980-1e1d-4de9-96fe-2a2b481f3c17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:14.123789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f04a2980-1e1d-4de9-96fe-2a2b481f3c17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:14.130298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f04a2980-1e1d-4de9-96fe-2a2b481f3c17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:14.130876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f04a2980-1e1d-4de9-96fe-2a2b481f3c17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:14.131286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f04a2980-1e1d-4de9-96fe-2a2b481f3c17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:14.131974 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f04a2980-1e1d-4de9-96fe-2a2b481f3c17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:14.132417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f04a2980-1e1d-4de9-96fe-2a2b481f3c17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:14.132798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f04a2980-1e1d-4de9-96fe-2a2b481f3c17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:14.263161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f04a2980-1e1d-4de9-96fe-2a2b481f3c17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:14.272101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f04a2980-1e1d-4de9-96fe-2a2b481f3c17 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.152959 Sep 13 20:17:14.272645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 984/1884] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:14 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:14.603773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-eda6a132-88cb-4ffc-a70c-dac256842e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:14.604415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-eda6a132-88cb-4ffc-a70c-dac256842e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:14.612791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eda6a132-88cb-4ffc-a70c-dac256842e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:14.613423 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eda6a132-88cb-4ffc-a70c-dac256842e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:14.613993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eda6a132-88cb-4ffc-a70c-dac256842e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:14.614980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eda6a132-88cb-4ffc-a70c-dac256842e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:14.615632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eda6a132-88cb-4ffc-a70c-dac256842e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:14.616187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eda6a132-88cb-4ffc-a70c-dac256842e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:14.757424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eda6a132-88cb-4ffc-a70c-dac256842e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:14.766474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eda6a132-88cb-4ffc-a70c-dac256842e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:14.767908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eda6a132-88cb-4ffc-a70c-dac256842e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:14.769086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-eda6a132-88cb-4ffc-a70c-dac256842e0c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169311 Sep 13 20:17:14.769641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 901/1885] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:15.296925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5a1c8720-ca62-4163-b3f7-617e850546ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:15.297675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5a1c8720-ca62-4163-b3f7-617e850546ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:15.306003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a1c8720-ca62-4163-b3f7-617e850546ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:15.306735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a1c8720-ca62-4163-b3f7-617e850546ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:15.307274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a1c8720-ca62-4163-b3f7-617e850546ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:15.308133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a1c8720-ca62-4163-b3f7-617e850546ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:15.308694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a1c8720-ca62-4163-b3f7-617e850546ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:15.309225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a1c8720-ca62-4163-b3f7-617e850546ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:15.443606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5a1c8720-ca62-4163-b3f7-617e850546ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:15.452319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5a1c8720-ca62-4163-b3f7-617e850546ec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.160292 Sep 13 20:17:15.452888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 985/1886] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:15 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:15.798559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4b8e7f10-4804-4d22-a38f-aea494702f85 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:15.799545 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4b8e7f10-4804-4d22-a38f-aea494702f85 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:15.807156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b8e7f10-4804-4d22-a38f-aea494702f85 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:15.807629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b8e7f10-4804-4d22-a38f-aea494702f85 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:15.808058 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b8e7f10-4804-4d22-a38f-aea494702f85 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:15.808741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b8e7f10-4804-4d22-a38f-aea494702f85 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:15.809186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b8e7f10-4804-4d22-a38f-aea494702f85 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:15.809601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b8e7f10-4804-4d22-a38f-aea494702f85 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:15.943222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4b8e7f10-4804-4d22-a38f-aea494702f85 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:15.951936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4b8e7f10-4804-4d22-a38f-aea494702f85 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:15.953352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4b8e7f10-4804-4d22-a38f-aea494702f85 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:15.954537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4b8e7f10-4804-4d22-a38f-aea494702f85 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162461 Sep 13 20:17:15.955121 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 902/1887] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:16.480168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1078020c-ac91-464d-8bfe-a4363da28da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:16.481173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1078020c-ac91-464d-8bfe-a4363da28da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:16.491600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1078020c-ac91-464d-8bfe-a4363da28da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:16.492004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1078020c-ac91-464d-8bfe-a4363da28da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:16.492422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1078020c-ac91-464d-8bfe-a4363da28da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:16.493129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1078020c-ac91-464d-8bfe-a4363da28da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:16.493585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1078020c-ac91-464d-8bfe-a4363da28da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:16.493989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1078020c-ac91-464d-8bfe-a4363da28da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:16.498896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:17:16.631135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1078020c-ac91-464d-8bfe-a4363da28da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:16.639788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1078020c-ac91-464d-8bfe-a4363da28da7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166135 Sep 13 20:17:16.640336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 986/1888] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:16 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:16.984106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9ecff597-811e-4591-b0c8-aaa2f683d27c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:16.985118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9ecff597-811e-4591-b0c8-aaa2f683d27c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:16.996983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ecff597-811e-4591-b0c8-aaa2f683d27c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:16.997784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ecff597-811e-4591-b0c8-aaa2f683d27c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:16.998569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ecff597-811e-4591-b0c8-aaa2f683d27c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:16.999750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ecff597-811e-4591-b0c8-aaa2f683d27c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:17.000464 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ecff597-811e-4591-b0c8-aaa2f683d27c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:17.001187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ecff597-811e-4591-b0c8-aaa2f683d27c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:17.132609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9ecff597-811e-4591-b0c8-aaa2f683d27c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:17.141430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9ecff597-811e-4591-b0c8-aaa2f683d27c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:17.142897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9ecff597-811e-4591-b0c8-aaa2f683d27c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:17.144052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9ecff597-811e-4591-b0c8-aaa2f683d27c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166565 Sep 13 20:17:17.144615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 903/1889] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:16 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:17.667923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8bf6c1f3-1d5e-4b51-b0e3-3f1834839e57 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:17.668824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8bf6c1f3-1d5e-4b51-b0e3-3f1834839e57 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:17.679817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bf6c1f3-1d5e-4b51-b0e3-3f1834839e57 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:17.680614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bf6c1f3-1d5e-4b51-b0e3-3f1834839e57 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:17.681340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bf6c1f3-1d5e-4b51-b0e3-3f1834839e57 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:17.682835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bf6c1f3-1d5e-4b51-b0e3-3f1834839e57 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:17.683590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bf6c1f3-1d5e-4b51-b0e3-3f1834839e57 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:17.684292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8bf6c1f3-1d5e-4b51-b0e3-3f1834839e57 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:17.833472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8bf6c1f3-1d5e-4b51-b0e3-3f1834839e57 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:17.842739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8bf6c1f3-1d5e-4b51-b0e3-3f1834839e57 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.181716 Sep 13 20:17:17.843305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 987/1890] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:17 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:18.173782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8e25f324-5b2a-4d22-b9d0-7bba9d992211 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:18.174751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8e25f324-5b2a-4d22-b9d0-7bba9d992211 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:18.182924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e25f324-5b2a-4d22-b9d0-7bba9d992211 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:18.183409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e25f324-5b2a-4d22-b9d0-7bba9d992211 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:18.183843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e25f324-5b2a-4d22-b9d0-7bba9d992211 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:18.185199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e25f324-5b2a-4d22-b9d0-7bba9d992211 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:18.185652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e25f324-5b2a-4d22-b9d0-7bba9d992211 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:18.186080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e25f324-5b2a-4d22-b9d0-7bba9d992211 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:18.322179 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8e25f324-5b2a-4d22-b9d0-7bba9d992211 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:18.331157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8e25f324-5b2a-4d22-b9d0-7bba9d992211 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:18.332585 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8e25f324-5b2a-4d22-b9d0-7bba9d992211 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:18.333716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8e25f324-5b2a-4d22-b9d0-7bba9d992211 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166520 Sep 13 20:17:18.334271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 904/1891] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:18.870047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-53c79ed8-a6bb-4ae8-934e-4f4d8b576a3d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:18.871124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-53c79ed8-a6bb-4ae8-934e-4f4d8b576a3d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:18.882418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53c79ed8-a6bb-4ae8-934e-4f4d8b576a3d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:18.883245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53c79ed8-a6bb-4ae8-934e-4f4d8b576a3d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:18.883960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53c79ed8-a6bb-4ae8-934e-4f4d8b576a3d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:18.885116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53c79ed8-a6bb-4ae8-934e-4f4d8b576a3d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:18.885756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53c79ed8-a6bb-4ae8-934e-4f4d8b576a3d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:18.886530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53c79ed8-a6bb-4ae8-934e-4f4d8b576a3d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:19.017389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-53c79ed8-a6bb-4ae8-934e-4f4d8b576a3d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:19.026359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-53c79ed8-a6bb-4ae8-934e-4f4d8b576a3d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.163038 Sep 13 20:17:19.026973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 988/1892] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:18 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:19.363703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5afebd43-d1d8-4dbc-844d-bb1efb6bfd2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:19.364702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5afebd43-d1d8-4dbc-844d-bb1efb6bfd2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:19.372075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5afebd43-d1d8-4dbc-844d-bb1efb6bfd2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:19.372576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5afebd43-d1d8-4dbc-844d-bb1efb6bfd2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:19.373023 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5afebd43-d1d8-4dbc-844d-bb1efb6bfd2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:19.373739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5afebd43-d1d8-4dbc-844d-bb1efb6bfd2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:19.374204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5afebd43-d1d8-4dbc-844d-bb1efb6bfd2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:19.374674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5afebd43-d1d8-4dbc-844d-bb1efb6bfd2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:19.511425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5afebd43-d1d8-4dbc-844d-bb1efb6bfd2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:19.520410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5afebd43-d1d8-4dbc-844d-bb1efb6bfd2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:19.521949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5afebd43-d1d8-4dbc-844d-bb1efb6bfd2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:19.523146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5afebd43-d1d8-4dbc-844d-bb1efb6bfd2c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166119 Sep 13 20:17:19.523700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 905/1893] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:20.054206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8f2fc191-fe52-4896-b2ee-0b3a80088412 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:20.055205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8f2fc191-fe52-4896-b2ee-0b3a80088412 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:20.066327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8f2fc191-fe52-4896-b2ee-0b3a80088412 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:20.067175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8f2fc191-fe52-4896-b2ee-0b3a80088412 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:20.067939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8f2fc191-fe52-4896-b2ee-0b3a80088412 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:20.068962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8f2fc191-fe52-4896-b2ee-0b3a80088412 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:20.069408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8f2fc191-fe52-4896-b2ee-0b3a80088412 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:20.069834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8f2fc191-fe52-4896-b2ee-0b3a80088412 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:20.206912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8f2fc191-fe52-4896-b2ee-0b3a80088412 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:20.216170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8f2fc191-fe52-4896-b2ee-0b3a80088412 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168571 Sep 13 20:17:20.216751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 989/1894] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:20 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:20.547781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-60b228fe-ba0a-4fa8-9286-7e08fabd284f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:20.548458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-60b228fe-ba0a-4fa8-9286-7e08fabd284f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:20.555366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-60b228fe-ba0a-4fa8-9286-7e08fabd284f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:20.555845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-60b228fe-ba0a-4fa8-9286-7e08fabd284f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:20.556284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-60b228fe-ba0a-4fa8-9286-7e08fabd284f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:20.556977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-60b228fe-ba0a-4fa8-9286-7e08fabd284f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:20.557433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-60b228fe-ba0a-4fa8-9286-7e08fabd284f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:20.557854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-60b228fe-ba0a-4fa8-9286-7e08fabd284f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:20.702348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-60b228fe-ba0a-4fa8-9286-7e08fabd284f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:20.713156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-60b228fe-ba0a-4fa8-9286-7e08fabd284f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:20.714638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-60b228fe-ba0a-4fa8-9286-7e08fabd284f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:20.715806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-60b228fe-ba0a-4fa8-9286-7e08fabd284f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172039 Sep 13 20:17:20.716373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 906/1895] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:21.243380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f25b4e4d-953b-4e30-9db5-04f2f00f9c2a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:21.244387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f25b4e4d-953b-4e30-9db5-04f2f00f9c2a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:21.255595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f25b4e4d-953b-4e30-9db5-04f2f00f9c2a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:21.256321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f25b4e4d-953b-4e30-9db5-04f2f00f9c2a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:21.256755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f25b4e4d-953b-4e30-9db5-04f2f00f9c2a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:21.257448 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f25b4e4d-953b-4e30-9db5-04f2f00f9c2a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:21.257893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f25b4e4d-953b-4e30-9db5-04f2f00f9c2a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:21.258316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f25b4e4d-953b-4e30-9db5-04f2f00f9c2a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:21.397396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f25b4e4d-953b-4e30-9db5-04f2f00f9c2a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:21.406180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f25b4e4d-953b-4e30-9db5-04f2f00f9c2a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169340 Sep 13 20:17:21.408489 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 990/1896] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:21 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:21.744801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-292486b7-4f7b-444a-ba05-bb89fa31efc4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:21.745815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-292486b7-4f7b-444a-ba05-bb89fa31efc4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:21.756872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-292486b7-4f7b-444a-ba05-bb89fa31efc4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:21.757554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-292486b7-4f7b-444a-ba05-bb89fa31efc4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:21.758272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-292486b7-4f7b-444a-ba05-bb89fa31efc4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:21.759473 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-292486b7-4f7b-444a-ba05-bb89fa31efc4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:21.760232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-292486b7-4f7b-444a-ba05-bb89fa31efc4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:21.760926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-292486b7-4f7b-444a-ba05-bb89fa31efc4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:21.895703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-292486b7-4f7b-444a-ba05-bb89fa31efc4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:21.898310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:17:21.906510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-292486b7-4f7b-444a-ba05-bb89fa31efc4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:21.907935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-292486b7-4f7b-444a-ba05-bb89fa31efc4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:21.909123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-292486b7-4f7b-444a-ba05-bb89fa31efc4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.171012 Sep 13 20:17:21.909685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 907/1897] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:22.435296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7cdcbb9c-de63-43e7-a9d5-76ae0106e17e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:22.436311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7cdcbb9c-de63-43e7-a9d5-76ae0106e17e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:22.447234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7cdcbb9c-de63-43e7-a9d5-76ae0106e17e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:22.448019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7cdcbb9c-de63-43e7-a9d5-76ae0106e17e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:22.448735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7cdcbb9c-de63-43e7-a9d5-76ae0106e17e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:22.449857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7cdcbb9c-de63-43e7-a9d5-76ae0106e17e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:22.450645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7cdcbb9c-de63-43e7-a9d5-76ae0106e17e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:22.451342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7cdcbb9c-de63-43e7-a9d5-76ae0106e17e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:22.612101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7cdcbb9c-de63-43e7-a9d5-76ae0106e17e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:22.622278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7cdcbb9c-de63-43e7-a9d5-76ae0106e17e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.193564 Sep 13 20:17:22.623047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 991/1898] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:22 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:22.939098 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d0ce9952-8790-4ec4-9f89-345064d98c3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:22.940020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d0ce9952-8790-4ec4-9f89-345064d98c3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:22.948533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0ce9952-8790-4ec4-9f89-345064d98c3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:22.948954 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0ce9952-8790-4ec4-9f89-345064d98c3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:22.949388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0ce9952-8790-4ec4-9f89-345064d98c3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:22.950077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0ce9952-8790-4ec4-9f89-345064d98c3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:22.950562 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0ce9952-8790-4ec4-9f89-345064d98c3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:22.950987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d0ce9952-8790-4ec4-9f89-345064d98c3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:23.095140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d0ce9952-8790-4ec4-9f89-345064d98c3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:23.109408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d0ce9952-8790-4ec4-9f89-345064d98c3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:23.111722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d0ce9952-8790-4ec4-9f89-345064d98c3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:23.113559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d0ce9952-8790-4ec4-9f89-345064d98c3d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.180756 Sep 13 20:17:23.114416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 908/1899] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:22 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:23.649348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5a8288a2-4ca6-4be3-a9ae-f2ce3c9a3765 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:23.650033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5a8288a2-4ca6-4be3-a9ae-f2ce3c9a3765 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:23.660076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a8288a2-4ca6-4be3-a9ae-f2ce3c9a3765 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:23.660731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a8288a2-4ca6-4be3-a9ae-f2ce3c9a3765 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:23.661362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a8288a2-4ca6-4be3-a9ae-f2ce3c9a3765 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:23.662635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a8288a2-4ca6-4be3-a9ae-f2ce3c9a3765 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:23.662875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a8288a2-4ca6-4be3-a9ae-f2ce3c9a3765 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:23.663296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a8288a2-4ca6-4be3-a9ae-f2ce3c9a3765 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:23.795513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5a8288a2-4ca6-4be3-a9ae-f2ce3c9a3765 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:23.803968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5a8288a2-4ca6-4be3-a9ae-f2ce3c9a3765 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.160843 Sep 13 20:17:23.804509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 992/1900] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:23 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:24.143955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f2e23535-a3fd-4f4e-9ef4-fee4c469d17a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:24.144868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f2e23535-a3fd-4f4e-9ef4-fee4c469d17a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:24.152673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f2e23535-a3fd-4f4e-9ef4-fee4c469d17a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:24.153171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f2e23535-a3fd-4f4e-9ef4-fee4c469d17a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:24.153619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f2e23535-a3fd-4f4e-9ef4-fee4c469d17a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:24.154337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f2e23535-a3fd-4f4e-9ef4-fee4c469d17a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:24.154828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f2e23535-a3fd-4f4e-9ef4-fee4c469d17a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:24.155267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f2e23535-a3fd-4f4e-9ef4-fee4c469d17a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:24.293766 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f2e23535-a3fd-4f4e-9ef4-fee4c469d17a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:24.304878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f2e23535-a3fd-4f4e-9ef4-fee4c469d17a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:24.307295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f2e23535-a3fd-4f4e-9ef4-fee4c469d17a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:24.309203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f2e23535-a3fd-4f4e-9ef4-fee4c469d17a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.171764 Sep 13 20:17:24.310086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 909/1901] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:24.827245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2d09da83-246f-4257-81aa-2de73989f006 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:24.827851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2d09da83-246f-4257-81aa-2de73989f006 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:24.835223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d09da83-246f-4257-81aa-2de73989f006 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:24.835717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d09da83-246f-4257-81aa-2de73989f006 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:24.836145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d09da83-246f-4257-81aa-2de73989f006 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:24.836822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d09da83-246f-4257-81aa-2de73989f006 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:24.837260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d09da83-246f-4257-81aa-2de73989f006 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:24.837668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d09da83-246f-4257-81aa-2de73989f006 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:24.976440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2d09da83-246f-4257-81aa-2de73989f006 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:24.989622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2d09da83-246f-4257-81aa-2de73989f006 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165938 Sep 13 20:17:24.990234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 993/1902] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:24 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:25.339210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-87f1c4de-a081-456c-886c-033dd3ba722d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:25.339807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-87f1c4de-a081-456c-886c-033dd3ba722d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:25.346764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87f1c4de-a081-456c-886c-033dd3ba722d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:25.347240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87f1c4de-a081-456c-886c-033dd3ba722d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:25.347679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87f1c4de-a081-456c-886c-033dd3ba722d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:25.348368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87f1c4de-a081-456c-886c-033dd3ba722d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:25.348817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87f1c4de-a081-456c-886c-033dd3ba722d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:25.349235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87f1c4de-a081-456c-886c-033dd3ba722d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:25.482081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-87f1c4de-a081-456c-886c-033dd3ba722d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:25.490931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-87f1c4de-a081-456c-886c-033dd3ba722d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:25.492366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-87f1c4de-a081-456c-886c-033dd3ba722d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:25.493549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-87f1c4de-a081-456c-886c-033dd3ba722d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158750 Sep 13 20:17:25.494115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 910/1903] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:26.020064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-96ac7128-d7b2-4543-9e70-8a56697a983c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:26.021085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-96ac7128-d7b2-4543-9e70-8a56697a983c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:26.032146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96ac7128-d7b2-4543-9e70-8a56697a983c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:26.032948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96ac7128-d7b2-4543-9e70-8a56697a983c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:26.033669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96ac7128-d7b2-4543-9e70-8a56697a983c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:26.034864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96ac7128-d7b2-4543-9e70-8a56697a983c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:26.035613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96ac7128-d7b2-4543-9e70-8a56697a983c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:26.036316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-96ac7128-d7b2-4543-9e70-8a56697a983c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:26.182491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-96ac7128-d7b2-4543-9e70-8a56697a983c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:26.191198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-96ac7128-d7b2-4543-9e70-8a56697a983c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.177665 Sep 13 20:17:26.191768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 994/1904] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:26 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:26.518674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-04cd9b3c-c70a-41e1-a8b9-3b9c11cfa402 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:26.519280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-04cd9b3c-c70a-41e1-a8b9-3b9c11cfa402 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:26.525672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04cd9b3c-c70a-41e1-a8b9-3b9c11cfa402 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:26.526146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04cd9b3c-c70a-41e1-a8b9-3b9c11cfa402 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:26.526613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04cd9b3c-c70a-41e1-a8b9-3b9c11cfa402 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:26.527304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04cd9b3c-c70a-41e1-a8b9-3b9c11cfa402 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:26.527772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04cd9b3c-c70a-41e1-a8b9-3b9c11cfa402 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:26.528185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04cd9b3c-c70a-41e1-a8b9-3b9c11cfa402 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:26.659288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-04cd9b3c-c70a-41e1-a8b9-3b9c11cfa402 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:26.669232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-04cd9b3c-c70a-41e1-a8b9-3b9c11cfa402 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:26.670705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-04cd9b3c-c70a-41e1-a8b9-3b9c11cfa402 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:26.671861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-04cd9b3c-c70a-41e1-a8b9-3b9c11cfa402 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.157153 Sep 13 20:17:26.672415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 911/1905] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:27.219990 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b8819151-6173-4757-8f11-49d443e74700 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:27.221041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b8819151-6173-4757-8f11-49d443e74700 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:27.229548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b8819151-6173-4757-8f11-49d443e74700 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:27.230026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b8819151-6173-4757-8f11-49d443e74700 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:27.230495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b8819151-6173-4757-8f11-49d443e74700 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:27.231185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b8819151-6173-4757-8f11-49d443e74700 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:27.231642 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b8819151-6173-4757-8f11-49d443e74700 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:27.232068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b8819151-6173-4757-8f11-49d443e74700 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:27.366080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b8819151-6173-4757-8f11-49d443e74700 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:27.374780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b8819151-6173-4757-8f11-49d443e74700 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161329 Sep 13 20:17:27.375355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 995/1906] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:27 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:27.701563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bf9f09ca-334b-42b2-9af6-034dd78da8aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:27.702670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bf9f09ca-334b-42b2-9af6-034dd78da8aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:27.712371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bf9f09ca-334b-42b2-9af6-034dd78da8aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:27.712875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bf9f09ca-334b-42b2-9af6-034dd78da8aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:27.713293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bf9f09ca-334b-42b2-9af6-034dd78da8aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:27.713985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bf9f09ca-334b-42b2-9af6-034dd78da8aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:27.714477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bf9f09ca-334b-42b2-9af6-034dd78da8aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:27.714896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bf9f09ca-334b-42b2-9af6-034dd78da8aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:27.854287 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bf9f09ca-334b-42b2-9af6-034dd78da8aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:27.863404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bf9f09ca-334b-42b2-9af6-034dd78da8aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:27.864846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bf9f09ca-334b-42b2-9af6-034dd78da8aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:27.866139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bf9f09ca-334b-42b2-9af6-034dd78da8aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.171188 Sep 13 20:17:27.866738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 912/1907] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:27 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:28.399734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c3e606da-88fa-43ac-9790-e477172d6dec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:28.400325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c3e606da-88fa-43ac-9790-e477172d6dec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:28.407399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3e606da-88fa-43ac-9790-e477172d6dec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:28.407878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3e606da-88fa-43ac-9790-e477172d6dec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:28.408306 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3e606da-88fa-43ac-9790-e477172d6dec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:28.409014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3e606da-88fa-43ac-9790-e477172d6dec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:28.409664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3e606da-88fa-43ac-9790-e477172d6dec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:28.410082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3e606da-88fa-43ac-9790-e477172d6dec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:28.564055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c3e606da-88fa-43ac-9790-e477172d6dec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:28.572578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c3e606da-88fa-43ac-9790-e477172d6dec tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.177504 Sep 13 20:17:28.573188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 996/1908] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:28 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:28.896325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-07b13dc9-5a1e-4063-96e2-7e01ff0a6cd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:28.897240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-07b13dc9-5a1e-4063-96e2-7e01ff0a6cd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:28.908565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07b13dc9-5a1e-4063-96e2-7e01ff0a6cd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:28.909353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07b13dc9-5a1e-4063-96e2-7e01ff0a6cd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:28.910123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07b13dc9-5a1e-4063-96e2-7e01ff0a6cd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:28.911337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07b13dc9-5a1e-4063-96e2-7e01ff0a6cd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:28.912226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07b13dc9-5a1e-4063-96e2-7e01ff0a6cd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:28.912657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07b13dc9-5a1e-4063-96e2-7e01ff0a6cd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:29.055327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-07b13dc9-5a1e-4063-96e2-7e01ff0a6cd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:29.064890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-07b13dc9-5a1e-4063-96e2-7e01ff0a6cd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:29.066457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-07b13dc9-5a1e-4063-96e2-7e01ff0a6cd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:29.067745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-07b13dc9-5a1e-4063-96e2-7e01ff0a6cd0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.178343 Sep 13 20:17:29.068619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 913/1909] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:29.596830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7dab91d1-0e06-46c4-aa5a-0a64a5ce02c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:29.597438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7dab91d1-0e06-46c4-aa5a-0a64a5ce02c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:29.604589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7dab91d1-0e06-46c4-aa5a-0a64a5ce02c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:29.605068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7dab91d1-0e06-46c4-aa5a-0a64a5ce02c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:29.605464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7dab91d1-0e06-46c4-aa5a-0a64a5ce02c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:29.606174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7dab91d1-0e06-46c4-aa5a-0a64a5ce02c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:29.606658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7dab91d1-0e06-46c4-aa5a-0a64a5ce02c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:29.607070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7dab91d1-0e06-46c4-aa5a-0a64a5ce02c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:29.738626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7dab91d1-0e06-46c4-aa5a-0a64a5ce02c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:29.747256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7dab91d1-0e06-46c4-aa5a-0a64a5ce02c0 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.154427 Sep 13 20:17:29.747839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 997/1910] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:29 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:30.095006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8fc02039-5400-445e-87ce-2799f0ce4a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:30.095610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8fc02039-5400-445e-87ce-2799f0ce4a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:30.102248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8fc02039-5400-445e-87ce-2799f0ce4a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:30.102755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8fc02039-5400-445e-87ce-2799f0ce4a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:30.103185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8fc02039-5400-445e-87ce-2799f0ce4a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:30.103873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8fc02039-5400-445e-87ce-2799f0ce4a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:30.104343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8fc02039-5400-445e-87ce-2799f0ce4a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:30.104755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8fc02039-5400-445e-87ce-2799f0ce4a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:30.237357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8fc02039-5400-445e-87ce-2799f0ce4a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:30.246812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8fc02039-5400-445e-87ce-2799f0ce4a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:30.248233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8fc02039-5400-445e-87ce-2799f0ce4a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:30.249385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8fc02039-5400-445e-87ce-2799f0ce4a44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158710 Sep 13 20:17:30.249943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 914/1911] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:30 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:30.775013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9da4b3f0-d3ef-4568-aed6-6146342f4c91 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:30.775777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9da4b3f0-d3ef-4568-aed6-6146342f4c91 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:30.784153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9da4b3f0-d3ef-4568-aed6-6146342f4c91 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:30.784751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9da4b3f0-d3ef-4568-aed6-6146342f4c91 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:30.785288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9da4b3f0-d3ef-4568-aed6-6146342f4c91 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:30.786142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9da4b3f0-d3ef-4568-aed6-6146342f4c91 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:30.786748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9da4b3f0-d3ef-4568-aed6-6146342f4c91 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:30.787276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9da4b3f0-d3ef-4568-aed6-6146342f4c91 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:30.931332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9da4b3f0-d3ef-4568-aed6-6146342f4c91 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:30.942005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9da4b3f0-d3ef-4568-aed6-6146342f4c91 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.173417 Sep 13 20:17:30.942780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 998/1912] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:30 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:31.278407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-048e7f7c-331e-4cef-bfc0-18c9edd647d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:31.279676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-048e7f7c-331e-4cef-bfc0-18c9edd647d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:31.290601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-048e7f7c-331e-4cef-bfc0-18c9edd647d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:31.291388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-048e7f7c-331e-4cef-bfc0-18c9edd647d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:31.292098 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-048e7f7c-331e-4cef-bfc0-18c9edd647d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:31.293220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-048e7f7c-331e-4cef-bfc0-18c9edd647d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:31.293954 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-048e7f7c-331e-4cef-bfc0-18c9edd647d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:31.294695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-048e7f7c-331e-4cef-bfc0-18c9edd647d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:31.430699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-048e7f7c-331e-4cef-bfc0-18c9edd647d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:31.439559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-048e7f7c-331e-4cef-bfc0-18c9edd647d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:31.441036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-048e7f7c-331e-4cef-bfc0-18c9edd647d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:31.442185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-048e7f7c-331e-4cef-bfc0-18c9edd647d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.170532 Sep 13 20:17:31.442780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 915/1913] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:31.971289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d9c3e647-a0e5-41a2-9b04-430ae526e8cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:31.972218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d9c3e647-a0e5-41a2-9b04-430ae526e8cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:31.976753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:17:31.982569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d9c3e647-a0e5-41a2-9b04-430ae526e8cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:31.983040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d9c3e647-a0e5-41a2-9b04-430ae526e8cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:31.983463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d9c3e647-a0e5-41a2-9b04-430ae526e8cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:31.984154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d9c3e647-a0e5-41a2-9b04-430ae526e8cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:31.984603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d9c3e647-a0e5-41a2-9b04-430ae526e8cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:31.985026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d9c3e647-a0e5-41a2-9b04-430ae526e8cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:32.120862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d9c3e647-a0e5-41a2-9b04-430ae526e8cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:32.133135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d9c3e647-a0e5-41a2-9b04-430ae526e8cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168118 Sep 13 20:17:32.133895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 999/1914] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:31 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:32.472565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c5c6254b-7e30-43eb-a65f-0775daa81d63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:32.473585 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c5c6254b-7e30-43eb-a65f-0775daa81d63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:32.477313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=52 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:17:32.482860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5c6254b-7e30-43eb-a65f-0775daa81d63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:32.483235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5c6254b-7e30-43eb-a65f-0775daa81d63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:32.483664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5c6254b-7e30-43eb-a65f-0775daa81d63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:32.484351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5c6254b-7e30-43eb-a65f-0775daa81d63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:32.484796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5c6254b-7e30-43eb-a65f-0775daa81d63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:32.485217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5c6254b-7e30-43eb-a65f-0775daa81d63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:32.863930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c5c6254b-7e30-43eb-a65f-0775daa81d63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:32.872942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c5c6254b-7e30-43eb-a65f-0775daa81d63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:32.874395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c5c6254b-7e30-43eb-a65f-0775daa81d63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:32.875639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c5c6254b-7e30-43eb-a65f-0775daa81d63 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.409680 Sep 13 20:17:32.876175 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 916/1915] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:33.160951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4a1b207a-d47f-40fe-be1f-a28ef51acf79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:33.161762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4a1b207a-d47f-40fe-be1f-a28ef51acf79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:33.169782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a1b207a-d47f-40fe-be1f-a28ef51acf79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:33.170267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a1b207a-d47f-40fe-be1f-a28ef51acf79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:33.170725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a1b207a-d47f-40fe-be1f-a28ef51acf79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:33.171414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a1b207a-d47f-40fe-be1f-a28ef51acf79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:33.171864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a1b207a-d47f-40fe-be1f-a28ef51acf79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:33.172283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a1b207a-d47f-40fe-be1f-a28ef51acf79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:33.301694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4a1b207a-d47f-40fe-be1f-a28ef51acf79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:33.311030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4a1b207a-d47f-40fe-be1f-a28ef51acf79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.156611 Sep 13 20:17:33.311841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1000/1916] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:33 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:33.905595 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c31fe5d8-3d9d-43e8-95f4-6b569eb45a95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:33.906490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c31fe5d8-3d9d-43e8-95f4-6b569eb45a95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:33.917627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c31fe5d8-3d9d-43e8-95f4-6b569eb45a95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:33.918113 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c31fe5d8-3d9d-43e8-95f4-6b569eb45a95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:33.918588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c31fe5d8-3d9d-43e8-95f4-6b569eb45a95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:33.919275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c31fe5d8-3d9d-43e8-95f4-6b569eb45a95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:33.919724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c31fe5d8-3d9d-43e8-95f4-6b569eb45a95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:33.920145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c31fe5d8-3d9d-43e8-95f4-6b569eb45a95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:34.051359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c31fe5d8-3d9d-43e8-95f4-6b569eb45a95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:34.060137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c31fe5d8-3d9d-43e8-95f4-6b569eb45a95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:34.061607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c31fe5d8-3d9d-43e8-95f4-6b569eb45a95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:34.062801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c31fe5d8-3d9d-43e8-95f4-6b569eb45a95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.164077 Sep 13 20:17:34.063350 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 917/1917] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:34.338971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e6857da2-ea54-40ba-b52e-964600e80dcf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:34.340651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e6857da2-ea54-40ba-b52e-964600e80dcf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:34.349552 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6857da2-ea54-40ba-b52e-964600e80dcf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:34.350197 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6857da2-ea54-40ba-b52e-964600e80dcf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:34.351004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6857da2-ea54-40ba-b52e-964600e80dcf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:34.351922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6857da2-ea54-40ba-b52e-964600e80dcf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:34.352558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6857da2-ea54-40ba-b52e-964600e80dcf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:34.353064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6857da2-ea54-40ba-b52e-964600e80dcf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:34.490768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e6857da2-ea54-40ba-b52e-964600e80dcf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:34.499901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e6857da2-ea54-40ba-b52e-964600e80dcf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167611 Sep 13 20:17:34.500483 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1001/1918] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:34 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:35.092871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-439dae2e-ecd9-40dd-aa80-e9750cfcea55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:35.093877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-439dae2e-ecd9-40dd-aa80-e9750cfcea55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:35.104936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-439dae2e-ecd9-40dd-aa80-e9750cfcea55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:35.105743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-439dae2e-ecd9-40dd-aa80-e9750cfcea55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:35.106483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-439dae2e-ecd9-40dd-aa80-e9750cfcea55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:35.107651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-439dae2e-ecd9-40dd-aa80-e9750cfcea55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:35.108409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-439dae2e-ecd9-40dd-aa80-e9750cfcea55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:35.109119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-439dae2e-ecd9-40dd-aa80-e9750cfcea55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:35.276661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-439dae2e-ecd9-40dd-aa80-e9750cfcea55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:35.285872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-439dae2e-ecd9-40dd-aa80-e9750cfcea55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:35.287545 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-439dae2e-ecd9-40dd-aa80-e9750cfcea55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:35.288438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-439dae2e-ecd9-40dd-aa80-e9750cfcea55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.202231 Sep 13 20:17:35.288995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 918/1919] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:35 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:35.523736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cd7faa7c-bff4-410b-be5d-6f9c04eb1028 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:35.524307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cd7faa7c-bff4-410b-be5d-6f9c04eb1028 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:35.531306 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd7faa7c-bff4-410b-be5d-6f9c04eb1028 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:35.531781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd7faa7c-bff4-410b-be5d-6f9c04eb1028 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:35.532198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd7faa7c-bff4-410b-be5d-6f9c04eb1028 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:35.532874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd7faa7c-bff4-410b-be5d-6f9c04eb1028 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:35.533314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd7faa7c-bff4-410b-be5d-6f9c04eb1028 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:35.533724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd7faa7c-bff4-410b-be5d-6f9c04eb1028 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:35.662027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cd7faa7c-bff4-410b-be5d-6f9c04eb1028 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:35.664250 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:17:35.672354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cd7faa7c-bff4-410b-be5d-6f9c04eb1028 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.152510 Sep 13 20:17:35.673016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1002/1920] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:35 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:36.318223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-eaec187a-8a57-4b92-86e2-8540f71c9b67 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:36.319218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-eaec187a-8a57-4b92-86e2-8540f71c9b67 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:36.327043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eaec187a-8a57-4b92-86e2-8540f71c9b67 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:36.327531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eaec187a-8a57-4b92-86e2-8540f71c9b67 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:36.327948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eaec187a-8a57-4b92-86e2-8540f71c9b67 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:36.328629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eaec187a-8a57-4b92-86e2-8540f71c9b67 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:36.329072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eaec187a-8a57-4b92-86e2-8540f71c9b67 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:36.329488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eaec187a-8a57-4b92-86e2-8540f71c9b67 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:36.466309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eaec187a-8a57-4b92-86e2-8540f71c9b67 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:36.475543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eaec187a-8a57-4b92-86e2-8540f71c9b67 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:36.476977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eaec187a-8a57-4b92-86e2-8540f71c9b67 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:36.478154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-eaec187a-8a57-4b92-86e2-8540f71c9b67 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166553 Sep 13 20:17:36.478736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 919/1921] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:36.699028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f1fd803f-0992-4a83-aa17-133cae7b64ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:36.700031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f1fd803f-0992-4a83-aa17-133cae7b64ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:36.711363 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1fd803f-0992-4a83-aa17-133cae7b64ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:36.712151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1fd803f-0992-4a83-aa17-133cae7b64ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:36.712810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1fd803f-0992-4a83-aa17-133cae7b64ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:36.713503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1fd803f-0992-4a83-aa17-133cae7b64ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:36.713954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1fd803f-0992-4a83-aa17-133cae7b64ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:36.714396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1fd803f-0992-4a83-aa17-133cae7b64ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:36.850963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f1fd803f-0992-4a83-aa17-133cae7b64ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:36.861704 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f1fd803f-0992-4a83-aa17-133cae7b64ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169043 Sep 13 20:17:36.862500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1003/1922] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:36 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:37.510107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-75972f23-445a-44ad-b76d-e7f881cc5541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:37.511183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-75972f23-445a-44ad-b76d-e7f881cc5541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:37.524619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-75972f23-445a-44ad-b76d-e7f881cc5541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:37.525654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-75972f23-445a-44ad-b76d-e7f881cc5541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:37.526711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-75972f23-445a-44ad-b76d-e7f881cc5541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:37.527187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-75972f23-445a-44ad-b76d-e7f881cc5541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:37.527831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-75972f23-445a-44ad-b76d-e7f881cc5541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:37.528441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-75972f23-445a-44ad-b76d-e7f881cc5541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:37.667111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-75972f23-445a-44ad-b76d-e7f881cc5541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:37.675821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-75972f23-445a-44ad-b76d-e7f881cc5541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:37.677261 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-75972f23-445a-44ad-b76d-e7f881cc5541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:37.678441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-75972f23-445a-44ad-b76d-e7f881cc5541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.177625 Sep 13 20:17:37.679006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 920/1923] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:37.897100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e692320a-c571-475c-b585-f31577c5fd56 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:37.897850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e692320a-c571-475c-b585-f31577c5fd56 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:37.908378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e692320a-c571-475c-b585-f31577c5fd56 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:37.909076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e692320a-c571-475c-b585-f31577c5fd56 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:37.910151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e692320a-c571-475c-b585-f31577c5fd56 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:37.911271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e692320a-c571-475c-b585-f31577c5fd56 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:37.911809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e692320a-c571-475c-b585-f31577c5fd56 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:37.912506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e692320a-c571-475c-b585-f31577c5fd56 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:38.043686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e692320a-c571-475c-b585-f31577c5fd56 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:38.052216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e692320a-c571-475c-b585-f31577c5fd56 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161969 Sep 13 20:17:38.052780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1004/1924] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:37 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:38.703942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f1994534-7d29-4973-9b51-2e31bfb55bbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:38.704568 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f1994534-7d29-4973-9b51-2e31bfb55bbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:38.711756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1994534-7d29-4973-9b51-2e31bfb55bbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:38.712235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1994534-7d29-4973-9b51-2e31bfb55bbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:38.712667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1994534-7d29-4973-9b51-2e31bfb55bbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:38.713360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1994534-7d29-4973-9b51-2e31bfb55bbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:38.713812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1994534-7d29-4973-9b51-2e31bfb55bbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:38.714301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f1994534-7d29-4973-9b51-2e31bfb55bbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:38.855975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f1994534-7d29-4973-9b51-2e31bfb55bbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:38.865034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f1994534-7d29-4973-9b51-2e31bfb55bbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:38.866484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f1994534-7d29-4973-9b51-2e31bfb55bbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:38.867649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f1994534-7d29-4973-9b51-2e31bfb55bbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167727 Sep 13 20:17:38.868213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 921/1925] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:39.078264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e1d43755-876b-4aa1-90d5-18c9ea1157e5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:39.079028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e1d43755-876b-4aa1-90d5-18c9ea1157e5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:39.087891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1d43755-876b-4aa1-90d5-18c9ea1157e5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:39.088527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1d43755-876b-4aa1-90d5-18c9ea1157e5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:39.089079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1d43755-876b-4aa1-90d5-18c9ea1157e5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:39.089932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1d43755-876b-4aa1-90d5-18c9ea1157e5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:39.090540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1d43755-876b-4aa1-90d5-18c9ea1157e5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:39.091065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1d43755-876b-4aa1-90d5-18c9ea1157e5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:39.222393 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e1d43755-876b-4aa1-90d5-18c9ea1157e5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:39.231295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e1d43755-876b-4aa1-90d5-18c9ea1157e5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158248 Sep 13 20:17:39.231867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1005/1926] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:39 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:39.893350 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fa496877-195a-4a0a-8b13-1456ac85e84a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:39.893932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fa496877-195a-4a0a-8b13-1456ac85e84a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:39.900876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa496877-195a-4a0a-8b13-1456ac85e84a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:39.901359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa496877-195a-4a0a-8b13-1456ac85e84a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:39.901787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa496877-195a-4a0a-8b13-1456ac85e84a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:39.902490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa496877-195a-4a0a-8b13-1456ac85e84a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:39.902969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa496877-195a-4a0a-8b13-1456ac85e84a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:39.903377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa496877-195a-4a0a-8b13-1456ac85e84a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:40.042615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fa496877-195a-4a0a-8b13-1456ac85e84a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:40.051661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fa496877-195a-4a0a-8b13-1456ac85e84a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:40.053138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fa496877-195a-4a0a-8b13-1456ac85e84a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:40.054334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fa496877-195a-4a0a-8b13-1456ac85e84a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165037 Sep 13 20:17:40.054963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 922/1927] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:40.254636 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5c4636f1-f5ea-4d02-a417-e6e4df016716 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:40.255192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5c4636f1-f5ea-4d02-a417-e6e4df016716 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:40.263114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c4636f1-f5ea-4d02-a417-e6e4df016716 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:40.263815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c4636f1-f5ea-4d02-a417-e6e4df016716 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:40.264368 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c4636f1-f5ea-4d02-a417-e6e4df016716 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:40.265479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c4636f1-f5ea-4d02-a417-e6e4df016716 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:40.266132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c4636f1-f5ea-4d02-a417-e6e4df016716 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:40.266758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5c4636f1-f5ea-4d02-a417-e6e4df016716 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:40.404186 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5c4636f1-f5ea-4d02-a417-e6e4df016716 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:40.417059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5c4636f1-f5ea-4d02-a417-e6e4df016716 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166361 Sep 13 20:17:40.417714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1006/1928] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:40 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:41.084247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-42f510cb-ba35-42d4-ae19-e450a30f9eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:41.085512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-42f510cb-ba35-42d4-ae19-e450a30f9eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:41.094024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42f510cb-ba35-42d4-ae19-e450a30f9eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:41.094540 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42f510cb-ba35-42d4-ae19-e450a30f9eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:41.094975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42f510cb-ba35-42d4-ae19-e450a30f9eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:41.095667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42f510cb-ba35-42d4-ae19-e450a30f9eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:41.096119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42f510cb-ba35-42d4-ae19-e450a30f9eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:41.096537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42f510cb-ba35-42d4-ae19-e450a30f9eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:41.228008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-42f510cb-ba35-42d4-ae19-e450a30f9eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:41.242197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-42f510cb-ba35-42d4-ae19-e450a30f9eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:41.244532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-42f510cb-ba35-42d4-ae19-e450a30f9eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:41.246401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-42f510cb-ba35-42d4-ae19-e450a30f9eb3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168853 Sep 13 20:17:41.247204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 923/1929] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:41 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:41.440733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e2762f5b-a112-4c49-a065-931cc4f9a4f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:41.441362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e2762f5b-a112-4c49-a065-931cc4f9a4f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:41.448011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2762f5b-a112-4c49-a065-931cc4f9a4f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:41.448522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2762f5b-a112-4c49-a065-931cc4f9a4f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:41.448946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2762f5b-a112-4c49-a065-931cc4f9a4f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:41.449625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2762f5b-a112-4c49-a065-931cc4f9a4f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:41.450059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2762f5b-a112-4c49-a065-931cc4f9a4f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:41.450501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2762f5b-a112-4c49-a065-931cc4f9a4f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:41.601960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e2762f5b-a112-4c49-a065-931cc4f9a4f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:41.610444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e2762f5b-a112-4c49-a065-931cc4f9a4f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.173664 Sep 13 20:17:41.611027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1007/1930] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:41 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:42.277743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-403ed32e-4b05-4f08-aeb5-c231bfb2a1fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:42.278737 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-403ed32e-4b05-4f08-aeb5-c231bfb2a1fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:42.289595 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-403ed32e-4b05-4f08-aeb5-c231bfb2a1fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:42.290435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-403ed32e-4b05-4f08-aeb5-c231bfb2a1fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:42.291128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-403ed32e-4b05-4f08-aeb5-c231bfb2a1fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:42.292351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-403ed32e-4b05-4f08-aeb5-c231bfb2a1fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:42.292795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-403ed32e-4b05-4f08-aeb5-c231bfb2a1fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:42.293209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-403ed32e-4b05-4f08-aeb5-c231bfb2a1fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:42.307838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:17:42.432933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-403ed32e-4b05-4f08-aeb5-c231bfb2a1fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:42.442229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-403ed32e-4b05-4f08-aeb5-c231bfb2a1fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:42.443709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-403ed32e-4b05-4f08-aeb5-c231bfb2a1fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:42.444877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-403ed32e-4b05-4f08-aeb5-c231bfb2a1fa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173794 Sep 13 20:17:42.445473 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 924/1931] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:42.638076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4224293a-f2e0-4fae-8410-f1929a7c089e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:42.639206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4224293a-f2e0-4fae-8410-f1929a7c089e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:42.650543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4224293a-f2e0-4fae-8410-f1929a7c089e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:42.651326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4224293a-f2e0-4fae-8410-f1929a7c089e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:42.651966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4224293a-f2e0-4fae-8410-f1929a7c089e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:42.652652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4224293a-f2e0-4fae-8410-f1929a7c089e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:42.653101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4224293a-f2e0-4fae-8410-f1929a7c089e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:42.653517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4224293a-f2e0-4fae-8410-f1929a7c089e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:42.803173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4224293a-f2e0-4fae-8410-f1929a7c089e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:42.814561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4224293a-f2e0-4fae-8410-f1929a7c089e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.182969 Sep 13 20:17:42.815172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1008/1932] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:42 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:43.471236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-31e13756-edd9-45f0-8c97-db1221cd4b65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:43.471872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-31e13756-edd9-45f0-8c97-db1221cd4b65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:43.478771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31e13756-edd9-45f0-8c97-db1221cd4b65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:43.479258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31e13756-edd9-45f0-8c97-db1221cd4b65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:43.479689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31e13756-edd9-45f0-8c97-db1221cd4b65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:43.480379 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31e13756-edd9-45f0-8c97-db1221cd4b65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:43.480827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31e13756-edd9-45f0-8c97-db1221cd4b65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:43.481247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-31e13756-edd9-45f0-8c97-db1221cd4b65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:43.620000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-31e13756-edd9-45f0-8c97-db1221cd4b65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:43.629136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-31e13756-edd9-45f0-8c97-db1221cd4b65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:43.630599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-31e13756-edd9-45f0-8c97-db1221cd4b65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:43.631762 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-31e13756-edd9-45f0-8c97-db1221cd4b65 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.164694 Sep 13 20:17:43.632326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 925/1933] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:43.843376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4e7cca07-4a27-46a9-8a13-bdc25022f98c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:43.844274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4e7cca07-4a27-46a9-8a13-bdc25022f98c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:43.854188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4e7cca07-4a27-46a9-8a13-bdc25022f98c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:43.854963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4e7cca07-4a27-46a9-8a13-bdc25022f98c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:43.855388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4e7cca07-4a27-46a9-8a13-bdc25022f98c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:43.856062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4e7cca07-4a27-46a9-8a13-bdc25022f98c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:43.856502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4e7cca07-4a27-46a9-8a13-bdc25022f98c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:43.856912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4e7cca07-4a27-46a9-8a13-bdc25022f98c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:43.995837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4e7cca07-4a27-46a9-8a13-bdc25022f98c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:44.004429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4e7cca07-4a27-46a9-8a13-bdc25022f98c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168014 Sep 13 20:17:44.005167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1009/1934] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:43 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:44.661218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c07a3461-97dc-4433-9501-91e620966314 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:44.662198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c07a3461-97dc-4433-9501-91e620966314 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:44.671199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c07a3461-97dc-4433-9501-91e620966314 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:44.671675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c07a3461-97dc-4433-9501-91e620966314 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:44.672100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c07a3461-97dc-4433-9501-91e620966314 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:44.672782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c07a3461-97dc-4433-9501-91e620966314 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:44.673225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c07a3461-97dc-4433-9501-91e620966314 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:44.673642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c07a3461-97dc-4433-9501-91e620966314 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:44.816376 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c07a3461-97dc-4433-9501-91e620966314 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:44.825485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c07a3461-97dc-4433-9501-91e620966314 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:44.826894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c07a3461-97dc-4433-9501-91e620966314 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:44.828037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c07a3461-97dc-4433-9501-91e620966314 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173342 Sep 13 20:17:44.828625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 926/1935] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:45.027776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ca80a625-0086-4fef-b171-454ea0ea118e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:45.028466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ca80a625-0086-4fef-b171-454ea0ea118e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:45.034618 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ca80a625-0086-4fef-b171-454ea0ea118e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:45.035096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ca80a625-0086-4fef-b171-454ea0ea118e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:45.035518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ca80a625-0086-4fef-b171-454ea0ea118e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:45.036191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ca80a625-0086-4fef-b171-454ea0ea118e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:45.036635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ca80a625-0086-4fef-b171-454ea0ea118e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:45.037041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ca80a625-0086-4fef-b171-454ea0ea118e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:45.165725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ca80a625-0086-4fef-b171-454ea0ea118e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:45.174485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ca80a625-0086-4fef-b171-454ea0ea118e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.150630 Sep 13 20:17:45.175057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1010/1936] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:45 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:45.857485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6b722975-026a-475b-b2f9-c291133f03c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:45.858085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6b722975-026a-475b-b2f9-c291133f03c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:45.866167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6b722975-026a-475b-b2f9-c291133f03c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:45.866775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6b722975-026a-475b-b2f9-c291133f03c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:45.867290 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6b722975-026a-475b-b2f9-c291133f03c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:45.868106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6b722975-026a-475b-b2f9-c291133f03c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:45.868635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6b722975-026a-475b-b2f9-c291133f03c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:45.869131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6b722975-026a-475b-b2f9-c291133f03c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:46.009212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6b722975-026a-475b-b2f9-c291133f03c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:46.018705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6b722975-026a-475b-b2f9-c291133f03c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:46.020149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6b722975-026a-475b-b2f9-c291133f03c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:46.021284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6b722975-026a-475b-b2f9-c291133f03c6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169900 Sep 13 20:17:46.021857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 927/1937] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:46.202820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-35b5e146-9ab2-4cbc-ba8b-89373a625cca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:46.203826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-35b5e146-9ab2-4cbc-ba8b-89373a625cca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:46.214991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35b5e146-9ab2-4cbc-ba8b-89373a625cca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:46.215473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35b5e146-9ab2-4cbc-ba8b-89373a625cca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:46.215901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35b5e146-9ab2-4cbc-ba8b-89373a625cca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:46.216592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35b5e146-9ab2-4cbc-ba8b-89373a625cca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:46.217041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35b5e146-9ab2-4cbc-ba8b-89373a625cca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:46.217457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35b5e146-9ab2-4cbc-ba8b-89373a625cca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:46.345876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-35b5e146-9ab2-4cbc-ba8b-89373a625cca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:46.354391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-35b5e146-9ab2-4cbc-ba8b-89373a625cca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.159024 Sep 13 20:17:46.354984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1011/1938] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:46 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:47.058142 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8bf6265b-a1a2-41bb-8cf0-9991f7134eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:47.059103 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8bf6265b-a1a2-41bb-8cf0-9991f7134eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:47.066584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8bf6265b-a1a2-41bb-8cf0-9991f7134eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:47.067087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8bf6265b-a1a2-41bb-8cf0-9991f7134eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:47.067547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8bf6265b-a1a2-41bb-8cf0-9991f7134eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:47.068267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8bf6265b-a1a2-41bb-8cf0-9991f7134eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:47.068739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8bf6265b-a1a2-41bb-8cf0-9991f7134eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:47.069174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8bf6265b-a1a2-41bb-8cf0-9991f7134eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:47.207075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8bf6265b-a1a2-41bb-8cf0-9991f7134eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:47.216419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8bf6265b-a1a2-41bb-8cf0-9991f7134eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:47.217837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8bf6265b-a1a2-41bb-8cf0-9991f7134eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:47.219017 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8bf6265b-a1a2-41bb-8cf0-9991f7134eb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167430 Sep 13 20:17:47.219572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 928/1939] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:47 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:47.381320 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e6072228-c671-4968-a3ab-2b1c9d6c3d79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:47.382204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e6072228-c671-4968-a3ab-2b1c9d6c3d79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:47.391056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6072228-c671-4968-a3ab-2b1c9d6c3d79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:47.391533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6072228-c671-4968-a3ab-2b1c9d6c3d79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:47.391965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6072228-c671-4968-a3ab-2b1c9d6c3d79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:47.392650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6072228-c671-4968-a3ab-2b1c9d6c3d79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:47.393103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6072228-c671-4968-a3ab-2b1c9d6c3d79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:47.393525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6072228-c671-4968-a3ab-2b1c9d6c3d79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:47.524374 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e6072228-c671-4968-a3ab-2b1c9d6c3d79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:47.536599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e6072228-c671-4968-a3ab-2b1c9d6c3d79 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161679 Sep 13 20:17:47.537364 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1012/1940] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:47 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:48.245498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4fbbe47d-ca6b-4e6a-a19d-4279fee2d985 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:48.246681 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4fbbe47d-ca6b-4e6a-a19d-4279fee2d985 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:48.253676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4fbbe47d-ca6b-4e6a-a19d-4279fee2d985 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:48.254150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4fbbe47d-ca6b-4e6a-a19d-4279fee2d985 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:48.254619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4fbbe47d-ca6b-4e6a-a19d-4279fee2d985 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:48.255305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4fbbe47d-ca6b-4e6a-a19d-4279fee2d985 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:48.255751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4fbbe47d-ca6b-4e6a-a19d-4279fee2d985 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:48.256144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4fbbe47d-ca6b-4e6a-a19d-4279fee2d985 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:48.386219 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4fbbe47d-ca6b-4e6a-a19d-4279fee2d985 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:48.397204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4fbbe47d-ca6b-4e6a-a19d-4279fee2d985 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:48.399700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4fbbe47d-ca6b-4e6a-a19d-4279fee2d985 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:48.401649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4fbbe47d-ca6b-4e6a-a19d-4279fee2d985 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159812 Sep 13 20:17:48.402568 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 929/1941] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:48 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:48.562401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d1e75e03-5239-436f-b4fd-4efbd15f1d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:48.563004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d1e75e03-5239-436f-b4fd-4efbd15f1d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:48.570114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1e75e03-5239-436f-b4fd-4efbd15f1d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:48.570640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1e75e03-5239-436f-b4fd-4efbd15f1d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:48.571073 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1e75e03-5239-436f-b4fd-4efbd15f1d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:48.571749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1e75e03-5239-436f-b4fd-4efbd15f1d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:48.572199 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1e75e03-5239-436f-b4fd-4efbd15f1d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:48.572619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1e75e03-5239-436f-b4fd-4efbd15f1d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:48.707213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d1e75e03-5239-436f-b4fd-4efbd15f1d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:48.715915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d1e75e03-5239-436f-b4fd-4efbd15f1d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158324 Sep 13 20:17:48.716586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1013/1942] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:48 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:49.427805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-392c3e89-9e58-47ec-b46f-8aa9c3483818 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:49.428384 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-392c3e89-9e58-47ec-b46f-8aa9c3483818 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:49.435466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-392c3e89-9e58-47ec-b46f-8aa9c3483818 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:49.435943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-392c3e89-9e58-47ec-b46f-8aa9c3483818 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:49.436356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-392c3e89-9e58-47ec-b46f-8aa9c3483818 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:49.437022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-392c3e89-9e58-47ec-b46f-8aa9c3483818 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:49.437459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-392c3e89-9e58-47ec-b46f-8aa9c3483818 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:49.437870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-392c3e89-9e58-47ec-b46f-8aa9c3483818 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:49.573961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-392c3e89-9e58-47ec-b46f-8aa9c3483818 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:49.583111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-392c3e89-9e58-47ec-b46f-8aa9c3483818 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:49.584926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-392c3e89-9e58-47ec-b46f-8aa9c3483818 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:49.586077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-392c3e89-9e58-47ec-b46f-8aa9c3483818 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162319 Sep 13 20:17:49.586649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 930/1943] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:49.740293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-292f85db-2c1c-4b38-ae44-185f6c4b8a10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:49.741107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-292f85db-2c1c-4b38-ae44-185f6c4b8a10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:49.752099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-292f85db-2c1c-4b38-ae44-185f6c4b8a10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:49.752870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-292f85db-2c1c-4b38-ae44-185f6c4b8a10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:49.753514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-292f85db-2c1c-4b38-ae44-185f6c4b8a10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:49.754586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-292f85db-2c1c-4b38-ae44-185f6c4b8a10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:49.755403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-292f85db-2c1c-4b38-ae44-185f6c4b8a10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:49.756144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-292f85db-2c1c-4b38-ae44-185f6c4b8a10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:49.897723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-292f85db-2c1c-4b38-ae44-185f6c4b8a10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:49.909222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-292f85db-2c1c-4b38-ae44-185f6c4b8a10 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.173058 Sep 13 20:17:49.909832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1014/1944] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:49 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:50.611651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e4e291a3-00c4-4b85-b187-95624497b58c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:50.612234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e4e291a3-00c4-4b85-b187-95624497b58c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:50.619273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e4e291a3-00c4-4b85-b187-95624497b58c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:50.619751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e4e291a3-00c4-4b85-b187-95624497b58c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:50.620183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e4e291a3-00c4-4b85-b187-95624497b58c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:50.620867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e4e291a3-00c4-4b85-b187-95624497b58c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:50.621313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e4e291a3-00c4-4b85-b187-95624497b58c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:50.621727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e4e291a3-00c4-4b85-b187-95624497b58c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:50.769804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e4e291a3-00c4-4b85-b187-95624497b58c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:50.778882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e4e291a3-00c4-4b85-b187-95624497b58c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:50.780324 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e4e291a3-00c4-4b85-b187-95624497b58c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:50.781482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e4e291a3-00c4-4b85-b187-95624497b58c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173860 Sep 13 20:17:50.782094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 931/1945] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:50.932880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5ed47cff-d725-45d5-bd41-3d008af5f9ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:50.933583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5ed47cff-d725-45d5-bd41-3d008af5f9ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:50.940323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ed47cff-d725-45d5-bd41-3d008af5f9ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:50.940794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ed47cff-d725-45d5-bd41-3d008af5f9ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:50.941211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ed47cff-d725-45d5-bd41-3d008af5f9ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:50.941977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ed47cff-d725-45d5-bd41-3d008af5f9ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:50.942501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ed47cff-d725-45d5-bd41-3d008af5f9ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:50.942909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ed47cff-d725-45d5-bd41-3d008af5f9ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:51.079326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5ed47cff-d725-45d5-bd41-3d008af5f9ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:51.088334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5ed47cff-d725-45d5-bd41-3d008af5f9ac tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.159424 Sep 13 20:17:51.088886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1015/1946] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:50 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:51.807638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-47490d50-7872-4221-a4e2-d6868fe35f46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:51.808193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-47490d50-7872-4221-a4e2-d6868fe35f46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:51.816689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47490d50-7872-4221-a4e2-d6868fe35f46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:51.817529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47490d50-7872-4221-a4e2-d6868fe35f46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:51.818203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47490d50-7872-4221-a4e2-d6868fe35f46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:51.819340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47490d50-7872-4221-a4e2-d6868fe35f46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:51.819911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47490d50-7872-4221-a4e2-d6868fe35f46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:51.820387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47490d50-7872-4221-a4e2-d6868fe35f46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:51.957045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-47490d50-7872-4221-a4e2-d6868fe35f46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:51.966514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-47490d50-7872-4221-a4e2-d6868fe35f46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:51.967985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-47490d50-7872-4221-a4e2-d6868fe35f46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:51.969115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-47490d50-7872-4221-a4e2-d6868fe35f46 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165584 Sep 13 20:17:51.969706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 932/1947] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:52.114726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-95186823-47f8-4914-8b9b-44a90b1ac0fd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:52.115570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-95186823-47f8-4914-8b9b-44a90b1ac0fd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:52.125136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95186823-47f8-4914-8b9b-44a90b1ac0fd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:52.125605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95186823-47f8-4914-8b9b-44a90b1ac0fd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:52.126027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95186823-47f8-4914-8b9b-44a90b1ac0fd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:52.126759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95186823-47f8-4914-8b9b-44a90b1ac0fd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:52.127200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95186823-47f8-4914-8b9b-44a90b1ac0fd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:52.127613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95186823-47f8-4914-8b9b-44a90b1ac0fd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:52.269831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-95186823-47f8-4914-8b9b-44a90b1ac0fd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:52.278537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-95186823-47f8-4914-8b9b-44a90b1ac0fd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.170330 Sep 13 20:17:52.279272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1016/1948] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:52 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:52.995251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-49c270c0-d62d-4e2e-96ee-0bbfd651db99 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:52.995887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-49c270c0-d62d-4e2e-96ee-0bbfd651db99 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:53.002968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49c270c0-d62d-4e2e-96ee-0bbfd651db99 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:53.003597 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49c270c0-d62d-4e2e-96ee-0bbfd651db99 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:53.005880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49c270c0-d62d-4e2e-96ee-0bbfd651db99 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:53.006660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49c270c0-d62d-4e2e-96ee-0bbfd651db99 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:53.007124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49c270c0-d62d-4e2e-96ee-0bbfd651db99 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:53.007558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49c270c0-d62d-4e2e-96ee-0bbfd651db99 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:53.140459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-49c270c0-d62d-4e2e-96ee-0bbfd651db99 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:53.149364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-49c270c0-d62d-4e2e-96ee-0bbfd651db99 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:53.150858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-49c270c0-d62d-4e2e-96ee-0bbfd651db99 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:53.152036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-49c270c0-d62d-4e2e-96ee-0bbfd651db99 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.160827 Sep 13 20:17:53.152598 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 933/1949] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:53.302394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-129215f9-f6aa-4611-97be-6c1af8f75f2d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:53.303014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-129215f9-f6aa-4611-97be-6c1af8f75f2d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:53.309791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-129215f9-f6aa-4611-97be-6c1af8f75f2d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:53.310274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-129215f9-f6aa-4611-97be-6c1af8f75f2d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:53.310725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-129215f9-f6aa-4611-97be-6c1af8f75f2d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:53.311445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-129215f9-f6aa-4611-97be-6c1af8f75f2d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:53.311893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-129215f9-f6aa-4611-97be-6c1af8f75f2d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:53.312634 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-129215f9-f6aa-4611-97be-6c1af8f75f2d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:53.457451 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-129215f9-f6aa-4611-97be-6c1af8f75f2d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:53.466532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-129215f9-f6aa-4611-97be-6c1af8f75f2d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168168 Sep 13 20:17:53.467114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1017/1950] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:53 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:54.177645 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b90027e8-f75f-42cc-a7b0-3825425c9012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:54.178282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b90027e8-f75f-42cc-a7b0-3825425c9012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:54.185129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b90027e8-f75f-42cc-a7b0-3825425c9012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:54.185619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b90027e8-f75f-42cc-a7b0-3825425c9012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:54.186059 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b90027e8-f75f-42cc-a7b0-3825425c9012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:54.186814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b90027e8-f75f-42cc-a7b0-3825425c9012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:54.187256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b90027e8-f75f-42cc-a7b0-3825425c9012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:54.187727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b90027e8-f75f-42cc-a7b0-3825425c9012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:54.327430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b90027e8-f75f-42cc-a7b0-3825425c9012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:54.336636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b90027e8-f75f-42cc-a7b0-3825425c9012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:54.338053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b90027e8-f75f-42cc-a7b0-3825425c9012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:54.339232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b90027e8-f75f-42cc-a7b0-3825425c9012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165612 Sep 13 20:17:54.339786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 934/1951] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:54 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:54.490145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-48a7b998-ff28-4a5d-b043-d9cbd552e71b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:54.490791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-48a7b998-ff28-4a5d-b043-d9cbd552e71b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:54.497812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48a7b998-ff28-4a5d-b043-d9cbd552e71b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:54.498293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48a7b998-ff28-4a5d-b043-d9cbd552e71b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:54.498761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48a7b998-ff28-4a5d-b043-d9cbd552e71b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:54.499452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48a7b998-ff28-4a5d-b043-d9cbd552e71b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:54.499895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48a7b998-ff28-4a5d-b043-d9cbd552e71b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:54.500304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48a7b998-ff28-4a5d-b043-d9cbd552e71b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:54.639561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-48a7b998-ff28-4a5d-b043-d9cbd552e71b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:54.648059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-48a7b998-ff28-4a5d-b043-d9cbd552e71b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161880 Sep 13 20:17:54.648703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1018/1952] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:54 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:55.368999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f4faa600-903a-4944-b033-cbc702765cbb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:55.369927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f4faa600-903a-4944-b033-cbc702765cbb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:55.378269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4faa600-903a-4944-b033-cbc702765cbb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:55.378801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4faa600-903a-4944-b033-cbc702765cbb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:55.379210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4faa600-903a-4944-b033-cbc702765cbb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:55.379902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4faa600-903a-4944-b033-cbc702765cbb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:55.380337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4faa600-903a-4944-b033-cbc702765cbb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:55.380758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f4faa600-903a-4944-b033-cbc702765cbb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:55.512415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f4faa600-903a-4944-b033-cbc702765cbb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:55.521690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f4faa600-903a-4944-b033-cbc702765cbb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:55.523203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f4faa600-903a-4944-b033-cbc702765cbb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:55.524362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f4faa600-903a-4944-b033-cbc702765cbb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162015 Sep 13 20:17:55.524915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 935/1953] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:55.672164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e6547949-f682-4a26-a3bc-1c0db8758c0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:55.672792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e6547949-f682-4a26-a3bc-1c0db8758c0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:55.679560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6547949-f682-4a26-a3bc-1c0db8758c0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:55.680057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6547949-f682-4a26-a3bc-1c0db8758c0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:55.680477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6547949-f682-4a26-a3bc-1c0db8758c0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:55.681162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6547949-f682-4a26-a3bc-1c0db8758c0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:55.681608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6547949-f682-4a26-a3bc-1c0db8758c0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:55.682009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e6547949-f682-4a26-a3bc-1c0db8758c0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:55.697416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:17:55.814608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e6547949-f682-4a26-a3bc-1c0db8758c0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:55.823131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e6547949-f682-4a26-a3bc-1c0db8758c0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.155599 Sep 13 20:17:55.823723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1019/1954] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:55 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:56.550400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-22777c70-02dd-4f9c-90f5-7dd3d5b9bf12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:56.550985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-22777c70-02dd-4f9c-90f5-7dd3d5b9bf12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:56.557408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22777c70-02dd-4f9c-90f5-7dd3d5b9bf12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:56.557890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22777c70-02dd-4f9c-90f5-7dd3d5b9bf12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:56.558308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22777c70-02dd-4f9c-90f5-7dd3d5b9bf12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:56.559014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22777c70-02dd-4f9c-90f5-7dd3d5b9bf12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:56.559459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22777c70-02dd-4f9c-90f5-7dd3d5b9bf12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:56.559873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22777c70-02dd-4f9c-90f5-7dd3d5b9bf12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:56.707845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-22777c70-02dd-4f9c-90f5-7dd3d5b9bf12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:56.719506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-22777c70-02dd-4f9c-90f5-7dd3d5b9bf12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:56.720911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-22777c70-02dd-4f9c-90f5-7dd3d5b9bf12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:56.722082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-22777c70-02dd-4f9c-90f5-7dd3d5b9bf12 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.175846 Sep 13 20:17:56.722661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 936/1955] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:56.850404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c77c73ee-7450-4b16-8cf8-82f238d1eab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:56.851242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c77c73ee-7450-4b16-8cf8-82f238d1eab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:56.861885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c77c73ee-7450-4b16-8cf8-82f238d1eab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:56.862737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c77c73ee-7450-4b16-8cf8-82f238d1eab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:56.863451 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c77c73ee-7450-4b16-8cf8-82f238d1eab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:56.864579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c77c73ee-7450-4b16-8cf8-82f238d1eab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:56.865334 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c77c73ee-7450-4b16-8cf8-82f238d1eab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:56.866084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c77c73ee-7450-4b16-8cf8-82f238d1eab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:57.003595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c77c73ee-7450-4b16-8cf8-82f238d1eab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:57.012550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c77c73ee-7450-4b16-8cf8-82f238d1eab2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168789 Sep 13 20:17:57.013219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1020/1956] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:56 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:57.751888 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9e26a2ad-6986-46e5-bc31-5d44509c27e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:57.752897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9e26a2ad-6986-46e5-bc31-5d44509c27e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:57.763679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e26a2ad-6986-46e5-bc31-5d44509c27e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:57.764214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e26a2ad-6986-46e5-bc31-5d44509c27e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:57.764676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e26a2ad-6986-46e5-bc31-5d44509c27e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:57.765374 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e26a2ad-6986-46e5-bc31-5d44509c27e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:57.765825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e26a2ad-6986-46e5-bc31-5d44509c27e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:57.766523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e26a2ad-6986-46e5-bc31-5d44509c27e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:57.902712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9e26a2ad-6986-46e5-bc31-5d44509c27e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:57.915958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9e26a2ad-6986-46e5-bc31-5d44509c27e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:57.918106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9e26a2ad-6986-46e5-bc31-5d44509c27e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:57.919712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9e26a2ad-6986-46e5-bc31-5d44509c27e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.174564 Sep 13 20:17:57.920278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 937/1957] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:58.037399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5d9e172c-08e2-4383-8a1a-7bf4a3218577 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:58.038015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5d9e172c-08e2-4383-8a1a-7bf4a3218577 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:58.045358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d9e172c-08e2-4383-8a1a-7bf4a3218577 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:58.045747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d9e172c-08e2-4383-8a1a-7bf4a3218577 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:58.046165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d9e172c-08e2-4383-8a1a-7bf4a3218577 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:58.046877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d9e172c-08e2-4383-8a1a-7bf4a3218577 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:58.047316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d9e172c-08e2-4383-8a1a-7bf4a3218577 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:58.047725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5d9e172c-08e2-4383-8a1a-7bf4a3218577 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:58.186263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5d9e172c-08e2-4383-8a1a-7bf4a3218577 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:58.194969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5d9e172c-08e2-4383-8a1a-7bf4a3218577 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161850 Sep 13 20:17:58.195544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1021/1958] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:58 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:17:58.945170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f75c8c5d-317b-418d-87ea-c362971d189f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:58.945823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f75c8c5d-317b-418d-87ea-c362971d189f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:58.952504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f75c8c5d-317b-418d-87ea-c362971d189f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:58.952992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f75c8c5d-317b-418d-87ea-c362971d189f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:58.953428 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f75c8c5d-317b-418d-87ea-c362971d189f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:58.954118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f75c8c5d-317b-418d-87ea-c362971d189f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:58.954605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f75c8c5d-317b-418d-87ea-c362971d189f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:58.955029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f75c8c5d-317b-418d-87ea-c362971d189f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:59.091313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f75c8c5d-317b-418d-87ea-c362971d189f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:59.102151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f75c8c5d-317b-418d-87ea-c362971d189f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:59.103866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f75c8c5d-317b-418d-87ea-c362971d189f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:59.105573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f75c8c5d-317b-418d-87ea-c362971d189f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.164186 Sep 13 20:17:59.106101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 938/1959] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:17:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:17:59.221255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8a8f0942-63e7-4cb6-9507-c21e7fb98f2e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:17:59.221928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8a8f0942-63e7-4cb6-9507-c21e7fb98f2e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:17:59.230180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a8f0942-63e7-4cb6-9507-c21e7fb98f2e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:59.230772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a8f0942-63e7-4cb6-9507-c21e7fb98f2e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:59.231267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a8f0942-63e7-4cb6-9507-c21e7fb98f2e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:59.232068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a8f0942-63e7-4cb6-9507-c21e7fb98f2e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:17:59.232585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a8f0942-63e7-4cb6-9507-c21e7fb98f2e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:17:59.233095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a8f0942-63e7-4cb6-9507-c21e7fb98f2e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:17:59.380019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8a8f0942-63e7-4cb6-9507-c21e7fb98f2e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:17:59.389069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8a8f0942-63e7-4cb6-9507-c21e7fb98f2e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.172719 Sep 13 20:17:59.389671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1022/1960] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:17:59 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:00.139910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ddf27fd1-b63f-47af-a458-14837b8f9405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:00.140941 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ddf27fd1-b63f-47af-a458-14837b8f9405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:00.151519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ddf27fd1-b63f-47af-a458-14837b8f9405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:00.152227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ddf27fd1-b63f-47af-a458-14837b8f9405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:00.152947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ddf27fd1-b63f-47af-a458-14837b8f9405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:00.154087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ddf27fd1-b63f-47af-a458-14837b8f9405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:00.154896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ddf27fd1-b63f-47af-a458-14837b8f9405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:00.155601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ddf27fd1-b63f-47af-a458-14837b8f9405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:00.306189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ddf27fd1-b63f-47af-a458-14837b8f9405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:00.319803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ddf27fd1-b63f-47af-a458-14837b8f9405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:00.321970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ddf27fd1-b63f-47af-a458-14837b8f9405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:00.323650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ddf27fd1-b63f-47af-a458-14837b8f9405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.190117 Sep 13 20:18:00.324410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 939/1961] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:00 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:00.418082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d1584c27-af4c-4022-a6ba-73c0633388fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:00.418999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d1584c27-af4c-4022-a6ba-73c0633388fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:00.429833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1584c27-af4c-4022-a6ba-73c0633388fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:00.430686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1584c27-af4c-4022-a6ba-73c0633388fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:00.431395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1584c27-af4c-4022-a6ba-73c0633388fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:00.432518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1584c27-af4c-4022-a6ba-73c0633388fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:00.433258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1584c27-af4c-4022-a6ba-73c0633388fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:00.433950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1584c27-af4c-4022-a6ba-73c0633388fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:00.570930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d1584c27-af4c-4022-a6ba-73c0633388fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:00.579486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d1584c27-af4c-4022-a6ba-73c0633388fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167992 Sep 13 20:18:00.580050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1023/1962] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:00 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:01.354711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d3e029be-072b-4763-8032-48ecd0835040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:01.355599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d3e029be-072b-4763-8032-48ecd0835040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:01.366652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3e029be-072b-4763-8032-48ecd0835040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:01.367455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3e029be-072b-4763-8032-48ecd0835040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:01.368182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3e029be-072b-4763-8032-48ecd0835040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:01.369323 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3e029be-072b-4763-8032-48ecd0835040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:01.370074 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3e029be-072b-4763-8032-48ecd0835040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:01.370987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3e029be-072b-4763-8032-48ecd0835040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:01.502348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d3e029be-072b-4763-8032-48ecd0835040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:01.514738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d3e029be-072b-4763-8032-48ecd0835040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:01.516151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d3e029be-072b-4763-8032-48ecd0835040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:01.517298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d3e029be-072b-4763-8032-48ecd0835040 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169300 Sep 13 20:18:01.517852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 940/1963] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:01.603653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1fab95fe-2a14-4b83-8f36-a90bda716f16 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:01.604270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1fab95fe-2a14-4b83-8f36-a90bda716f16 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:01.611322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fab95fe-2a14-4b83-8f36-a90bda716f16 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:01.611738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fab95fe-2a14-4b83-8f36-a90bda716f16 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:01.612168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fab95fe-2a14-4b83-8f36-a90bda716f16 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:01.612863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fab95fe-2a14-4b83-8f36-a90bda716f16 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:01.613309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fab95fe-2a14-4b83-8f36-a90bda716f16 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:01.613727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fab95fe-2a14-4b83-8f36-a90bda716f16 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:01.744546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1fab95fe-2a14-4b83-8f36-a90bda716f16 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:01.758194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1fab95fe-2a14-4b83-8f36-a90bda716f16 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158249 Sep 13 20:18:01.759093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1024/1964] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:01 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:02.545810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8fe4fbe1-016f-47c2-96a3-401bbb18ce2e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:02.546434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8fe4fbe1-016f-47c2-96a3-401bbb18ce2e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:02.548776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=50 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:18:02.554611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8fe4fbe1-016f-47c2-96a3-401bbb18ce2e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:02.555092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8fe4fbe1-016f-47c2-96a3-401bbb18ce2e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:02.555527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8fe4fbe1-016f-47c2-96a3-401bbb18ce2e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:02.556223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8fe4fbe1-016f-47c2-96a3-401bbb18ce2e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:02.556673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8fe4fbe1-016f-47c2-96a3-401bbb18ce2e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:02.557099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8fe4fbe1-016f-47c2-96a3-401bbb18ce2e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:02.559923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:18:02.687705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8fe4fbe1-016f-47c2-96a3-401bbb18ce2e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:02.696835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8fe4fbe1-016f-47c2-96a3-401bbb18ce2e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:02.698244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8fe4fbe1-016f-47c2-96a3-401bbb18ce2e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:02.699422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8fe4fbe1-016f-47c2-96a3-401bbb18ce2e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159439 Sep 13 20:18:02.699976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 941/1965] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:02.786982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a4477ec9-73b8-4f1a-a153-9c30b25bede8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:02.787977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a4477ec9-73b8-4f1a-a153-9c30b25bede8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:02.791619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:18:02.800356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a4477ec9-73b8-4f1a-a153-9c30b25bede8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:02.801030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a4477ec9-73b8-4f1a-a153-9c30b25bede8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:02.801737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a4477ec9-73b8-4f1a-a153-9c30b25bede8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:02.802919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a4477ec9-73b8-4f1a-a153-9c30b25bede8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:02.803655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a4477ec9-73b8-4f1a-a153-9c30b25bede8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:02.804344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a4477ec9-73b8-4f1a-a153-9c30b25bede8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:02.942621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a4477ec9-73b8-4f1a-a153-9c30b25bede8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:02.955759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a4477ec9-73b8-4f1a-a153-9c30b25bede8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.175128 Sep 13 20:18:02.956607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1025/1966] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:02 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:03.729347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-148bab09-eefa-4275-a6a8-7215a6be52ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:03.730335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-148bab09-eefa-4275-a6a8-7215a6be52ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:03.741137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-148bab09-eefa-4275-a6a8-7215a6be52ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:03.741921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-148bab09-eefa-4275-a6a8-7215a6be52ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:03.742695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-148bab09-eefa-4275-a6a8-7215a6be52ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:03.743816 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-148bab09-eefa-4275-a6a8-7215a6be52ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:03.744559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-148bab09-eefa-4275-a6a8-7215a6be52ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:03.745287 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-148bab09-eefa-4275-a6a8-7215a6be52ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:03.894565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-148bab09-eefa-4275-a6a8-7215a6be52ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:03.908173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-148bab09-eefa-4275-a6a8-7215a6be52ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:03.910438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-148bab09-eefa-4275-a6a8-7215a6be52ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:03.912225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-148bab09-eefa-4275-a6a8-7215a6be52ef tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.189178 Sep 13 20:18:03.912985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 942/1967] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:03.981762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c45a59fc-db99-4a6d-ae9f-567a4deca3f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:03.982352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c45a59fc-db99-4a6d-ae9f-567a4deca3f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:03.989134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c45a59fc-db99-4a6d-ae9f-567a4deca3f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:03.989608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c45a59fc-db99-4a6d-ae9f-567a4deca3f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:03.990035 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c45a59fc-db99-4a6d-ae9f-567a4deca3f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:03.990751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c45a59fc-db99-4a6d-ae9f-567a4deca3f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:03.991198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c45a59fc-db99-4a6d-ae9f-567a4deca3f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:03.991615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c45a59fc-db99-4a6d-ae9f-567a4deca3f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:04.122867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c45a59fc-db99-4a6d-ae9f-567a4deca3f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:04.131149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c45a59fc-db99-4a6d-ae9f-567a4deca3f5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.154615 Sep 13 20:18:04.131711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1026/1968] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:03 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:04.944893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-18131a6a-ae7c-4fc8-be2a-4d85e25edf93 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:04.945759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-18131a6a-ae7c-4fc8-be2a-4d85e25edf93 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:04.956635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-18131a6a-ae7c-4fc8-be2a-4d85e25edf93 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:04.957432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-18131a6a-ae7c-4fc8-be2a-4d85e25edf93 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:04.958155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-18131a6a-ae7c-4fc8-be2a-4d85e25edf93 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:04.959741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-18131a6a-ae7c-4fc8-be2a-4d85e25edf93 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:04.960489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-18131a6a-ae7c-4fc8-be2a-4d85e25edf93 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:04.961203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-18131a6a-ae7c-4fc8-be2a-4d85e25edf93 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:05.097838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-18131a6a-ae7c-4fc8-be2a-4d85e25edf93 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:05.107205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-18131a6a-ae7c-4fc8-be2a-4d85e25edf93 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:05.108629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-18131a6a-ae7c-4fc8-be2a-4d85e25edf93 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:05.109777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-18131a6a-ae7c-4fc8-be2a-4d85e25edf93 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172167 Sep 13 20:18:05.110392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 943/1969] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:05.155618 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-027ea66e-43e9-4c6f-bcaa-45b96d7b7e09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:05.156230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-027ea66e-43e9-4c6f-bcaa-45b96d7b7e09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:05.163163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-027ea66e-43e9-4c6f-bcaa-45b96d7b7e09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:05.163649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-027ea66e-43e9-4c6f-bcaa-45b96d7b7e09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:05.164080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-027ea66e-43e9-4c6f-bcaa-45b96d7b7e09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:05.164769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-027ea66e-43e9-4c6f-bcaa-45b96d7b7e09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:05.165243 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-027ea66e-43e9-4c6f-bcaa-45b96d7b7e09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:05.165637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-027ea66e-43e9-4c6f-bcaa-45b96d7b7e09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:05.306295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-027ea66e-43e9-4c6f-bcaa-45b96d7b7e09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:05.314694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-027ea66e-43e9-4c6f-bcaa-45b96d7b7e09 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.163036 Sep 13 20:18:05.315269 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1027/1970] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:05 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:06.143632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fb954057-4e4c-43ef-a083-a99b2ee86992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:06.144608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fb954057-4e4c-43ef-a083-a99b2ee86992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:06.155682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb954057-4e4c-43ef-a083-a99b2ee86992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:06.156449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb954057-4e4c-43ef-a083-a99b2ee86992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:06.157162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb954057-4e4c-43ef-a083-a99b2ee86992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:06.158281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb954057-4e4c-43ef-a083-a99b2ee86992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:06.159064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb954057-4e4c-43ef-a083-a99b2ee86992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:06.159773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb954057-4e4c-43ef-a083-a99b2ee86992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:06.299696 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fb954057-4e4c-43ef-a083-a99b2ee86992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:06.308493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fb954057-4e4c-43ef-a083-a99b2ee86992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:06.309914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fb954057-4e4c-43ef-a083-a99b2ee86992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:06.311088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fb954057-4e4c-43ef-a083-a99b2ee86992 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.174268 Sep 13 20:18:06.311620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 944/1971] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:06 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:06.338881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-73f4b7f9-69fb-44ac-90ba-9a9f5b18556d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:06.339498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-73f4b7f9-69fb-44ac-90ba-9a9f5b18556d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:06.346257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73f4b7f9-69fb-44ac-90ba-9a9f5b18556d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:06.346992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73f4b7f9-69fb-44ac-90ba-9a9f5b18556d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:06.347454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73f4b7f9-69fb-44ac-90ba-9a9f5b18556d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:06.348116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73f4b7f9-69fb-44ac-90ba-9a9f5b18556d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:06.348563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73f4b7f9-69fb-44ac-90ba-9a9f5b18556d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:06.348974 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73f4b7f9-69fb-44ac-90ba-9a9f5b18556d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:06.483073 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-73f4b7f9-69fb-44ac-90ba-9a9f5b18556d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:06.495732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-73f4b7f9-69fb-44ac-90ba-9a9f5b18556d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.160487 Sep 13 20:18:06.496505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1028/1972] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:06 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:07.341428 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a81954fc-3e04-4fa2-b7e2-965e60db4579 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:07.342208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a81954fc-3e04-4fa2-b7e2-965e60db4579 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:07.351216 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a81954fc-3e04-4fa2-b7e2-965e60db4579 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:07.353678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a81954fc-3e04-4fa2-b7e2-965e60db4579 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:07.353678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a81954fc-3e04-4fa2-b7e2-965e60db4579 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:07.353678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a81954fc-3e04-4fa2-b7e2-965e60db4579 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:07.354095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a81954fc-3e04-4fa2-b7e2-965e60db4579 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:07.354458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a81954fc-3e04-4fa2-b7e2-965e60db4579 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:07.488423 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a81954fc-3e04-4fa2-b7e2-965e60db4579 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:07.497176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a81954fc-3e04-4fa2-b7e2-965e60db4579 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:07.498634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a81954fc-3e04-4fa2-b7e2-965e60db4579 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:07.499797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a81954fc-3e04-4fa2-b7e2-965e60db4579 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165612 Sep 13 20:18:07.500358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 945/1973] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:07.519497 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-380a1c0d-da0a-4356-8736-a118bee9a5e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:07.520110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-380a1c0d-da0a-4356-8736-a118bee9a5e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:07.527650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-380a1c0d-da0a-4356-8736-a118bee9a5e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:07.528099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-380a1c0d-da0a-4356-8736-a118bee9a5e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:07.528607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-380a1c0d-da0a-4356-8736-a118bee9a5e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:07.529625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-380a1c0d-da0a-4356-8736-a118bee9a5e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:07.529735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-380a1c0d-da0a-4356-8736-a118bee9a5e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:07.530125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-380a1c0d-da0a-4356-8736-a118bee9a5e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:07.664812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-380a1c0d-da0a-4356-8736-a118bee9a5e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:07.674002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-380a1c0d-da0a-4356-8736-a118bee9a5e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158428 Sep 13 20:18:07.674615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1029/1974] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:07 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:18:08.529853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3932b24f-9f61-41b3-9a70-3a5ac673a5a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:08.530513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3932b24f-9f61-41b3-9a70-3a5ac673a5a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:08.538159 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3932b24f-9f61-41b3-9a70-3a5ac673a5a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:08.538689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3932b24f-9f61-41b3-9a70-3a5ac673a5a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:08.539131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3932b24f-9f61-41b3-9a70-3a5ac673a5a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:08.539838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3932b24f-9f61-41b3-9a70-3a5ac673a5a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:08.540289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3932b24f-9f61-41b3-9a70-3a5ac673a5a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:08.540711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3932b24f-9f61-41b3-9a70-3a5ac673a5a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:08.682716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3932b24f-9f61-41b3-9a70-3a5ac673a5a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:08.692683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3932b24f-9f61-41b3-9a70-3a5ac673a5a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:08.694124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3932b24f-9f61-41b3-9a70-3a5ac673a5a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:08.695325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3932b24f-9f61-41b3-9a70-3a5ac673a5a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169539 Sep 13 20:18:08.695907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 946/1975] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:08.697126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d2f7c2d6-eea0-4814-a3ab-40e9e63277fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:08.698351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d2f7c2d6-eea0-4814-a3ab-40e9e63277fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:08.705019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2f7c2d6-eea0-4814-a3ab-40e9e63277fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:08.705486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2f7c2d6-eea0-4814-a3ab-40e9e63277fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:08.705907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2f7c2d6-eea0-4814-a3ab-40e9e63277fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:08.706625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2f7c2d6-eea0-4814-a3ab-40e9e63277fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:08.707064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2f7c2d6-eea0-4814-a3ab-40e9e63277fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:08.707470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d2f7c2d6-eea0-4814-a3ab-40e9e63277fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:08.842663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d2f7c2d6-eea0-4814-a3ab-40e9e63277fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:08.850948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d2f7c2d6-eea0-4814-a3ab-40e9e63277fb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.157633 Sep 13 20:18:08.851509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1030/1976] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:08 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:09.725294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e2172a51-831e-447b-967b-d9d848fc9c37 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:09.726244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e2172a51-831e-447b-967b-d9d848fc9c37 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:09.737006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2172a51-831e-447b-967b-d9d848fc9c37 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:09.737846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2172a51-831e-447b-967b-d9d848fc9c37 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:09.738631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2172a51-831e-447b-967b-d9d848fc9c37 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:09.739779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2172a51-831e-447b-967b-d9d848fc9c37 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:09.740531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2172a51-831e-447b-967b-d9d848fc9c37 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:09.741249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2172a51-831e-447b-967b-d9d848fc9c37 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:09.874359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e9e9646a-fd11-4be1-b184-a578a1498602 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:09.875011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e9e9646a-fd11-4be1-b184-a578a1498602 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:09.882710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9e9646a-fd11-4be1-b184-a578a1498602 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:09.883245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9e9646a-fd11-4be1-b184-a578a1498602 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:09.883786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9e9646a-fd11-4be1-b184-a578a1498602 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:09.884351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9e9646a-fd11-4be1-b184-a578a1498602 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:09.884795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9e9646a-fd11-4be1-b184-a578a1498602 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:09.885208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9e9646a-fd11-4be1-b184-a578a1498602 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:09.886777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e2172a51-831e-447b-967b-d9d848fc9c37 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:09.895940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e2172a51-831e-447b-967b-d9d848fc9c37 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:09.897466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e2172a51-831e-447b-967b-d9d848fc9c37 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:09.898741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e2172a51-831e-447b-967b-d9d848fc9c37 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.180069 Sep 13 20:18:09.899583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 947/1977] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:10.018832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e9e9646a-fd11-4be1-b184-a578a1498602 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:10.031741 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e9e9646a-fd11-4be1-b184-a578a1498602 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161114 Sep 13 20:18:10.032410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1031/1978] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:09 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:10.928101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-88978b64-9233-425c-a981-b5ba596339e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:10.929018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-88978b64-9233-425c-a981-b5ba596339e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:10.937893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88978b64-9233-425c-a981-b5ba596339e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:10.938572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88978b64-9233-425c-a981-b5ba596339e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:10.938936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88978b64-9233-425c-a981-b5ba596339e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:10.939651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88978b64-9233-425c-a981-b5ba596339e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:10.940114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88978b64-9233-425c-a981-b5ba596339e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:10.940529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-88978b64-9233-425c-a981-b5ba596339e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:11.059697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bfd01e55-0679-4b1b-8097-3191cf4249a2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:11.061020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bfd01e55-0679-4b1b-8097-3191cf4249a2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:11.067860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfd01e55-0679-4b1b-8097-3191cf4249a2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:11.068335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfd01e55-0679-4b1b-8097-3191cf4249a2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:11.068758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfd01e55-0679-4b1b-8097-3191cf4249a2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:11.069428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfd01e55-0679-4b1b-8097-3191cf4249a2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:11.069865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfd01e55-0679-4b1b-8097-3191cf4249a2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:11.070279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfd01e55-0679-4b1b-8097-3191cf4249a2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:11.077718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-88978b64-9233-425c-a981-b5ba596339e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:11.087260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-88978b64-9233-425c-a981-b5ba596339e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:11.088663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-88978b64-9233-425c-a981-b5ba596339e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:11.089838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-88978b64-9233-425c-a981-b5ba596339e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167958 Sep 13 20:18:11.090428 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 948/1979] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:11.204847 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bfd01e55-0679-4b1b-8097-3191cf4249a2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:11.217302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bfd01e55-0679-4b1b-8097-3191cf4249a2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161546 Sep 13 20:18:11.217870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1032/1980] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:11 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:12.119909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-47baa225-a38b-4cfc-9449-1527a2783a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:12.120850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-47baa225-a38b-4cfc-9449-1527a2783a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:12.132198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47baa225-a38b-4cfc-9449-1527a2783a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:12.133053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47baa225-a38b-4cfc-9449-1527a2783a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:12.133790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47baa225-a38b-4cfc-9449-1527a2783a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:12.134966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47baa225-a38b-4cfc-9449-1527a2783a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:12.135698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47baa225-a38b-4cfc-9449-1527a2783a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:12.136381 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47baa225-a38b-4cfc-9449-1527a2783a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:12.240711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fe1339e8-4cb1-4a5d-8a7e-bbd675989216 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:12.241427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fe1339e8-4cb1-4a5d-8a7e-bbd675989216 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:12.248743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe1339e8-4cb1-4a5d-8a7e-bbd675989216 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:12.249390 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe1339e8-4cb1-4a5d-8a7e-bbd675989216 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:12.249842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe1339e8-4cb1-4a5d-8a7e-bbd675989216 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:12.250630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe1339e8-4cb1-4a5d-8a7e-bbd675989216 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:12.251249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe1339e8-4cb1-4a5d-8a7e-bbd675989216 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:12.251695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe1339e8-4cb1-4a5d-8a7e-bbd675989216 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:12.281453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-47baa225-a38b-4cfc-9449-1527a2783a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:12.290985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-47baa225-a38b-4cfc-9449-1527a2783a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:12.293171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-47baa225-a38b-4cfc-9449-1527a2783a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:12.294900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-47baa225-a38b-4cfc-9449-1527a2783a27 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.181564 Sep 13 20:18:12.295715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 949/1981] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:12.393484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fe1339e8-4cb1-4a5d-8a7e-bbd675989216 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:12.402172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fe1339e8-4cb1-4a5d-8a7e-bbd675989216 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165409 Sep 13 20:18:12.402791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1033/1982] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:12 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:13.325020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5dc30891-f8ba-45c1-83a2-938629239405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:13.325974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5dc30891-f8ba-45c1-83a2-938629239405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:13.337147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5dc30891-f8ba-45c1-83a2-938629239405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:13.337909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5dc30891-f8ba-45c1-83a2-938629239405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:13.338715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5dc30891-f8ba-45c1-83a2-938629239405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:13.339853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5dc30891-f8ba-45c1-83a2-938629239405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:13.340609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5dc30891-f8ba-45c1-83a2-938629239405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:13.341272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5dc30891-f8ba-45c1-83a2-938629239405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:13.425778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7afc1fc8-2d87-4179-bf15-5f137e91687b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:13.426401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7afc1fc8-2d87-4179-bf15-5f137e91687b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:13.432544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7afc1fc8-2d87-4179-bf15-5f137e91687b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:13.433036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7afc1fc8-2d87-4179-bf15-5f137e91687b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:13.433512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7afc1fc8-2d87-4179-bf15-5f137e91687b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:13.434291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7afc1fc8-2d87-4179-bf15-5f137e91687b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:13.434869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7afc1fc8-2d87-4179-bf15-5f137e91687b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:13.435276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7afc1fc8-2d87-4179-bf15-5f137e91687b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:13.474798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5dc30891-f8ba-45c1-83a2-938629239405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:13.483840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5dc30891-f8ba-45c1-83a2-938629239405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:13.485250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5dc30891-f8ba-45c1-83a2-938629239405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:13.486419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5dc30891-f8ba-45c1-83a2-938629239405 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168215 Sep 13 20:18:13.487008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 950/1983] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:13.566860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7afc1fc8-2d87-4179-bf15-5f137e91687b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:13.575642 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7afc1fc8-2d87-4179-bf15-5f137e91687b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.154068 Sep 13 20:18:13.576150 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1034/1984] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:13 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:14.516343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fc2d05d1-e6ff-42ba-a1b0-7e108b1608c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:14.517295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fc2d05d1-e6ff-42ba-a1b0-7e108b1608c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:14.529333 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc2d05d1-e6ff-42ba-a1b0-7e108b1608c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:14.530128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc2d05d1-e6ff-42ba-a1b0-7e108b1608c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:14.530903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc2d05d1-e6ff-42ba-a1b0-7e108b1608c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:14.532045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc2d05d1-e6ff-42ba-a1b0-7e108b1608c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:14.532798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc2d05d1-e6ff-42ba-a1b0-7e108b1608c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:14.533511 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc2d05d1-e6ff-42ba-a1b0-7e108b1608c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:14.599077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-60351194-4c35-4a11-8d7a-6f27e6489dd3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:14.599703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-60351194-4c35-4a11-8d7a-6f27e6489dd3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:14.606090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60351194-4c35-4a11-8d7a-6f27e6489dd3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:14.606654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60351194-4c35-4a11-8d7a-6f27e6489dd3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:14.607075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60351194-4c35-4a11-8d7a-6f27e6489dd3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:14.607753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60351194-4c35-4a11-8d7a-6f27e6489dd3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:14.608188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60351194-4c35-4a11-8d7a-6f27e6489dd3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:14.608566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-60351194-4c35-4a11-8d7a-6f27e6489dd3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:14.673807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fc2d05d1-e6ff-42ba-a1b0-7e108b1608c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:14.682803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fc2d05d1-e6ff-42ba-a1b0-7e108b1608c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:14.684257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fc2d05d1-e6ff-42ba-a1b0-7e108b1608c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:14.685474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fc2d05d1-e6ff-42ba-a1b0-7e108b1608c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.176049 Sep 13 20:18:14.686038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 951/1985] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:14.739321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-60351194-4c35-4a11-8d7a-6f27e6489dd3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:14.748115 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-60351194-4c35-4a11-8d7a-6f27e6489dd3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.153001 Sep 13 20:18:14.748732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1035/1986] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:14 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:15.714457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d843fcf1-5b06-423b-a81d-2163c7bcfcaa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:15.715488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d843fcf1-5b06-423b-a81d-2163c7bcfcaa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:15.723417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d843fcf1-5b06-423b-a81d-2163c7bcfcaa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:15.723970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d843fcf1-5b06-423b-a81d-2163c7bcfcaa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:15.724455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d843fcf1-5b06-423b-a81d-2163c7bcfcaa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:15.725299 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d843fcf1-5b06-423b-a81d-2163c7bcfcaa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:15.725797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d843fcf1-5b06-423b-a81d-2163c7bcfcaa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:15.726270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d843fcf1-5b06-423b-a81d-2163c7bcfcaa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:15.771217 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d0e888b9-078f-4637-9f3a-d75f3ffee570 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:15.771823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d0e888b9-078f-4637-9f3a-d75f3ffee570 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:15.778639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0e888b9-078f-4637-9f3a-d75f3ffee570 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:15.779102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0e888b9-078f-4637-9f3a-d75f3ffee570 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:15.779598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0e888b9-078f-4637-9f3a-d75f3ffee570 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:15.780296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0e888b9-078f-4637-9f3a-d75f3ffee570 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:15.780745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0e888b9-078f-4637-9f3a-d75f3ffee570 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:15.781163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d0e888b9-078f-4637-9f3a-d75f3ffee570 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:15.783841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:18:15.860754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d843fcf1-5b06-423b-a81d-2163c7bcfcaa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:15.869972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d843fcf1-5b06-423b-a81d-2163c7bcfcaa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:15.871433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d843fcf1-5b06-423b-a81d-2163c7bcfcaa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:15.872600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d843fcf1-5b06-423b-a81d-2163c7bcfcaa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165200 Sep 13 20:18:15.873218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 952/1987] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:15.913156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d0e888b9-078f-4637-9f3a-d75f3ffee570 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:15.921709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d0e888b9-078f-4637-9f3a-d75f3ffee570 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.154688 Sep 13 20:18:15.922253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1036/1988] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:15 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:16.901401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f474c641-aabe-40b7-9b6c-63fd7775bf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:16.902280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f474c641-aabe-40b7-9b6c-63fd7775bf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:16.910404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f474c641-aabe-40b7-9b6c-63fd7775bf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:16.910925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f474c641-aabe-40b7-9b6c-63fd7775bf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:16.911357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f474c641-aabe-40b7-9b6c-63fd7775bf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:16.912040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f474c641-aabe-40b7-9b6c-63fd7775bf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:16.912485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f474c641-aabe-40b7-9b6c-63fd7775bf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:16.912900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f474c641-aabe-40b7-9b6c-63fd7775bf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:16.945179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0ae9480c-b0ed-4329-a7cc-8f8c877b806e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:16.945792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0ae9480c-b0ed-4329-a7cc-8f8c877b806e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:16.952662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ae9480c-b0ed-4329-a7cc-8f8c877b806e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:16.953142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ae9480c-b0ed-4329-a7cc-8f8c877b806e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:16.953605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ae9480c-b0ed-4329-a7cc-8f8c877b806e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:16.954294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ae9480c-b0ed-4329-a7cc-8f8c877b806e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:16.954774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ae9480c-b0ed-4329-a7cc-8f8c877b806e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:16.955716 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ae9480c-b0ed-4329-a7cc-8f8c877b806e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:17.051889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f474c641-aabe-40b7-9b6c-63fd7775bf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:17.061255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f474c641-aabe-40b7-9b6c-63fd7775bf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:17.062711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f474c641-aabe-40b7-9b6c-63fd7775bf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:17.063868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f474c641-aabe-40b7-9b6c-63fd7775bf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169142 Sep 13 20:18:17.064570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 953/1989] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:16 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:17.098901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0ae9480c-b0ed-4329-a7cc-8f8c877b806e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:17.111929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0ae9480c-b0ed-4329-a7cc-8f8c877b806e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.170324 Sep 13 20:18:17.112696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1037/1990] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:16 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:18.091167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-927d2953-fde3-4d32-931f-a3cf4a69054f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:18.092377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-927d2953-fde3-4d32-931f-a3cf4a69054f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:18.099038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-927d2953-fde3-4d32-931f-a3cf4a69054f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:18.099518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-927d2953-fde3-4d32-931f-a3cf4a69054f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:18.099975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-927d2953-fde3-4d32-931f-a3cf4a69054f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:18.100650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-927d2953-fde3-4d32-931f-a3cf4a69054f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:18.101076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-927d2953-fde3-4d32-931f-a3cf4a69054f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:18.101506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-927d2953-fde3-4d32-931f-a3cf4a69054f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:18.140640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2503ff6b-7d15-4d95-b0d8-b4ad8030f9ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:18.141231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2503ff6b-7d15-4d95-b0d8-b4ad8030f9ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:18.147807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2503ff6b-7d15-4d95-b0d8-b4ad8030f9ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:18.148274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2503ff6b-7d15-4d95-b0d8-b4ad8030f9ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:18.148693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2503ff6b-7d15-4d95-b0d8-b4ad8030f9ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:18.149371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2503ff6b-7d15-4d95-b0d8-b4ad8030f9ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:18.149806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2503ff6b-7d15-4d95-b0d8-b4ad8030f9ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:18.150213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2503ff6b-7d15-4d95-b0d8-b4ad8030f9ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:18.233560 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-927d2953-fde3-4d32-931f-a3cf4a69054f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:18.244255 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-927d2953-fde3-4d32-931f-a3cf4a69054f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:18.245961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-927d2953-fde3-4d32-931f-a3cf4a69054f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:18.247383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-927d2953-fde3-4d32-931f-a3cf4a69054f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162409 Sep 13 20:18:18.248561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 954/1991] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:18.279957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2503ff6b-7d15-4d95-b0d8-b4ad8030f9ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:18.288261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2503ff6b-7d15-4d95-b0d8-b4ad8030f9ef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.151496 Sep 13 20:18:18.288754 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1038/1992] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:18 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:18:19.272411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-519f008f-9c14-4f4f-ab22-3993d23b87ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:19.273020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-519f008f-9c14-4f4f-ab22-3993d23b87ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:19.280000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-519f008f-9c14-4f4f-ab22-3993d23b87ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:19.280491 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-519f008f-9c14-4f4f-ab22-3993d23b87ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:19.280926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-519f008f-9c14-4f4f-ab22-3993d23b87ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:19.281623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-519f008f-9c14-4f4f-ab22-3993d23b87ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:19.282071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-519f008f-9c14-4f4f-ab22-3993d23b87ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:19.282537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-519f008f-9c14-4f4f-ab22-3993d23b87ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:19.310829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0f2f19a6-8c51-4f0b-97ce-b3a7aa8cef1b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:19.311510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0f2f19a6-8c51-4f0b-97ce-b3a7aa8cef1b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:19.318157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f2f19a6-8c51-4f0b-97ce-b3a7aa8cef1b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:19.318667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f2f19a6-8c51-4f0b-97ce-b3a7aa8cef1b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:19.319089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f2f19a6-8c51-4f0b-97ce-b3a7aa8cef1b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:19.319772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f2f19a6-8c51-4f0b-97ce-b3a7aa8cef1b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:19.320212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f2f19a6-8c51-4f0b-97ce-b3a7aa8cef1b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:19.320629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0f2f19a6-8c51-4f0b-97ce-b3a7aa8cef1b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:19.414790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-519f008f-9c14-4f4f-ab22-3993d23b87ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:19.424011 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-519f008f-9c14-4f4f-ab22-3993d23b87ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:19.425454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-519f008f-9c14-4f4f-ab22-3993d23b87ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:19.427102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-519f008f-9c14-4f4f-ab22-3993d23b87ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158624 Sep 13 20:18:19.427808 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 955/1993] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:19.458241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0f2f19a6-8c51-4f0b-97ce-b3a7aa8cef1b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:19.471821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0f2f19a6-8c51-4f0b-97ce-b3a7aa8cef1b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164662 Sep 13 20:18:19.472469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1039/1994] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:19 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:20.456781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ee24fbbe-20c7-419c-ab8c-e1f3ec0cd707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:20.457694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ee24fbbe-20c7-419c-ab8c-e1f3ec0cd707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:20.469106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee24fbbe-20c7-419c-ab8c-e1f3ec0cd707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:20.469904 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee24fbbe-20c7-419c-ab8c-e1f3ec0cd707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:20.470699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee24fbbe-20c7-419c-ab8c-e1f3ec0cd707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:20.471845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee24fbbe-20c7-419c-ab8c-e1f3ec0cd707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:20.472610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee24fbbe-20c7-419c-ab8c-e1f3ec0cd707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:20.473322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee24fbbe-20c7-419c-ab8c-e1f3ec0cd707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:20.499231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ef703131-02fa-40be-a4c1-7f3973be2fff tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:20.499841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ef703131-02fa-40be-a4c1-7f3973be2fff tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:20.506680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef703131-02fa-40be-a4c1-7f3973be2fff tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:20.507187 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef703131-02fa-40be-a4c1-7f3973be2fff tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:20.507617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef703131-02fa-40be-a4c1-7f3973be2fff tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:20.508305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef703131-02fa-40be-a4c1-7f3973be2fff tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:20.508749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef703131-02fa-40be-a4c1-7f3973be2fff tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:20.509171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ef703131-02fa-40be-a4c1-7f3973be2fff tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:20.611109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ee24fbbe-20c7-419c-ab8c-e1f3ec0cd707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:20.619863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ee24fbbe-20c7-419c-ab8c-e1f3ec0cd707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:20.621280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ee24fbbe-20c7-419c-ab8c-e1f3ec0cd707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:20.622593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ee24fbbe-20c7-419c-ab8c-e1f3ec0cd707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172501 Sep 13 20:18:20.623390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 956/1995] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:20.640588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ef703131-02fa-40be-a4c1-7f3973be2fff tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:20.648951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ef703131-02fa-40be-a4c1-7f3973be2fff tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.153670 Sep 13 20:18:20.649515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1040/1996] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:20 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:21.652203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6c2774c5-b158-492c-a179-f9c0cb20a541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:21.653211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6c2774c5-b158-492c-a179-f9c0cb20a541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:21.661096 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c2774c5-b158-492c-a179-f9c0cb20a541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:21.661580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c2774c5-b158-492c-a179-f9c0cb20a541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:21.662011 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c2774c5-b158-492c-a179-f9c0cb20a541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:21.662742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c2774c5-b158-492c-a179-f9c0cb20a541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:21.663194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c2774c5-b158-492c-a179-f9c0cb20a541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:21.663616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c2774c5-b158-492c-a179-f9c0cb20a541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:21.672691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-90874979-932a-4393-895d-f5d28b6ed866 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:21.673299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-90874979-932a-4393-895d-f5d28b6ed866 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:21.680681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90874979-932a-4393-895d-f5d28b6ed866 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:21.681162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90874979-932a-4393-895d-f5d28b6ed866 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:21.681594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90874979-932a-4393-895d-f5d28b6ed866 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:21.682287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90874979-932a-4393-895d-f5d28b6ed866 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:21.682776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90874979-932a-4393-895d-f5d28b6ed866 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:21.683545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90874979-932a-4393-895d-f5d28b6ed866 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:21.792068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6c2774c5-b158-492c-a179-f9c0cb20a541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:21.794318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:18:21.801860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6c2774c5-b158-492c-a179-f9c0cb20a541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:21.803395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6c2774c5-b158-492c-a179-f9c0cb20a541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:21.804570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6c2774c5-b158-492c-a179-f9c0cb20a541 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158913 Sep 13 20:18:21.805106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 957/1997] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:21.812709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-90874979-932a-4393-895d-f5d28b6ed866 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:21.821128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-90874979-932a-4393-895d-f5d28b6ed866 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.152442 Sep 13 20:18:21.821696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1041/1998] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:21 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:22.834798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-70d786cf-0fb7-4f2c-8416-2751ff273b75 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:22.835627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-70d786cf-0fb7-4f2c-8416-2751ff273b75 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:22.845626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70d786cf-0fb7-4f2c-8416-2751ff273b75 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:22.846118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70d786cf-0fb7-4f2c-8416-2751ff273b75 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:22.846583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70d786cf-0fb7-4f2c-8416-2751ff273b75 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:22.846745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1384ba6c-ef0d-44fd-89b8-47b0623b12e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:22.847233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1384ba6c-ef0d-44fd-89b8-47b0623b12e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:22.847387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70d786cf-0fb7-4f2c-8416-2751ff273b75 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:22.847719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70d786cf-0fb7-4f2c-8416-2751ff273b75 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:22.848136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70d786cf-0fb7-4f2c-8416-2751ff273b75 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:22.857256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1384ba6c-ef0d-44fd-89b8-47b0623b12e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:22.857796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1384ba6c-ef0d-44fd-89b8-47b0623b12e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:22.858229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1384ba6c-ef0d-44fd-89b8-47b0623b12e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:22.859082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1384ba6c-ef0d-44fd-89b8-47b0623b12e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:22.859534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1384ba6c-ef0d-44fd-89b8-47b0623b12e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:22.860007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1384ba6c-ef0d-44fd-89b8-47b0623b12e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:22.986543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-70d786cf-0fb7-4f2c-8416-2751ff273b75 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:22.991865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1384ba6c-ef0d-44fd-89b8-47b0623b12e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:22.995586 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-70d786cf-0fb7-4f2c-8416-2751ff273b75 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:22.997025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-70d786cf-0fb7-4f2c-8416-2751ff273b75 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:22.998168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-70d786cf-0fb7-4f2c-8416-2751ff273b75 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.170552 Sep 13 20:18:22.998800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 958/1999] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:22 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:23.000132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1384ba6c-ef0d-44fd-89b8-47b0623b12e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.157995 Sep 13 20:18:23.000682 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1042/2000] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:22 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:24.025714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c3f6070c-d594-4808-b4e6-d36fcba426cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:24.026545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-36acedf4-85c5-4a26-bdb9-7fb25f86be50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:24.027101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c3f6070c-d594-4808-b4e6-d36fcba426cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:24.027272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-36acedf4-85c5-4a26-bdb9-7fb25f86be50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:24.035439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36acedf4-85c5-4a26-bdb9-7fb25f86be50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:24.035855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3f6070c-d594-4808-b4e6-d36fcba426cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:24.036047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36acedf4-85c5-4a26-bdb9-7fb25f86be50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:24.036449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3f6070c-d594-4808-b4e6-d36fcba426cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:24.036614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36acedf4-85c5-4a26-bdb9-7fb25f86be50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:24.037022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3f6070c-d594-4808-b4e6-d36fcba426cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:24.037498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36acedf4-85c5-4a26-bdb9-7fb25f86be50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:24.037967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3f6070c-d594-4808-b4e6-d36fcba426cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:24.038132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36acedf4-85c5-4a26-bdb9-7fb25f86be50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:24.038585 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3f6070c-d594-4808-b4e6-d36fcba426cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:24.038735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36acedf4-85c5-4a26-bdb9-7fb25f86be50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:24.039709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c3f6070c-d594-4808-b4e6-d36fcba426cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:24.173792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c3f6070c-d594-4808-b4e6-d36fcba426cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:24.174441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-36acedf4-85c5-4a26-bdb9-7fb25f86be50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:24.183014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-36acedf4-85c5-4a26-bdb9-7fb25f86be50 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.162138 Sep 13 20:18:24.183588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c3f6070c-d594-4808-b4e6-d36fcba426cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:24.183779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1043/2001] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:24 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:18:24.185025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c3f6070c-d594-4808-b4e6-d36fcba426cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:24.186182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c3f6070c-d594-4808-b4e6-d36fcba426cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165777 Sep 13 20:18:24.186806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 959/2002] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:25.211075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6ad643ee-fc8e-494a-b7a8-dc6129b57615 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:25.211913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6ad643ee-fc8e-494a-b7a8-dc6129b57615 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:25.217554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-777b8de5-5aad-46bc-baaa-1ef3fbf51686 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:25.218539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-777b8de5-5aad-46bc-baaa-1ef3fbf51686 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:25.221336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6ad643ee-fc8e-494a-b7a8-dc6129b57615 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:25.221841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6ad643ee-fc8e-494a-b7a8-dc6129b57615 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:25.222266 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6ad643ee-fc8e-494a-b7a8-dc6129b57615 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:25.222995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6ad643ee-fc8e-494a-b7a8-dc6129b57615 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:25.223469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6ad643ee-fc8e-494a-b7a8-dc6129b57615 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:25.224019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6ad643ee-fc8e-494a-b7a8-dc6129b57615 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:25.225215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-777b8de5-5aad-46bc-baaa-1ef3fbf51686 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:25.225696 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-777b8de5-5aad-46bc-baaa-1ef3fbf51686 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:25.226129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-777b8de5-5aad-46bc-baaa-1ef3fbf51686 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:25.226848 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-777b8de5-5aad-46bc-baaa-1ef3fbf51686 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:25.227279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-777b8de5-5aad-46bc-baaa-1ef3fbf51686 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:25.227695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-777b8de5-5aad-46bc-baaa-1ef3fbf51686 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:25.356687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-777b8de5-5aad-46bc-baaa-1ef3fbf51686 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:25.356881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6ad643ee-fc8e-494a-b7a8-dc6129b57615 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:25.365437 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6ad643ee-fc8e-494a-b7a8-dc6129b57615 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161396 Sep 13 20:18:25.365867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-777b8de5-5aad-46bc-baaa-1ef3fbf51686 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:25.369032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1044/2003] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:25 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:25.369203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-777b8de5-5aad-46bc-baaa-1ef3fbf51686 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:25.369203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-777b8de5-5aad-46bc-baaa-1ef3fbf51686 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.157587 Sep 13 20:18:25.369203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 960/2004] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:26.393015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b36a908a-9b80-4713-a952-90ad6ed120f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:26.393652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b36a908a-9b80-4713-a952-90ad6ed120f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:26.394639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-34123912-6cae-44d0-9999-adafe9303086 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:26.395242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-34123912-6cae-44d0-9999-adafe9303086 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:26.400116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b36a908a-9b80-4713-a952-90ad6ed120f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:26.400614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b36a908a-9b80-4713-a952-90ad6ed120f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:26.401067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b36a908a-9b80-4713-a952-90ad6ed120f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:26.401791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b36a908a-9b80-4713-a952-90ad6ed120f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:26.402259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b36a908a-9b80-4713-a952-90ad6ed120f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:26.402437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34123912-6cae-44d0-9999-adafe9303086 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:26.402687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b36a908a-9b80-4713-a952-90ad6ed120f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:26.402877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34123912-6cae-44d0-9999-adafe9303086 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:26.403333 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34123912-6cae-44d0-9999-adafe9303086 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:26.404070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34123912-6cae-44d0-9999-adafe9303086 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:26.404544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34123912-6cae-44d0-9999-adafe9303086 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:26.404988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-34123912-6cae-44d0-9999-adafe9303086 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:26.541654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b36a908a-9b80-4713-a952-90ad6ed120f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:26.548282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-34123912-6cae-44d0-9999-adafe9303086 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:26.551984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b36a908a-9b80-4713-a952-90ad6ed120f1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164888 Sep 13 20:18:26.552553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1045/2005] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:26 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:26.557834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-34123912-6cae-44d0-9999-adafe9303086 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:26.559477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-34123912-6cae-44d0-9999-adafe9303086 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:26.560681 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-34123912-6cae-44d0-9999-adafe9303086 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.170166 Sep 13 20:18:26.561465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 961/2006] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:27.576697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-72ab1ca5-c3f0-4965-95e8-e5eb1a62e153 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:27.577305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-72ab1ca5-c3f0-4965-95e8-e5eb1a62e153 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:27.586587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-72ab1ca5-c3f0-4965-95e8-e5eb1a62e153 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:27.587067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-72ab1ca5-c3f0-4965-95e8-e5eb1a62e153 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:27.587487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-72ab1ca5-c3f0-4965-95e8-e5eb1a62e153 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:27.588831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-72ab1ca5-c3f0-4965-95e8-e5eb1a62e153 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:27.589665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-72ab1ca5-c3f0-4965-95e8-e5eb1a62e153 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:27.589665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-72ab1ca5-c3f0-4965-95e8-e5eb1a62e153 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:27.747380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-72ab1ca5-c3f0-4965-95e8-e5eb1a62e153 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:27.755517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-72ab1ca5-c3f0-4965-95e8-e5eb1a62e153 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.182790 Sep 13 20:18:27.756360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1046/2007] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:27 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:27.844120 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-740ebb22-7d12-42ee-bab2-5611f6273a04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:27.844721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-740ebb22-7d12-42ee-bab2-5611f6273a04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:27.850755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-740ebb22-7d12-42ee-bab2-5611f6273a04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:27.851230 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-740ebb22-7d12-42ee-bab2-5611f6273a04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:27.851658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-740ebb22-7d12-42ee-bab2-5611f6273a04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:27.852351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-740ebb22-7d12-42ee-bab2-5611f6273a04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:27.852795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-740ebb22-7d12-42ee-bab2-5611f6273a04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:27.853209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-740ebb22-7d12-42ee-bab2-5611f6273a04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:27.991025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-740ebb22-7d12-42ee-bab2-5611f6273a04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:27.999959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-740ebb22-7d12-42ee-bab2-5611f6273a04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:28.001394 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-740ebb22-7d12-42ee-bab2-5611f6273a04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:28.002628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-740ebb22-7d12-42ee-bab2-5611f6273a04 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.420017 Sep 13 20:18:28.003185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 962/2008] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:27 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:28.778867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-201ba32d-6049-4398-ad7d-fb6a040b3690 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:28.779484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-201ba32d-6049-4398-ad7d-fb6a040b3690 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:28.786216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-201ba32d-6049-4398-ad7d-fb6a040b3690 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:28.786725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-201ba32d-6049-4398-ad7d-fb6a040b3690 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:28.787154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-201ba32d-6049-4398-ad7d-fb6a040b3690 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:28.787868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-201ba32d-6049-4398-ad7d-fb6a040b3690 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:28.788255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-201ba32d-6049-4398-ad7d-fb6a040b3690 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:28.788701 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-201ba32d-6049-4398-ad7d-fb6a040b3690 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:28.915420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-201ba32d-6049-4398-ad7d-fb6a040b3690 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:28.924051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-201ba32d-6049-4398-ad7d-fb6a040b3690 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.148911 Sep 13 20:18:28.924450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1047/2009] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:28 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:29.028677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-291084a1-181e-4d0e-935a-a10e43dd1969 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:29.029249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-291084a1-181e-4d0e-935a-a10e43dd1969 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:29.035872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-291084a1-181e-4d0e-935a-a10e43dd1969 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:29.036346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-291084a1-181e-4d0e-935a-a10e43dd1969 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:29.036776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-291084a1-181e-4d0e-935a-a10e43dd1969 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:29.037454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-291084a1-181e-4d0e-935a-a10e43dd1969 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:29.037895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-291084a1-181e-4d0e-935a-a10e43dd1969 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:29.038309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-291084a1-181e-4d0e-935a-a10e43dd1969 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:29.178317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-291084a1-181e-4d0e-935a-a10e43dd1969 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:29.187429 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-291084a1-181e-4d0e-935a-a10e43dd1969 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:29.188850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-291084a1-181e-4d0e-935a-a10e43dd1969 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:29.190007 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-291084a1-181e-4d0e-935a-a10e43dd1969 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165228 Sep 13 20:18:29.190588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 963/2010] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:29 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:29.951354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-19913a45-699c-4fee-8960-28dc72476a04 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:29.952319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-19913a45-699c-4fee-8960-28dc72476a04 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:29.960475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19913a45-699c-4fee-8960-28dc72476a04 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:29.960982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19913a45-699c-4fee-8960-28dc72476a04 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:29.961431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19913a45-699c-4fee-8960-28dc72476a04 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:29.962150 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19913a45-699c-4fee-8960-28dc72476a04 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:29.962659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19913a45-699c-4fee-8960-28dc72476a04 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:29.963100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19913a45-699c-4fee-8960-28dc72476a04 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:30.106850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-19913a45-699c-4fee-8960-28dc72476a04 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:30.115946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-19913a45-699c-4fee-8960-28dc72476a04 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.171056 Sep 13 20:18:30.116520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1048/2011] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:29 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:30.219521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d28e0a24-1a81-4d46-b58e-a54e3c7a438e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:30.220523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d28e0a24-1a81-4d46-b58e-a54e3c7a438e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:30.230688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d28e0a24-1a81-4d46-b58e-a54e3c7a438e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:30.231472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d28e0a24-1a81-4d46-b58e-a54e3c7a438e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:30.232146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d28e0a24-1a81-4d46-b58e-a54e3c7a438e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:30.233363 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d28e0a24-1a81-4d46-b58e-a54e3c7a438e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:30.234097 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d28e0a24-1a81-4d46-b58e-a54e3c7a438e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:30.234861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d28e0a24-1a81-4d46-b58e-a54e3c7a438e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:30.368904 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d28e0a24-1a81-4d46-b58e-a54e3c7a438e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:30.380326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d28e0a24-1a81-4d46-b58e-a54e3c7a438e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:30.381758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d28e0a24-1a81-4d46-b58e-a54e3c7a438e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:30.382947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d28e0a24-1a81-4d46-b58e-a54e3c7a438e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169880 Sep 13 20:18:30.383480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 964/2012] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:30 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:31.148082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-35c40ff1-98c9-4aad-ab18-12cb2c826d62 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:31.148721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-35c40ff1-98c9-4aad-ab18-12cb2c826d62 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:31.155874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35c40ff1-98c9-4aad-ab18-12cb2c826d62 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:31.156343 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35c40ff1-98c9-4aad-ab18-12cb2c826d62 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:31.156762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35c40ff1-98c9-4aad-ab18-12cb2c826d62 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:31.157692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35c40ff1-98c9-4aad-ab18-12cb2c826d62 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:31.158121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35c40ff1-98c9-4aad-ab18-12cb2c826d62 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:31.158576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35c40ff1-98c9-4aad-ab18-12cb2c826d62 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:31.300998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-35c40ff1-98c9-4aad-ab18-12cb2c826d62 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:31.309837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-35c40ff1-98c9-4aad-ab18-12cb2c826d62 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165741 Sep 13 20:18:31.310425 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1049/2013] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:31 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:31.412529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-51b95839-affb-4ec0-b1fd-dbdcfb342bfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:31.413377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-51b95839-affb-4ec0-b1fd-dbdcfb342bfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:31.423978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-51b95839-affb-4ec0-b1fd-dbdcfb342bfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:31.424465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-51b95839-affb-4ec0-b1fd-dbdcfb342bfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:31.424893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-51b95839-affb-4ec0-b1fd-dbdcfb342bfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:31.425585 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-51b95839-affb-4ec0-b1fd-dbdcfb342bfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:31.426030 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-51b95839-affb-4ec0-b1fd-dbdcfb342bfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:31.426479 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-51b95839-affb-4ec0-b1fd-dbdcfb342bfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:31.557378 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-51b95839-affb-4ec0-b1fd-dbdcfb342bfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:31.566243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-51b95839-affb-4ec0-b1fd-dbdcfb342bfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:31.567748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-51b95839-affb-4ec0-b1fd-dbdcfb342bfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:31.568904 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-51b95839-affb-4ec0-b1fd-dbdcfb342bfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.163111 Sep 13 20:18:31.569459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 965/2014] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:32.337983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4b15572a-679e-42a7-a07a-0c84328028db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:32.339052 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4b15572a-679e-42a7-a07a-0c84328028db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:32.349982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4b15572a-679e-42a7-a07a-0c84328028db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:32.350839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4b15572a-679e-42a7-a07a-0c84328028db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:32.351553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4b15572a-679e-42a7-a07a-0c84328028db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:32.352704 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4b15572a-679e-42a7-a07a-0c84328028db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:32.353440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4b15572a-679e-42a7-a07a-0c84328028db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:32.354209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4b15572a-679e-42a7-a07a-0c84328028db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:32.483725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4b15572a-679e-42a7-a07a-0c84328028db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:32.492842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4b15572a-679e-42a7-a07a-0c84328028db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161640 Sep 13 20:18:32.493419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1050/2015] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:32 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:32.595762 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-da1ec498-c9e4-443a-9647-84288c6a8b31 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:32.596269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-da1ec498-c9e4-443a-9647-84288c6a8b31 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:32.598783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=50 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:18:32.604264 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da1ec498-c9e4-443a-9647-84288c6a8b31 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:32.604742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da1ec498-c9e4-443a-9647-84288c6a8b31 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:32.605183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da1ec498-c9e4-443a-9647-84288c6a8b31 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:32.605874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da1ec498-c9e4-443a-9647-84288c6a8b31 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:32.606314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da1ec498-c9e4-443a-9647-84288c6a8b31 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:32.606803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-da1ec498-c9e4-443a-9647-84288c6a8b31 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:32.742154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-da1ec498-c9e4-443a-9647-84288c6a8b31 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:32.750982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-da1ec498-c9e4-443a-9647-84288c6a8b31 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:32.752464 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-da1ec498-c9e4-443a-9647-84288c6a8b31 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:32.753627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-da1ec498-c9e4-443a-9647-84288c6a8b31 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162241 Sep 13 20:18:32.754166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 966/2016] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:33.520487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6bd7b4e3-905d-41a0-99c5-5c25a041ed34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:33.521487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6bd7b4e3-905d-41a0-99c5-5c25a041ed34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:33.525043 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:18:33.533457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6bd7b4e3-905d-41a0-99c5-5c25a041ed34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:33.533922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6bd7b4e3-905d-41a0-99c5-5c25a041ed34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:33.534345 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6bd7b4e3-905d-41a0-99c5-5c25a041ed34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:33.535041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6bd7b4e3-905d-41a0-99c5-5c25a041ed34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:33.535479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6bd7b4e3-905d-41a0-99c5-5c25a041ed34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:33.535887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6bd7b4e3-905d-41a0-99c5-5c25a041ed34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:33.670022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6bd7b4e3-905d-41a0-99c5-5c25a041ed34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:33.679936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6bd7b4e3-905d-41a0-99c5-5c25a041ed34 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166017 Sep 13 20:18:33.680505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1051/2017] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:33 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:33.783369 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-210e7c4d-ed24-4213-b6bc-ffe41a58ff29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:33.784227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-210e7c4d-ed24-4213-b6bc-ffe41a58ff29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:33.795108 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-210e7c4d-ed24-4213-b6bc-ffe41a58ff29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:33.795890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-210e7c4d-ed24-4213-b6bc-ffe41a58ff29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:33.796600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-210e7c4d-ed24-4213-b6bc-ffe41a58ff29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:33.797715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-210e7c4d-ed24-4213-b6bc-ffe41a58ff29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:33.798407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-210e7c4d-ed24-4213-b6bc-ffe41a58ff29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:33.798832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-210e7c4d-ed24-4213-b6bc-ffe41a58ff29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:33.928625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-210e7c4d-ed24-4213-b6bc-ffe41a58ff29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:33.941730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-210e7c4d-ed24-4213-b6bc-ffe41a58ff29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:33.944129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-210e7c4d-ed24-4213-b6bc-ffe41a58ff29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:33.945914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-210e7c4d-ed24-4213-b6bc-ffe41a58ff29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168965 Sep 13 20:18:33.946688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 967/2018] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:34.707037 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2bf45e20-1aac-4850-8c34-cdd98143a842 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:34.708052 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2bf45e20-1aac-4850-8c34-cdd98143a842 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:34.719565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2bf45e20-1aac-4850-8c34-cdd98143a842 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:34.720353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2bf45e20-1aac-4850-8c34-cdd98143a842 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:34.721060 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2bf45e20-1aac-4850-8c34-cdd98143a842 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:34.722233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2bf45e20-1aac-4850-8c34-cdd98143a842 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:34.723029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2bf45e20-1aac-4850-8c34-cdd98143a842 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:34.723729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2bf45e20-1aac-4850-8c34-cdd98143a842 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:34.972684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ff872a29-e4c1-44af-b3bf-0dbd9f2346dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:34.973404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ff872a29-e4c1-44af-b3bf-0dbd9f2346dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:34.979853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2bf45e20-1aac-4850-8c34-cdd98143a842 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:34.980260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff872a29-e4c1-44af-b3bf-0dbd9f2346dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:34.980831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff872a29-e4c1-44af-b3bf-0dbd9f2346dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:34.981270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff872a29-e4c1-44af-b3bf-0dbd9f2346dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:34.981980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff872a29-e4c1-44af-b3bf-0dbd9f2346dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:34.982096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:18:34.982459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff872a29-e4c1-44af-b3bf-0dbd9f2346dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:34.982891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff872a29-e4c1-44af-b3bf-0dbd9f2346dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:34.989107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2bf45e20-1aac-4850-8c34-cdd98143a842 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.288749 Sep 13 20:18:34.993535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1052/2019] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:34 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:35.118276 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ff872a29-e4c1-44af-b3bf-0dbd9f2346dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:35.127331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ff872a29-e4c1-44af-b3bf-0dbd9f2346dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:35.128733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ff872a29-e4c1-44af-b3bf-0dbd9f2346dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:35.129906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ff872a29-e4c1-44af-b3bf-0dbd9f2346dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161653 Sep 13 20:18:35.130486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 968/2020] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:34 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:36.017426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-caaf7f27-7798-4372-85c6-8fc81d0fb361 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:36.018263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-caaf7f27-7798-4372-85c6-8fc81d0fb361 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:36.026118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-caaf7f27-7798-4372-85c6-8fc81d0fb361 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:36.026721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-caaf7f27-7798-4372-85c6-8fc81d0fb361 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:36.027225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-caaf7f27-7798-4372-85c6-8fc81d0fb361 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:36.028027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-caaf7f27-7798-4372-85c6-8fc81d0fb361 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:36.028554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-caaf7f27-7798-4372-85c6-8fc81d0fb361 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:36.029044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-caaf7f27-7798-4372-85c6-8fc81d0fb361 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:36.154976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9938c063-ea49-49b7-8d0e-803e25a2e597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:36.155586 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9938c063-ea49-49b7-8d0e-803e25a2e597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:36.163093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9938c063-ea49-49b7-8d0e-803e25a2e597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:36.163573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-caaf7f27-7798-4372-85c6-8fc81d0fb361 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:36.163718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9938c063-ea49-49b7-8d0e-803e25a2e597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:36.164037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9938c063-ea49-49b7-8d0e-803e25a2e597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:36.164759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9938c063-ea49-49b7-8d0e-803e25a2e597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:36.165208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9938c063-ea49-49b7-8d0e-803e25a2e597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:36.165627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9938c063-ea49-49b7-8d0e-803e25a2e597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:36.172299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-caaf7f27-7798-4372-85c6-8fc81d0fb361 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.162106 Sep 13 20:18:36.172903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1053/2021] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:36 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:36.297427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9938c063-ea49-49b7-8d0e-803e25a2e597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:36.306220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9938c063-ea49-49b7-8d0e-803e25a2e597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:36.307714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9938c063-ea49-49b7-8d0e-803e25a2e597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:36.308862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9938c063-ea49-49b7-8d0e-803e25a2e597 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158104 Sep 13 20:18:36.309416 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 969/2022] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:37.196275 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-be1470f8-75c7-4240-982e-d0e87338805a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:37.197035 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-be1470f8-75c7-4240-982e-d0e87338805a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:37.204331 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be1470f8-75c7-4240-982e-d0e87338805a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:37.204813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be1470f8-75c7-4240-982e-d0e87338805a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:37.205238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be1470f8-75c7-4240-982e-d0e87338805a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:37.205928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be1470f8-75c7-4240-982e-d0e87338805a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:37.206392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be1470f8-75c7-4240-982e-d0e87338805a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:37.206790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be1470f8-75c7-4240-982e-d0e87338805a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:37.334657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-47550ca1-cf7f-48e0-a4d7-4306bf2707a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:37.335276 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-47550ca1-cf7f-48e0-a4d7-4306bf2707a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:37.342469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-be1470f8-75c7-4240-982e-d0e87338805a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:37.343544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47550ca1-cf7f-48e0-a4d7-4306bf2707a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:37.344033 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47550ca1-cf7f-48e0-a4d7-4306bf2707a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:37.344465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47550ca1-cf7f-48e0-a4d7-4306bf2707a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:37.345175 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47550ca1-cf7f-48e0-a4d7-4306bf2707a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:37.346222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47550ca1-cf7f-48e0-a4d7-4306bf2707a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:37.346222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47550ca1-cf7f-48e0-a4d7-4306bf2707a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:37.351476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-be1470f8-75c7-4240-982e-d0e87338805a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.159062 Sep 13 20:18:37.352034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1054/2023] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:37 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:37.556634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-47550ca1-cf7f-48e0-a4d7-4306bf2707a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:37.565674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-47550ca1-cf7f-48e0-a4d7-4306bf2707a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:37.567176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-47550ca1-cf7f-48e0-a4d7-4306bf2707a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:37.568361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-47550ca1-cf7f-48e0-a4d7-4306bf2707a6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.239024 Sep 13 20:18:37.569243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 970/2024] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:38.375811 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-10a9b9fe-0b5c-4364-a319-bef7e7a7ddb3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:38.376431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-10a9b9fe-0b5c-4364-a319-bef7e7a7ddb3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:38.383226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10a9b9fe-0b5c-4364-a319-bef7e7a7ddb3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:38.383703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10a9b9fe-0b5c-4364-a319-bef7e7a7ddb3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:38.384123 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10a9b9fe-0b5c-4364-a319-bef7e7a7ddb3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:38.384795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10a9b9fe-0b5c-4364-a319-bef7e7a7ddb3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:38.385239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10a9b9fe-0b5c-4364-a319-bef7e7a7ddb3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:38.385644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-10a9b9fe-0b5c-4364-a319-bef7e7a7ddb3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:38.520768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-10a9b9fe-0b5c-4364-a319-bef7e7a7ddb3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:38.529181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-10a9b9fe-0b5c-4364-a319-bef7e7a7ddb3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.157312 Sep 13 20:18:38.529723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1055/2025] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:38 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:38.594327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7ada5f09-fdc6-45a1-8f2c-d42ac0f9a697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:38.594995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7ada5f09-fdc6-45a1-8f2c-d42ac0f9a697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:38.602062 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7ada5f09-fdc6-45a1-8f2c-d42ac0f9a697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:38.602583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7ada5f09-fdc6-45a1-8f2c-d42ac0f9a697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:38.603014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7ada5f09-fdc6-45a1-8f2c-d42ac0f9a697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:38.603704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7ada5f09-fdc6-45a1-8f2c-d42ac0f9a697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:38.604151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7ada5f09-fdc6-45a1-8f2c-d42ac0f9a697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:38.604571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7ada5f09-fdc6-45a1-8f2c-d42ac0f9a697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:38.746835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7ada5f09-fdc6-45a1-8f2c-d42ac0f9a697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:38.757653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7ada5f09-fdc6-45a1-8f2c-d42ac0f9a697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:38.759146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7ada5f09-fdc6-45a1-8f2c-d42ac0f9a697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:38.760312 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7ada5f09-fdc6-45a1-8f2c-d42ac0f9a697 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169895 Sep 13 20:18:38.760879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 971/2026] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:39.554314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-731a15c5-b7a4-4354-8bfe-18eaac473645 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:39.555013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-731a15c5-b7a4-4354-8bfe-18eaac473645 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:39.561818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-731a15c5-b7a4-4354-8bfe-18eaac473645 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:39.562291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-731a15c5-b7a4-4354-8bfe-18eaac473645 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:39.562896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-731a15c5-b7a4-4354-8bfe-18eaac473645 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:39.563589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-731a15c5-b7a4-4354-8bfe-18eaac473645 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:39.564028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-731a15c5-b7a4-4354-8bfe-18eaac473645 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:39.564480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-731a15c5-b7a4-4354-8bfe-18eaac473645 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:39.696333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-731a15c5-b7a4-4354-8bfe-18eaac473645 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:39.704879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-731a15c5-b7a4-4354-8bfe-18eaac473645 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.155810 Sep 13 20:18:39.705450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1056/2027] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:39 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:39.790029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bd285883-c553-45f8-b386-1d755fec86b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:39.791010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bd285883-c553-45f8-b386-1d755fec86b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:39.801547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bd285883-c553-45f8-b386-1d755fec86b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:39.802022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bd285883-c553-45f8-b386-1d755fec86b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:39.802487 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bd285883-c553-45f8-b386-1d755fec86b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:39.803178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bd285883-c553-45f8-b386-1d755fec86b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:39.803618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bd285883-c553-45f8-b386-1d755fec86b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:39.804041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bd285883-c553-45f8-b386-1d755fec86b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:39.956108 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bd285883-c553-45f8-b386-1d755fec86b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:39.965327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bd285883-c553-45f8-b386-1d755fec86b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:39.966804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bd285883-c553-45f8-b386-1d755fec86b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:39.967976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bd285883-c553-45f8-b386-1d755fec86b9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.184510 Sep 13 20:18:39.968580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 972/2028] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:40.732602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8a156642-6388-4a32-999e-61087bd0e956 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:40.733771 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8a156642-6388-4a32-999e-61087bd0e956 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:40.744640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a156642-6388-4a32-999e-61087bd0e956 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:40.745434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a156642-6388-4a32-999e-61087bd0e956 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:40.746157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a156642-6388-4a32-999e-61087bd0e956 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:40.747371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a156642-6388-4a32-999e-61087bd0e956 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:40.748109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a156642-6388-4a32-999e-61087bd0e956 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:40.748805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8a156642-6388-4a32-999e-61087bd0e956 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:40.888797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8a156642-6388-4a32-999e-61087bd0e956 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:40.897194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8a156642-6388-4a32-999e-61087bd0e956 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.171190 Sep 13 20:18:40.897764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1057/2029] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:40 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:40.998268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b681f289-bc10-4445-91a8-80b63b9a0eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:40.999174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b681f289-bc10-4445-91a8-80b63b9a0eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:41.007691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b681f289-bc10-4445-91a8-80b63b9a0eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:41.008166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b681f289-bc10-4445-91a8-80b63b9a0eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:41.008584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b681f289-bc10-4445-91a8-80b63b9a0eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:41.009262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b681f289-bc10-4445-91a8-80b63b9a0eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:41.009704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b681f289-bc10-4445-91a8-80b63b9a0eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:41.010117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b681f289-bc10-4445-91a8-80b63b9a0eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:41.155966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b681f289-bc10-4445-91a8-80b63b9a0eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:41.164827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b681f289-bc10-4445-91a8-80b63b9a0eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:41.166276 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b681f289-bc10-4445-91a8-80b63b9a0eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:41.167470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b681f289-bc10-4445-91a8-80b63b9a0eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.176039 Sep 13 20:18:41.168035 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 973/2030] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:41.922917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bf53f6d5-105f-4085-9bc1-5a7cc9893757 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:41.923536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bf53f6d5-105f-4085-9bc1-5a7cc9893757 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:41.931325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bf53f6d5-105f-4085-9bc1-5a7cc9893757 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:41.931807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bf53f6d5-105f-4085-9bc1-5a7cc9893757 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:41.932235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bf53f6d5-105f-4085-9bc1-5a7cc9893757 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:41.932918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bf53f6d5-105f-4085-9bc1-5a7cc9893757 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:41.933371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bf53f6d5-105f-4085-9bc1-5a7cc9893757 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:41.933788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bf53f6d5-105f-4085-9bc1-5a7cc9893757 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:42.074387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bf53f6d5-105f-4085-9bc1-5a7cc9893757 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:42.083499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bf53f6d5-105f-4085-9bc1-5a7cc9893757 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164829 Sep 13 20:18:42.084081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1058/2031] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:41 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:42.195421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e599cc33-1c1a-4b82-bcdd-bec501aafc6a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:42.195990 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e599cc33-1c1a-4b82-bcdd-bec501aafc6a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:42.203634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e599cc33-1c1a-4b82-bcdd-bec501aafc6a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:42.204166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e599cc33-1c1a-4b82-bcdd-bec501aafc6a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:42.204646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e599cc33-1c1a-4b82-bcdd-bec501aafc6a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:42.205411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e599cc33-1c1a-4b82-bcdd-bec501aafc6a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:42.205908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e599cc33-1c1a-4b82-bcdd-bec501aafc6a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:42.206407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e599cc33-1c1a-4b82-bcdd-bec501aafc6a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:42.223049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:18:42.371247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e599cc33-1c1a-4b82-bcdd-bec501aafc6a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:42.382917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e599cc33-1c1a-4b82-bcdd-bec501aafc6a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:42.384325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e599cc33-1c1a-4b82-bcdd-bec501aafc6a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:42.385503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e599cc33-1c1a-4b82-bcdd-bec501aafc6a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.195045 Sep 13 20:18:42.386067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 974/2032] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:43.111337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-07a81366-0763-4edd-9801-9efdd3c4077c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:43.112393 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-07a81366-0763-4edd-9801-9efdd3c4077c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:43.124861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07a81366-0763-4edd-9801-9efdd3c4077c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:43.125760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07a81366-0763-4edd-9801-9efdd3c4077c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:43.126524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07a81366-0763-4edd-9801-9efdd3c4077c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:43.127632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07a81366-0763-4edd-9801-9efdd3c4077c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:43.128371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07a81366-0763-4edd-9801-9efdd3c4077c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:43.129154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07a81366-0763-4edd-9801-9efdd3c4077c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:43.261511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-07a81366-0763-4edd-9801-9efdd3c4077c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:43.269984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-07a81366-0763-4edd-9801-9efdd3c4077c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165261 Sep 13 20:18:43.270566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1059/2033] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:43 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:43.410734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a269e679-f552-4055-81a6-d32b887a41b7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:43.411310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a269e679-f552-4055-81a6-d32b887a41b7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:43.417982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a269e679-f552-4055-81a6-d32b887a41b7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:43.418491 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a269e679-f552-4055-81a6-d32b887a41b7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:43.418924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a269e679-f552-4055-81a6-d32b887a41b7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:43.419608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a269e679-f552-4055-81a6-d32b887a41b7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:43.420048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a269e679-f552-4055-81a6-d32b887a41b7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:43.420470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a269e679-f552-4055-81a6-d32b887a41b7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:43.554963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a269e679-f552-4055-81a6-d32b887a41b7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:43.563848 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a269e679-f552-4055-81a6-d32b887a41b7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:43.565305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a269e679-f552-4055-81a6-d32b887a41b7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:43.566516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a269e679-f552-4055-81a6-d32b887a41b7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159937 Sep 13 20:18:43.567080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 975/2034] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:44.297410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d1bbfb43-5123-4cd9-af9c-9605dcb715e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:44.298573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d1bbfb43-5123-4cd9-af9c-9605dcb715e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:44.306501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1bbfb43-5123-4cd9-af9c-9605dcb715e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:44.307002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1bbfb43-5123-4cd9-af9c-9605dcb715e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:44.307450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1bbfb43-5123-4cd9-af9c-9605dcb715e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:44.308162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1bbfb43-5123-4cd9-af9c-9605dcb715e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:44.308633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1bbfb43-5123-4cd9-af9c-9605dcb715e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:44.309064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d1bbfb43-5123-4cd9-af9c-9605dcb715e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:44.444114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d1bbfb43-5123-4cd9-af9c-9605dcb715e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:44.455353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d1bbfb43-5123-4cd9-af9c-9605dcb715e2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164590 Sep 13 20:18:44.456131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1060/2035] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:44 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:44.597350 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-24e76178-f6d7-4245-8ebf-75e323e46406 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:44.598028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-24e76178-f6d7-4245-8ebf-75e323e46406 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:44.604975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24e76178-f6d7-4245-8ebf-75e323e46406 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:44.605449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24e76178-f6d7-4245-8ebf-75e323e46406 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:44.605874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24e76178-f6d7-4245-8ebf-75e323e46406 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:44.606594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24e76178-f6d7-4245-8ebf-75e323e46406 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:44.607036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24e76178-f6d7-4245-8ebf-75e323e46406 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:44.607447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-24e76178-f6d7-4245-8ebf-75e323e46406 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:44.745900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-24e76178-f6d7-4245-8ebf-75e323e46406 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:44.755010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-24e76178-f6d7-4245-8ebf-75e323e46406 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:44.756459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-24e76178-f6d7-4245-8ebf-75e323e46406 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:44.757608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-24e76178-f6d7-4245-8ebf-75e323e46406 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.164201 Sep 13 20:18:44.758153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 976/2036] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:45.483430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-aee6f14e-41a2-4e60-ae32-964729cd7e84 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:45.484413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-aee6f14e-41a2-4e60-ae32-964729cd7e84 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:45.492905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aee6f14e-41a2-4e60-ae32-964729cd7e84 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:45.493385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aee6f14e-41a2-4e60-ae32-964729cd7e84 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:45.493814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aee6f14e-41a2-4e60-ae32-964729cd7e84 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:45.494548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aee6f14e-41a2-4e60-ae32-964729cd7e84 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:45.494997 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aee6f14e-41a2-4e60-ae32-964729cd7e84 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:45.495417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aee6f14e-41a2-4e60-ae32-964729cd7e84 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:45.635826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-aee6f14e-41a2-4e60-ae32-964729cd7e84 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:45.648284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-aee6f14e-41a2-4e60-ae32-964729cd7e84 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.171126 Sep 13 20:18:45.648974 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1061/2037] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:45 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:45.782037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-23406555-f7ad-4edf-a723-c92f2b7f428b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:45.782670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-23406555-f7ad-4edf-a723-c92f2b7f428b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:45.789589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23406555-f7ad-4edf-a723-c92f2b7f428b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:45.790072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23406555-f7ad-4edf-a723-c92f2b7f428b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:45.790539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23406555-f7ad-4edf-a723-c92f2b7f428b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:45.791271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23406555-f7ad-4edf-a723-c92f2b7f428b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:45.791728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23406555-f7ad-4edf-a723-c92f2b7f428b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:45.792148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23406555-f7ad-4edf-a723-c92f2b7f428b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:45.923395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-23406555-f7ad-4edf-a723-c92f2b7f428b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:45.932292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-23406555-f7ad-4edf-a723-c92f2b7f428b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:45.933721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-23406555-f7ad-4edf-a723-c92f2b7f428b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:45.934917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-23406555-f7ad-4edf-a723-c92f2b7f428b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.156817 Sep 13 20:18:45.935448 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 977/2038] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:46.679630 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f1bbca36-17dc-4beb-9f12-abb7b90b463d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:46.680617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f1bbca36-17dc-4beb-9f12-abb7b90b463d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:46.691821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1bbca36-17dc-4beb-9f12-abb7b90b463d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:46.692282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1bbca36-17dc-4beb-9f12-abb7b90b463d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:46.692687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1bbca36-17dc-4beb-9f12-abb7b90b463d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:46.693362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1bbca36-17dc-4beb-9f12-abb7b90b463d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:46.693797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1bbca36-17dc-4beb-9f12-abb7b90b463d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:46.694206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f1bbca36-17dc-4beb-9f12-abb7b90b463d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:46.831889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f1bbca36-17dc-4beb-9f12-abb7b90b463d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:46.840766 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f1bbca36-17dc-4beb-9f12-abb7b90b463d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167718 Sep 13 20:18:46.841333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1062/2039] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:46 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:46.964494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-14650ce0-0e9e-4bcd-b405-6f4868f52ec4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:46.965532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-14650ce0-0e9e-4bcd-b405-6f4868f52ec4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:46.976287 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14650ce0-0e9e-4bcd-b405-6f4868f52ec4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:46.977138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14650ce0-0e9e-4bcd-b405-6f4868f52ec4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:46.977848 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14650ce0-0e9e-4bcd-b405-6f4868f52ec4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:46.979023 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14650ce0-0e9e-4bcd-b405-6f4868f52ec4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:46.979767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14650ce0-0e9e-4bcd-b405-6f4868f52ec4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:46.980461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-14650ce0-0e9e-4bcd-b405-6f4868f52ec4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:47.112617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-14650ce0-0e9e-4bcd-b405-6f4868f52ec4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:47.125743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-14650ce0-0e9e-4bcd-b405-6f4868f52ec4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:47.127902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-14650ce0-0e9e-4bcd-b405-6f4868f52ec4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:47.129630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-14650ce0-0e9e-4bcd-b405-6f4868f52ec4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.171936 Sep 13 20:18:47.130188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 978/2040] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:47.868395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b6ca7d0f-c14a-4a38-9ad8-2dd9e4e3b818 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:47.870751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b6ca7d0f-c14a-4a38-9ad8-2dd9e4e3b818 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:47.880882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6ca7d0f-c14a-4a38-9ad8-2dd9e4e3b818 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:47.881349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6ca7d0f-c14a-4a38-9ad8-2dd9e4e3b818 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:47.881771 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6ca7d0f-c14a-4a38-9ad8-2dd9e4e3b818 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:47.882458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6ca7d0f-c14a-4a38-9ad8-2dd9e4e3b818 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:47.882936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6ca7d0f-c14a-4a38-9ad8-2dd9e4e3b818 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:47.883348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b6ca7d0f-c14a-4a38-9ad8-2dd9e4e3b818 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:48.016384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b6ca7d0f-c14a-4a38-9ad8-2dd9e4e3b818 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:48.027454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b6ca7d0f-c14a-4a38-9ad8-2dd9e4e3b818 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165616 Sep 13 20:18:48.028041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1063/2041] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:47 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:48.169085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c89e4479-29fe-4824-bad1-f56c2937f012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:48.169948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c89e4479-29fe-4824-bad1-f56c2937f012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:48.180806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c89e4479-29fe-4824-bad1-f56c2937f012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:48.181654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c89e4479-29fe-4824-bad1-f56c2937f012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:48.182337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c89e4479-29fe-4824-bad1-f56c2937f012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:48.183526 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c89e4479-29fe-4824-bad1-f56c2937f012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:48.184282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c89e4479-29fe-4824-bad1-f56c2937f012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:48.184982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c89e4479-29fe-4824-bad1-f56c2937f012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:48.321933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c89e4479-29fe-4824-bad1-f56c2937f012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:48.331093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c89e4479-29fe-4824-bad1-f56c2937f012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:48.332543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c89e4479-29fe-4824-bad1-f56c2937f012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:48.334101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c89e4479-29fe-4824-bad1-f56c2937f012 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.171796 Sep 13 20:18:48.334730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 979/2042] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:48 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:49.051086 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a0ceae81-c515-4b5d-9e4a-23685ee8b104 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:49.051689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a0ceae81-c515-4b5d-9e4a-23685ee8b104 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:49.058594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0ceae81-c515-4b5d-9e4a-23685ee8b104 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:49.059071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0ceae81-c515-4b5d-9e4a-23685ee8b104 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:49.059491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0ceae81-c515-4b5d-9e4a-23685ee8b104 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:49.060147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0ceae81-c515-4b5d-9e4a-23685ee8b104 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:49.060610 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0ceae81-c515-4b5d-9e4a-23685ee8b104 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:49.061022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0ceae81-c515-4b5d-9e4a-23685ee8b104 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:49.188415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a0ceae81-c515-4b5d-9e4a-23685ee8b104 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:49.197318 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a0ceae81-c515-4b5d-9e4a-23685ee8b104 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.150126 Sep 13 20:18:49.197903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1064/2043] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:49 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:49.364314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c2d47fa8-9d9a-448b-b0f9-584ae1a4c493 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:49.365174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c2d47fa8-9d9a-448b-b0f9-584ae1a4c493 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:49.376342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2d47fa8-9d9a-448b-b0f9-584ae1a4c493 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:49.377102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2d47fa8-9d9a-448b-b0f9-584ae1a4c493 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:49.377867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2d47fa8-9d9a-448b-b0f9-584ae1a4c493 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:49.379053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2d47fa8-9d9a-448b-b0f9-584ae1a4c493 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:49.379801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2d47fa8-9d9a-448b-b0f9-584ae1a4c493 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:49.380500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2d47fa8-9d9a-448b-b0f9-584ae1a4c493 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:49.513620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c2d47fa8-9d9a-448b-b0f9-584ae1a4c493 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:49.522820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c2d47fa8-9d9a-448b-b0f9-584ae1a4c493 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:49.524239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c2d47fa8-9d9a-448b-b0f9-584ae1a4c493 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:49.525422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c2d47fa8-9d9a-448b-b0f9-584ae1a4c493 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167909 Sep 13 20:18:49.525982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 980/2044] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:50.221174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8d3d7942-ae1e-4dc7-a618-1407072c6f46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:50.221730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8d3d7942-ae1e-4dc7-a618-1407072c6f46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:50.228596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d3d7942-ae1e-4dc7-a618-1407072c6f46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:50.229066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d3d7942-ae1e-4dc7-a618-1407072c6f46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:50.229484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d3d7942-ae1e-4dc7-a618-1407072c6f46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:50.230191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d3d7942-ae1e-4dc7-a618-1407072c6f46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:50.230667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d3d7942-ae1e-4dc7-a618-1407072c6f46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:50.231083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d3d7942-ae1e-4dc7-a618-1407072c6f46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:50.369159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8d3d7942-ae1e-4dc7-a618-1407072c6f46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:50.381900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8d3d7942-ae1e-4dc7-a618-1407072c6f46 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164216 Sep 13 20:18:50.382458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1065/2045] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:50 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:50.554621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3e0c94e9-0a43-4ce3-aa33-04d4c7208da3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:50.555264 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3e0c94e9-0a43-4ce3-aa33-04d4c7208da3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:50.562028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e0c94e9-0a43-4ce3-aa33-04d4c7208da3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:50.562535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e0c94e9-0a43-4ce3-aa33-04d4c7208da3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:50.562965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e0c94e9-0a43-4ce3-aa33-04d4c7208da3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:50.563650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e0c94e9-0a43-4ce3-aa33-04d4c7208da3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:50.564090 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e0c94e9-0a43-4ce3-aa33-04d4c7208da3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:50.564505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e0c94e9-0a43-4ce3-aa33-04d4c7208da3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:50.693943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3e0c94e9-0a43-4ce3-aa33-04d4c7208da3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:50.703051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3e0c94e9-0a43-4ce3-aa33-04d4c7208da3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:50.704490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3e0c94e9-0a43-4ce3-aa33-04d4c7208da3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:50.705653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3e0c94e9-0a43-4ce3-aa33-04d4c7208da3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.157349 Sep 13 20:18:50.706221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 981/2046] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:51.414937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-99637303-e159-43d1-8037-732bf9a6c23e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:51.415945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-99637303-e159-43d1-8037-732bf9a6c23e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:51.428143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99637303-e159-43d1-8037-732bf9a6c23e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:51.428859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99637303-e159-43d1-8037-732bf9a6c23e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:51.429295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99637303-e159-43d1-8037-732bf9a6c23e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:51.429995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99637303-e159-43d1-8037-732bf9a6c23e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:51.430474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99637303-e159-43d1-8037-732bf9a6c23e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:51.430897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-99637303-e159-43d1-8037-732bf9a6c23e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:51.563938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-99637303-e159-43d1-8037-732bf9a6c23e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:51.572875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-99637303-e159-43d1-8037-732bf9a6c23e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164841 Sep 13 20:18:51.573527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1066/2047] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:51 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:51.735861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d60df43d-30ca-4143-bf01-4b25e4ffc3aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:51.736875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d60df43d-30ca-4143-bf01-4b25e4ffc3aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:51.747854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d60df43d-30ca-4143-bf01-4b25e4ffc3aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:51.748655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d60df43d-30ca-4143-bf01-4b25e4ffc3aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:51.749420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d60df43d-30ca-4143-bf01-4b25e4ffc3aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:51.750565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d60df43d-30ca-4143-bf01-4b25e4ffc3aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:51.751326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d60df43d-30ca-4143-bf01-4b25e4ffc3aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:51.752028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d60df43d-30ca-4143-bf01-4b25e4ffc3aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:51.890204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d60df43d-30ca-4143-bf01-4b25e4ffc3aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:51.899077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d60df43d-30ca-4143-bf01-4b25e4ffc3aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:51.900515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d60df43d-30ca-4143-bf01-4b25e4ffc3aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:51.901673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d60df43d-30ca-4143-bf01-4b25e4ffc3aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172442 Sep 13 20:18:51.902238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 982/2048] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:52.596416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e87c99ed-ee01-427b-b1a4-ec375f156596 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:52.597088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e87c99ed-ee01-427b-b1a4-ec375f156596 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:52.604441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e87c99ed-ee01-427b-b1a4-ec375f156596 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:52.604922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e87c99ed-ee01-427b-b1a4-ec375f156596 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:52.605351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e87c99ed-ee01-427b-b1a4-ec375f156596 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:52.606033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e87c99ed-ee01-427b-b1a4-ec375f156596 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:52.606504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e87c99ed-ee01-427b-b1a4-ec375f156596 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:52.606922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e87c99ed-ee01-427b-b1a4-ec375f156596 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:52.743010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e87c99ed-ee01-427b-b1a4-ec375f156596 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:52.751572 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e87c99ed-ee01-427b-b1a4-ec375f156596 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.159493 Sep 13 20:18:52.752147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1067/2049] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:52 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:52.927960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-610b050e-9e8e-4c69-9fd8-1e3d898e731c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:52.928621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-610b050e-9e8e-4c69-9fd8-1e3d898e731c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:52.935539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-610b050e-9e8e-4c69-9fd8-1e3d898e731c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:52.936022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-610b050e-9e8e-4c69-9fd8-1e3d898e731c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:52.936458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-610b050e-9e8e-4c69-9fd8-1e3d898e731c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:52.937150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-610b050e-9e8e-4c69-9fd8-1e3d898e731c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:52.937621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-610b050e-9e8e-4c69-9fd8-1e3d898e731c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:52.938029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-610b050e-9e8e-4c69-9fd8-1e3d898e731c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:53.069985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-610b050e-9e8e-4c69-9fd8-1e3d898e731c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:53.078778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-610b050e-9e8e-4c69-9fd8-1e3d898e731c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:53.080223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-610b050e-9e8e-4c69-9fd8-1e3d898e731c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:53.081376 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-610b050e-9e8e-4c69-9fd8-1e3d898e731c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158242 Sep 13 20:18:53.081946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 983/2050] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:53.779983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f857663f-7a5a-4445-93f4-c95d3c3f80cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:53.781014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f857663f-7a5a-4445-93f4-c95d3c3f80cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:53.790503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f857663f-7a5a-4445-93f4-c95d3c3f80cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:53.790984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f857663f-7a5a-4445-93f4-c95d3c3f80cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:53.791419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f857663f-7a5a-4445-93f4-c95d3c3f80cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:53.792105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f857663f-7a5a-4445-93f4-c95d3c3f80cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:53.792553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f857663f-7a5a-4445-93f4-c95d3c3f80cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:53.792969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f857663f-7a5a-4445-93f4-c95d3c3f80cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:53.934531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f857663f-7a5a-4445-93f4-c95d3c3f80cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:53.945559 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f857663f-7a5a-4445-93f4-c95d3c3f80cb tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.172159 Sep 13 20:18:53.946132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1068/2051] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:53 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:54.115709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-397bbd9b-5e18-4d8e-a31c-14b13c661dbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:54.116432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-397bbd9b-5e18-4d8e-a31c-14b13c661dbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:54.124979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-397bbd9b-5e18-4d8e-a31c-14b13c661dbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:54.125606 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-397bbd9b-5e18-4d8e-a31c-14b13c661dbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:54.126148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-397bbd9b-5e18-4d8e-a31c-14b13c661dbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:54.127380 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-397bbd9b-5e18-4d8e-a31c-14b13c661dbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:54.127962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-397bbd9b-5e18-4d8e-a31c-14b13c661dbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:54.128504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-397bbd9b-5e18-4d8e-a31c-14b13c661dbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:54.267266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-397bbd9b-5e18-4d8e-a31c-14b13c661dbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:54.276327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-397bbd9b-5e18-4d8e-a31c-14b13c661dbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:54.277759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-397bbd9b-5e18-4d8e-a31c-14b13c661dbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:54.278960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-397bbd9b-5e18-4d8e-a31c-14b13c661dbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168241 Sep 13 20:18:54.279543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 984/2052] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:54 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:54.973532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6e39b1e6-f0c5-48c9-a613-1fa8e8aae89c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:54.974654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6e39b1e6-f0c5-48c9-a613-1fa8e8aae89c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:54.985583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e39b1e6-f0c5-48c9-a613-1fa8e8aae89c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:54.986427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e39b1e6-f0c5-48c9-a613-1fa8e8aae89c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:54.987129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e39b1e6-f0c5-48c9-a613-1fa8e8aae89c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:54.988249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e39b1e6-f0c5-48c9-a613-1fa8e8aae89c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:54.988988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e39b1e6-f0c5-48c9-a613-1fa8e8aae89c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:54.989680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6e39b1e6-f0c5-48c9-a613-1fa8e8aae89c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:55.007267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:18:55.128744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6e39b1e6-f0c5-48c9-a613-1fa8e8aae89c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:55.141348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6e39b1e6-f0c5-48c9-a613-1fa8e8aae89c tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.173923 Sep 13 20:18:55.142387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1069/2053] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:54 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:55.308783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c312259c-fa89-438a-93da-d4b773eac10f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:55.309617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c312259c-fa89-438a-93da-d4b773eac10f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:55.320045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c312259c-fa89-438a-93da-d4b773eac10f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:55.320522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c312259c-fa89-438a-93da-d4b773eac10f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:55.320953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c312259c-fa89-438a-93da-d4b773eac10f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:55.321641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c312259c-fa89-438a-93da-d4b773eac10f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:55.322082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c312259c-fa89-438a-93da-d4b773eac10f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:55.322540 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c312259c-fa89-438a-93da-d4b773eac10f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:55.459492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c312259c-fa89-438a-93da-d4b773eac10f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:55.468413 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c312259c-fa89-438a-93da-d4b773eac10f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:55.469825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c312259c-fa89-438a-93da-d4b773eac10f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:55.471020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c312259c-fa89-438a-93da-d4b773eac10f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168964 Sep 13 20:18:55.471618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 985/2054] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:56.166148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3d261a3e-9c24-44d7-88d8-321f406baaf7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:56.167434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3d261a3e-9c24-44d7-88d8-321f406baaf7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:56.174252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d261a3e-9c24-44d7-88d8-321f406baaf7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:56.174773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d261a3e-9c24-44d7-88d8-321f406baaf7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:56.175201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d261a3e-9c24-44d7-88d8-321f406baaf7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:56.175892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d261a3e-9c24-44d7-88d8-321f406baaf7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:56.176331 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d261a3e-9c24-44d7-88d8-321f406baaf7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:56.176747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d261a3e-9c24-44d7-88d8-321f406baaf7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:56.318975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3d261a3e-9c24-44d7-88d8-321f406baaf7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:56.327262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3d261a3e-9c24-44d7-88d8-321f406baaf7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165779 Sep 13 20:18:56.327835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1070/2055] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:56 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:56.496155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-578bd2b2-7632-4b9c-b759-343f29e19aec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:56.496739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-578bd2b2-7632-4b9c-b759-343f29e19aec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:56.504019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-578bd2b2-7632-4b9c-b759-343f29e19aec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:56.504502 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-578bd2b2-7632-4b9c-b759-343f29e19aec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:56.504934 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-578bd2b2-7632-4b9c-b759-343f29e19aec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:56.505639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-578bd2b2-7632-4b9c-b759-343f29e19aec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:56.506087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-578bd2b2-7632-4b9c-b759-343f29e19aec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:56.506551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-578bd2b2-7632-4b9c-b759-343f29e19aec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:56.638572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-578bd2b2-7632-4b9c-b759-343f29e19aec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:56.647764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-578bd2b2-7632-4b9c-b759-343f29e19aec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:56.649184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-578bd2b2-7632-4b9c-b759-343f29e19aec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:56.650335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-578bd2b2-7632-4b9c-b759-343f29e19aec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158106 Sep 13 20:18:56.650916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 986/2056] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:57.355081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3eff5603-c984-4492-9625-d5ef94bf219f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:57.356153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3eff5603-c984-4492-9625-d5ef94bf219f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:57.366820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3eff5603-c984-4492-9625-d5ef94bf219f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:57.367300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3eff5603-c984-4492-9625-d5ef94bf219f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:57.367730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3eff5603-c984-4492-9625-d5ef94bf219f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:57.368415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3eff5603-c984-4492-9625-d5ef94bf219f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:57.368868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3eff5603-c984-4492-9625-d5ef94bf219f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:57.369380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3eff5603-c984-4492-9625-d5ef94bf219f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:57.676257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-faa2fd09-6f1d-4ab8-acd4-4c5733247c56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:57.676866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-faa2fd09-6f1d-4ab8-acd4-4c5733247c56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:57.683806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-faa2fd09-6f1d-4ab8-acd4-4c5733247c56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:57.684298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-faa2fd09-6f1d-4ab8-acd4-4c5733247c56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:57.684768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-faa2fd09-6f1d-4ab8-acd4-4c5733247c56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:57.685469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-faa2fd09-6f1d-4ab8-acd4-4c5733247c56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:57.685919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-faa2fd09-6f1d-4ab8-acd4-4c5733247c56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:57.686338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-faa2fd09-6f1d-4ab8-acd4-4c5733247c56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:57.699911 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3eff5603-c984-4492-9625-d5ef94bf219f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:57.708563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3eff5603-c984-4492-9625-d5ef94bf219f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.360145 Sep 13 20:18:57.709399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1071/2057] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:57 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:57.818056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-faa2fd09-6f1d-4ab8-acd4-4c5733247c56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:57.827583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-faa2fd09-6f1d-4ab8-acd4-4c5733247c56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:57.829017 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-faa2fd09-6f1d-4ab8-acd4-4c5733247c56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:57.830169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-faa2fd09-6f1d-4ab8-acd4-4c5733247c56 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.157940 Sep 13 20:18:57.830761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 987/2058] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:58.736395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dd7c788d-7b28-4039-95c8-19476e21942a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:58.737360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dd7c788d-7b28-4039-95c8-19476e21942a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:58.745547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd7c788d-7b28-4039-95c8-19476e21942a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:58.746023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd7c788d-7b28-4039-95c8-19476e21942a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:58.746485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd7c788d-7b28-4039-95c8-19476e21942a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:58.747179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd7c788d-7b28-4039-95c8-19476e21942a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:58.747625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd7c788d-7b28-4039-95c8-19476e21942a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:58.748042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd7c788d-7b28-4039-95c8-19476e21942a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:58.857100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9ffd6dd2-2d8e-4d5f-a799-7c67f8bb1a16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:58.857679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9ffd6dd2-2d8e-4d5f-a799-7c67f8bb1a16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:58.864730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ffd6dd2-2d8e-4d5f-a799-7c67f8bb1a16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:58.865221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ffd6dd2-2d8e-4d5f-a799-7c67f8bb1a16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:58.865649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ffd6dd2-2d8e-4d5f-a799-7c67f8bb1a16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:58.866344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ffd6dd2-2d8e-4d5f-a799-7c67f8bb1a16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:58.866798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ffd6dd2-2d8e-4d5f-a799-7c67f8bb1a16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:58.867399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ffd6dd2-2d8e-4d5f-a799-7c67f8bb1a16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:58.885869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dd7c788d-7b28-4039-95c8-19476e21942a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:58.894712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dd7c788d-7b28-4039-95c8-19476e21942a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164798 Sep 13 20:18:58.895312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1072/2059] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:58 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:18:58.999293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9ffd6dd2-2d8e-4d5f-a799-7c67f8bb1a16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:59.011651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9ffd6dd2-2d8e-4d5f-a799-7c67f8bb1a16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:59.013101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9ffd6dd2-2d8e-4d5f-a799-7c67f8bb1a16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:18:59.014249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9ffd6dd2-2d8e-4d5f-a799-7c67f8bb1a16 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161192 Sep 13 20:18:59.014860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 988/2060] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:18:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:18:59.922585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-69297b85-3034-4aac-8abd-00a6f3996727 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:18:59.923428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-69297b85-3034-4aac-8abd-00a6f3996727 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:18:59.934165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69297b85-3034-4aac-8abd-00a6f3996727 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:59.935026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69297b85-3034-4aac-8abd-00a6f3996727 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:59.935748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69297b85-3034-4aac-8abd-00a6f3996727 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:18:59.936881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69297b85-3034-4aac-8abd-00a6f3996727 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:18:59.937632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69297b85-3034-4aac-8abd-00a6f3996727 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:18:59.938341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69297b85-3034-4aac-8abd-00a6f3996727 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:00.039666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cee41e91-e5cc-4256-8b25-cc2488d6e53b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:00.040265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cee41e91-e5cc-4256-8b25-cc2488d6e53b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:00.046662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cee41e91-e5cc-4256-8b25-cc2488d6e53b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:00.047195 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cee41e91-e5cc-4256-8b25-cc2488d6e53b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:00.047636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cee41e91-e5cc-4256-8b25-cc2488d6e53b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:00.048311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cee41e91-e5cc-4256-8b25-cc2488d6e53b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:00.048757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cee41e91-e5cc-4256-8b25-cc2488d6e53b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:00.049173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cee41e91-e5cc-4256-8b25-cc2488d6e53b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:00.073409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-69297b85-3034-4aac-8abd-00a6f3996727 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:00.082009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-69297b85-3034-4aac-8abd-00a6f3996727 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166084 Sep 13 20:19:00.083092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1073/2061] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:18:59 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:00.190810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-cee41e91-e5cc-4256-8b25-cc2488d6e53b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:00.204616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-cee41e91-e5cc-4256-8b25-cc2488d6e53b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:00.207006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-cee41e91-e5cc-4256-8b25-cc2488d6e53b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:00.209058 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cee41e91-e5cc-4256-8b25-cc2488d6e53b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173328 Sep 13 20:19:00.209826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 989/2062] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:00 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:01.109196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-88232759-6e50-43fe-b934-17831fdb6162 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:01.110118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-88232759-6e50-43fe-b934-17831fdb6162 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:01.119583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88232759-6e50-43fe-b934-17831fdb6162 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:01.120057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88232759-6e50-43fe-b934-17831fdb6162 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:01.120489 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88232759-6e50-43fe-b934-17831fdb6162 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:01.121171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88232759-6e50-43fe-b934-17831fdb6162 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:01.121616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88232759-6e50-43fe-b934-17831fdb6162 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:01.122029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88232759-6e50-43fe-b934-17831fdb6162 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:01.235314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dfee743b-0c58-4d34-a490-aebebcfcb543 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:01.235875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dfee743b-0c58-4d34-a490-aebebcfcb543 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:01.242818 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dfee743b-0c58-4d34-a490-aebebcfcb543 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:01.243300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dfee743b-0c58-4d34-a490-aebebcfcb543 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:01.243731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dfee743b-0c58-4d34-a490-aebebcfcb543 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:01.244419 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dfee743b-0c58-4d34-a490-aebebcfcb543 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:01.244865 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dfee743b-0c58-4d34-a490-aebebcfcb543 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:01.245262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dfee743b-0c58-4d34-a490-aebebcfcb543 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:01.252726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-88232759-6e50-43fe-b934-17831fdb6162 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:01.261900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-88232759-6e50-43fe-b934-17831fdb6162 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.159143 Sep 13 20:19:01.262527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1074/2063] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:01 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:01.539496 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dfee743b-0c58-4d34-a490-aebebcfcb543 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:01.548468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dfee743b-0c58-4d34-a490-aebebcfcb543 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:01.549895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dfee743b-0c58-4d34-a490-aebebcfcb543 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:01.551094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dfee743b-0c58-4d34-a490-aebebcfcb543 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.320323 Sep 13 20:19:01.551653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 990/2064] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:02.289596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-af0d793f-7853-4d59-82d6-fc38207c3a11 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:02.290585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-af0d793f-7853-4d59-82d6-fc38207c3a11 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:02.301346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af0d793f-7853-4d59-82d6-fc38207c3a11 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:02.302142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af0d793f-7853-4d59-82d6-fc38207c3a11 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:02.302892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af0d793f-7853-4d59-82d6-fc38207c3a11 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:02.304004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af0d793f-7853-4d59-82d6-fc38207c3a11 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:02.304733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af0d793f-7853-4d59-82d6-fc38207c3a11 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:02.305421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af0d793f-7853-4d59-82d6-fc38207c3a11 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:02.444838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-af0d793f-7853-4d59-82d6-fc38207c3a11 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:02.453401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-af0d793f-7853-4d59-82d6-fc38207c3a11 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.170398 Sep 13 20:19:02.453970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1075/2065] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:02 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:02.577422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-743ee13c-3113-4d45-8148-74cc30517415 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:02.578170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-743ee13c-3113-4d45-8148-74cc30517415 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:02.586846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-743ee13c-3113-4d45-8148-74cc30517415 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:02.587324 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-743ee13c-3113-4d45-8148-74cc30517415 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:02.587755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-743ee13c-3113-4d45-8148-74cc30517415 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:02.588443 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-743ee13c-3113-4d45-8148-74cc30517415 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:02.588890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-743ee13c-3113-4d45-8148-74cc30517415 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:02.589312 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-743ee13c-3113-4d45-8148-74cc30517415 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:02.591863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:02.723451 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-743ee13c-3113-4d45-8148-74cc30517415 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:02.732538 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-743ee13c-3113-4d45-8148-74cc30517415 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:02.733955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-743ee13c-3113-4d45-8148-74cc30517415 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:02.735136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-743ee13c-3113-4d45-8148-74cc30517415 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162752 Sep 13 20:19:02.735689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 991/2066] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:03.479599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d6750500-2d12-4d5a-961a-b81a7525325f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:03.480196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d6750500-2d12-4d5a-961a-b81a7525325f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:03.487114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6750500-2d12-4d5a-961a-b81a7525325f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:03.487589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6750500-2d12-4d5a-961a-b81a7525325f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:03.488017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6750500-2d12-4d5a-961a-b81a7525325f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:03.488696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6750500-2d12-4d5a-961a-b81a7525325f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:03.489140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6750500-2d12-4d5a-961a-b81a7525325f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:03.489568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6750500-2d12-4d5a-961a-b81a7525325f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:03.634640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d6750500-2d12-4d5a-961a-b81a7525325f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:03.643038 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d6750500-2d12-4d5a-961a-b81a7525325f tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168606 Sep 13 20:19:03.643601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1076/2067] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:03 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:03.764691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9a31a36a-5584-41a9-be77-365dae736393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:03.765598 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9a31a36a-5584-41a9-be77-365dae736393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:03.769163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=52 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:03.777932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a31a36a-5584-41a9-be77-365dae736393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:03.778804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a31a36a-5584-41a9-be77-365dae736393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:03.779518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a31a36a-5584-41a9-be77-365dae736393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:03.780684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a31a36a-5584-41a9-be77-365dae736393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:03.781387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a31a36a-5584-41a9-be77-365dae736393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:03.782083 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a31a36a-5584-41a9-be77-365dae736393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:03.918809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9a31a36a-5584-41a9-be77-365dae736393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:03.927809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9a31a36a-5584-41a9-be77-365dae736393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:03.929242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9a31a36a-5584-41a9-be77-365dae736393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:03.930549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9a31a36a-5584-41a9-be77-365dae736393 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172709 Sep 13 20:19:03.931066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 992/2068] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:04.671102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-614e7c02-6794-44c0-a95d-698ee36eb60a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:04.672104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-614e7c02-6794-44c0-a95d-698ee36eb60a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:04.675782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:04.683867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-614e7c02-6794-44c0-a95d-698ee36eb60a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:04.684333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-614e7c02-6794-44c0-a95d-698ee36eb60a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:04.684760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-614e7c02-6794-44c0-a95d-698ee36eb60a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:04.685439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-614e7c02-6794-44c0-a95d-698ee36eb60a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:04.685880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-614e7c02-6794-44c0-a95d-698ee36eb60a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:04.686297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-614e7c02-6794-44c0-a95d-698ee36eb60a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:04.827433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-614e7c02-6794-44c0-a95d-698ee36eb60a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:04.839953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-614e7c02-6794-44c0-a95d-698ee36eb60a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.175484 Sep 13 20:19:04.840512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1077/2069] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:04 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:04.960141 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4cb5e300-ae45-48b2-84ba-1b6a45575f78 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:04.961059 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4cb5e300-ae45-48b2-84ba-1b6a45575f78 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:04.971895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cb5e300-ae45-48b2-84ba-1b6a45575f78 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:04.972716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cb5e300-ae45-48b2-84ba-1b6a45575f78 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:04.973429 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cb5e300-ae45-48b2-84ba-1b6a45575f78 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:04.974621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cb5e300-ae45-48b2-84ba-1b6a45575f78 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:04.975362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cb5e300-ae45-48b2-84ba-1b6a45575f78 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:04.976061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cb5e300-ae45-48b2-84ba-1b6a45575f78 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:05.110646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4cb5e300-ae45-48b2-84ba-1b6a45575f78 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:05.124676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4cb5e300-ae45-48b2-84ba-1b6a45575f78 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:05.126880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4cb5e300-ae45-48b2-84ba-1b6a45575f78 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:05.128625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4cb5e300-ae45-48b2-84ba-1b6a45575f78 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.175086 Sep 13 20:19:05.129374 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 993/2070] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:05.867426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-45889f89-3782-4108-a357-ab3c7eddefda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:05.868492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-45889f89-3782-4108-a357-ab3c7eddefda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:05.879509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45889f89-3782-4108-a357-ab3c7eddefda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.880300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45889f89-3782-4108-a357-ab3c7eddefda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.881012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45889f89-3782-4108-a357-ab3c7eddefda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:05.882136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45889f89-3782-4108-a357-ab3c7eddefda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.882924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45889f89-3782-4108-a357-ab3c7eddefda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.883624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45889f89-3782-4108-a357-ab3c7eddefda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:06.014700 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-45889f89-3782-4108-a357-ab3c7eddefda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:06.023463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-45889f89-3782-4108-a357-ab3c7eddefda tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.162559 Sep 13 20:19:06.024053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1078/2071] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:05 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:06.158661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c20c8119-0d12-43c2-8476-0da2b06b9ccf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:06.159538 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c20c8119-0d12-43c2-8476-0da2b06b9ccf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:06.170254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c20c8119-0d12-43c2-8476-0da2b06b9ccf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:06.171091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c20c8119-0d12-43c2-8476-0da2b06b9ccf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:06.171815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c20c8119-0d12-43c2-8476-0da2b06b9ccf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:06.173002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c20c8119-0d12-43c2-8476-0da2b06b9ccf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:06.173734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c20c8119-0d12-43c2-8476-0da2b06b9ccf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:06.174442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c20c8119-0d12-43c2-8476-0da2b06b9ccf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:06.309730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c20c8119-0d12-43c2-8476-0da2b06b9ccf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:06.318595 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c20c8119-0d12-43c2-8476-0da2b06b9ccf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:06.320022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c20c8119-0d12-43c2-8476-0da2b06b9ccf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:06.321176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c20c8119-0d12-43c2-8476-0da2b06b9ccf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169168 Sep 13 20:19:06.321726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 994/2072] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:06 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:07.050993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-933833e5-9b49-4ee3-ac0d-91283ed8e67d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:07.051942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-933833e5-9b49-4ee3-ac0d-91283ed8e67d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:07.061126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-933833e5-9b49-4ee3-ac0d-91283ed8e67d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:07.061598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-933833e5-9b49-4ee3-ac0d-91283ed8e67d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:07.062026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-933833e5-9b49-4ee3-ac0d-91283ed8e67d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:07.062746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-933833e5-9b49-4ee3-ac0d-91283ed8e67d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:07.063195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-933833e5-9b49-4ee3-ac0d-91283ed8e67d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:07.063612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-933833e5-9b49-4ee3-ac0d-91283ed8e67d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:07.191182 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-933833e5-9b49-4ee3-ac0d-91283ed8e67d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:07.202279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-933833e5-9b49-4ee3-ac0d-91283ed8e67d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.157910 Sep 13 20:19:07.202896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1079/2073] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:07 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:07.346765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ba8c8a28-2bf3-4055-95e3-23649690359a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:07.347366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ba8c8a28-2bf3-4055-95e3-23649690359a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:07.353831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba8c8a28-2bf3-4055-95e3-23649690359a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:07.354305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba8c8a28-2bf3-4055-95e3-23649690359a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:07.354874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba8c8a28-2bf3-4055-95e3-23649690359a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:07.355555 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba8c8a28-2bf3-4055-95e3-23649690359a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:07.356003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba8c8a28-2bf3-4055-95e3-23649690359a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:07.356417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ba8c8a28-2bf3-4055-95e3-23649690359a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:07.493232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ba8c8a28-2bf3-4055-95e3-23649690359a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:07.502431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ba8c8a28-2bf3-4055-95e3-23649690359a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:07.503898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ba8c8a28-2bf3-4055-95e3-23649690359a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:07.505012 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ba8c8a28-2bf3-4055-95e3-23649690359a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162299 Sep 13 20:19:07.505527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 995/2074] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:08.229975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2901fede-fe89-40c0-b669-eb96d2ef8c95 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:08.230786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2901fede-fe89-40c0-b669-eb96d2ef8c95 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:08.239934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2901fede-fe89-40c0-b669-eb96d2ef8c95 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:08.240567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2901fede-fe89-40c0-b669-eb96d2ef8c95 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:08.241173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2901fede-fe89-40c0-b669-eb96d2ef8c95 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:08.242071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2901fede-fe89-40c0-b669-eb96d2ef8c95 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:08.242711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2901fede-fe89-40c0-b669-eb96d2ef8c95 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:08.243267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2901fede-fe89-40c0-b669-eb96d2ef8c95 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:08.385783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2901fede-fe89-40c0-b669-eb96d2ef8c95 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:08.394099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2901fede-fe89-40c0-b669-eb96d2ef8c95 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.170643 Sep 13 20:19:08.394820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1080/2075] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:08 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:08.537239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c2e7b94e-c4b4-40c1-80a9-b560f045469c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:08.538298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c2e7b94e-c4b4-40c1-80a9-b560f045469c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:08.549263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2e7b94e-c4b4-40c1-80a9-b560f045469c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:08.550058 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2e7b94e-c4b4-40c1-80a9-b560f045469c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:08.550837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2e7b94e-c4b4-40c1-80a9-b560f045469c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:08.552036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2e7b94e-c4b4-40c1-80a9-b560f045469c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:08.552777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2e7b94e-c4b4-40c1-80a9-b560f045469c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:08.553522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2e7b94e-c4b4-40c1-80a9-b560f045469c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:08.692673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c2e7b94e-c4b4-40c1-80a9-b560f045469c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:08.703001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c2e7b94e-c4b4-40c1-80a9-b560f045469c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:08.704493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c2e7b94e-c4b4-40c1-80a9-b560f045469c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:08.705657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c2e7b94e-c4b4-40c1-80a9-b560f045469c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.175221 Sep 13 20:19:08.706247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 996/2076] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:09.417933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e04d5b53-61b5-4f96-a370-ae59f4f08e0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:09.418536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e04d5b53-61b5-4f96-a370-ae59f4f08e0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:09.426394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e04d5b53-61b5-4f96-a370-ae59f4f08e0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:09.426871 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e04d5b53-61b5-4f96-a370-ae59f4f08e0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:09.427296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e04d5b53-61b5-4f96-a370-ae59f4f08e0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:09.427980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e04d5b53-61b5-4f96-a370-ae59f4f08e0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:09.428423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e04d5b53-61b5-4f96-a370-ae59f4f08e0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:09.428831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e04d5b53-61b5-4f96-a370-ae59f4f08e0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:09.560314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e04d5b53-61b5-4f96-a370-ae59f4f08e0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:09.568797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e04d5b53-61b5-4f96-a370-ae59f4f08e0e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.155114 Sep 13 20:19:09.569360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1081/2077] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:09 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:09.735835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d213f533-0298-48a2-a275-4b6160752a13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:09.736893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d213f533-0298-48a2-a275-4b6160752a13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:09.747846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d213f533-0298-48a2-a275-4b6160752a13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:09.748626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d213f533-0298-48a2-a275-4b6160752a13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:09.749337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d213f533-0298-48a2-a275-4b6160752a13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:09.750520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d213f533-0298-48a2-a275-4b6160752a13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:09.751299 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d213f533-0298-48a2-a275-4b6160752a13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:09.751955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d213f533-0298-48a2-a275-4b6160752a13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:09.887527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d213f533-0298-48a2-a275-4b6160752a13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:09.900876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d213f533-0298-48a2-a275-4b6160752a13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:09.902625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d213f533-0298-48a2-a275-4b6160752a13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:09.903813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d213f533-0298-48a2-a275-4b6160752a13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.174761 Sep 13 20:19:09.904372 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 997/2078] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:10.592994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8810344e-0cb8-4ecf-b159-f1f45b2e03a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:10.593596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8810344e-0cb8-4ecf-b159-f1f45b2e03a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:10.600397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8810344e-0cb8-4ecf-b159-f1f45b2e03a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:10.600867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8810344e-0cb8-4ecf-b159-f1f45b2e03a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:10.601283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8810344e-0cb8-4ecf-b159-f1f45b2e03a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:10.601954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8810344e-0cb8-4ecf-b159-f1f45b2e03a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:10.602471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8810344e-0cb8-4ecf-b159-f1f45b2e03a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:10.602831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8810344e-0cb8-4ecf-b159-f1f45b2e03a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:10.734337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8810344e-0cb8-4ecf-b159-f1f45b2e03a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:10.742724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8810344e-0cb8-4ecf-b159-f1f45b2e03a8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.153942 Sep 13 20:19:10.743280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1082/2079] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:10 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:10.930657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-be4286f9-b627-4087-aa3e-f653c98c61ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:10.931360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-be4286f9-b627-4087-aa3e-f653c98c61ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:10.939431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be4286f9-b627-4087-aa3e-f653c98c61ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:10.940013 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be4286f9-b627-4087-aa3e-f653c98c61ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:10.940516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be4286f9-b627-4087-aa3e-f653c98c61ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:10.941660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be4286f9-b627-4087-aa3e-f653c98c61ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:10.942347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be4286f9-b627-4087-aa3e-f653c98c61ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:10.942899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be4286f9-b627-4087-aa3e-f653c98c61ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:11.087996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-be4286f9-b627-4087-aa3e-f653c98c61ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:11.096937 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-be4286f9-b627-4087-aa3e-f653c98c61ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:11.098398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-be4286f9-b627-4087-aa3e-f653c98c61ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:11.099571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-be4286f9-b627-4087-aa3e-f653c98c61ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173621 Sep 13 20:19:11.100126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 998/2080] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:11.927392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e7c678b4-8547-4e25-aeab-c76b866fa36e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:11.928006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e7c678b4-8547-4e25-aeab-c76b866fa36e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:11.934276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7c678b4-8547-4e25-aeab-c76b866fa36e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:11.934796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7c678b4-8547-4e25-aeab-c76b866fa36e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:11.935222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7c678b4-8547-4e25-aeab-c76b866fa36e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:11.935907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7c678b4-8547-4e25-aeab-c76b866fa36e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:11.936356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7c678b4-8547-4e25-aeab-c76b866fa36e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:11.936774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7c678b4-8547-4e25-aeab-c76b866fa36e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:11.980207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:19:11.980466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:19:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 (ip 10.222.0.52) !!! Sep 13 20:19:11.981552 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:19:11.981718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:19:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 (ip 10.222.0.52) !!! Sep 13 20:19:12.080881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e7c678b4-8547-4e25-aeab-c76b866fa36e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:12.090006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e7c678b4-8547-4e25-aeab-c76b866fa36e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.326685 Sep 13 20:19:12.090612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1083/2081] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:11 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:12.125970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d8a2d102-5ead-4f01-815e-93d4cd26720c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:12.126589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d8a2d102-5ead-4f01-815e-93d4cd26720c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:12.133250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8a2d102-5ead-4f01-815e-93d4cd26720c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:12.133769 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8a2d102-5ead-4f01-815e-93d4cd26720c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:12.134204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8a2d102-5ead-4f01-815e-93d4cd26720c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:12.134945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8a2d102-5ead-4f01-815e-93d4cd26720c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:12.135394 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8a2d102-5ead-4f01-815e-93d4cd26720c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:12.135813 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8a2d102-5ead-4f01-815e-93d4cd26720c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:12.518756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d8a2d102-5ead-4f01-815e-93d4cd26720c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:12.533032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d8a2d102-5ead-4f01-815e-93d4cd26720c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:12.535328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d8a2d102-5ead-4f01-815e-93d4cd26720c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:12.537153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d8a2d102-5ead-4f01-815e-93d4cd26720c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.414860 Sep 13 20:19:12.537936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 999/2082] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:13.117847 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fe8fe0e4-777a-4da1-9f6a-c362be590587 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:13.118823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fe8fe0e4-777a-4da1-9f6a-c362be590587 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:13.127172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe8fe0e4-777a-4da1-9f6a-c362be590587 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:13.127703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe8fe0e4-777a-4da1-9f6a-c362be590587 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:13.128171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe8fe0e4-777a-4da1-9f6a-c362be590587 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:13.128926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe8fe0e4-777a-4da1-9f6a-c362be590587 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:13.129423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe8fe0e4-777a-4da1-9f6a-c362be590587 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:13.129884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe8fe0e4-777a-4da1-9f6a-c362be590587 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:13.264590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fe8fe0e4-777a-4da1-9f6a-c362be590587 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:13.272839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fe8fe0e4-777a-4da1-9f6a-c362be590587 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161509 Sep 13 20:19:13.273408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1084/2083] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:13 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:13.564187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a9820562-6114-4228-8c19-e7b12cb172e6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:13.564798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a9820562-6114-4228-8c19-e7b12cb172e6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:13.573180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9820562-6114-4228-8c19-e7b12cb172e6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:13.573707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9820562-6114-4228-8c19-e7b12cb172e6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:13.574129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9820562-6114-4228-8c19-e7b12cb172e6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:13.574872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9820562-6114-4228-8c19-e7b12cb172e6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:13.575321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9820562-6114-4228-8c19-e7b12cb172e6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:13.575741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9820562-6114-4228-8c19-e7b12cb172e6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:13.710540 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a9820562-6114-4228-8c19-e7b12cb172e6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:13.723999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a9820562-6114-4228-8c19-e7b12cb172e6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:13.725554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a9820562-6114-4228-8c19-e7b12cb172e6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:13.726758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a9820562-6114-4228-8c19-e7b12cb172e6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166751 Sep 13 20:19:13.727322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1000/2084] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:14.300807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-294c06e7-f4f0-4b81-b7a0-0bf876e20d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:14.301818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-294c06e7-f4f0-4b81-b7a0-0bf876e20d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:14.310814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-294c06e7-f4f0-4b81-b7a0-0bf876e20d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:14.311292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-294c06e7-f4f0-4b81-b7a0-0bf876e20d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:14.311724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-294c06e7-f4f0-4b81-b7a0-0bf876e20d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:14.312403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-294c06e7-f4f0-4b81-b7a0-0bf876e20d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:14.312843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-294c06e7-f4f0-4b81-b7a0-0bf876e20d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:14.313257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-294c06e7-f4f0-4b81-b7a0-0bf876e20d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:14.455033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-294c06e7-f4f0-4b81-b7a0-0bf876e20d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:14.464032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-294c06e7-f4f0-4b81-b7a0-0bf876e20d96 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.170141 Sep 13 20:19:14.464715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1085/2085] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:14 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:14.751464 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5c827a0b-91c7-4be9-954b-0f94b39c55ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:14.752072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5c827a0b-91c7-4be9-954b-0f94b39c55ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:14.754691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:19:14.754871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:19:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 (ip 10.222.0.52) !!! Sep 13 20:19:14.761633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c827a0b-91c7-4be9-954b-0f94b39c55ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:14.762111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c827a0b-91c7-4be9-954b-0f94b39c55ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:14.762570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c827a0b-91c7-4be9-954b-0f94b39c55ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:14.763262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c827a0b-91c7-4be9-954b-0f94b39c55ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:14.763694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c827a0b-91c7-4be9-954b-0f94b39c55ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:14.764157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c827a0b-91c7-4be9-954b-0f94b39c55ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:14.897463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5c827a0b-91c7-4be9-954b-0f94b39c55ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:14.906619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5c827a0b-91c7-4be9-954b-0f94b39c55ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:14.908062 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5c827a0b-91c7-4be9-954b-0f94b39c55ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:14.909233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5c827a0b-91c7-4be9-954b-0f94b39c55ba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161748 Sep 13 20:19:14.909789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1001/2086] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:15.492050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-419f049c-68e9-4cdc-b46c-d2a3c57733e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:15.493019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-419f049c-68e9-4cdc-b46c-d2a3c57733e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:15.504062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-419f049c-68e9-4cdc-b46c-d2a3c57733e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:15.504848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-419f049c-68e9-4cdc-b46c-d2a3c57733e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:15.505564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-419f049c-68e9-4cdc-b46c-d2a3c57733e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:15.506739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-419f049c-68e9-4cdc-b46c-d2a3c57733e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:15.507481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-419f049c-68e9-4cdc-b46c-d2a3c57733e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:15.508208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-419f049c-68e9-4cdc-b46c-d2a3c57733e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:15.511999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:15.645680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-419f049c-68e9-4cdc-b46c-d2a3c57733e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:15.657654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-419f049c-68e9-4cdc-b46c-d2a3c57733e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.172000 Sep 13 20:19:15.658402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1086/2087] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:15 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:15.935888 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f10c67bb-da46-4875-b072-32f41762ead4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:15.936477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f10c67bb-da46-4875-b072-32f41762ead4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:15.943996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f10c67bb-da46-4875-b072-32f41762ead4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:15.944471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f10c67bb-da46-4875-b072-32f41762ead4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:15.944905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f10c67bb-da46-4875-b072-32f41762ead4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:15.945621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f10c67bb-da46-4875-b072-32f41762ead4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:15.946071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f10c67bb-da46-4875-b072-32f41762ead4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:15.946534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f10c67bb-da46-4875-b072-32f41762ead4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:16.080837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f10c67bb-da46-4875-b072-32f41762ead4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:16.090198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f10c67bb-da46-4875-b072-32f41762ead4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:16.091667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f10c67bb-da46-4875-b072-32f41762ead4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:16.092864 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f10c67bb-da46-4875-b072-32f41762ead4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162327 Sep 13 20:19:16.093411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1002/2088] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:16.683934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a35f1170-f526-4274-b550-c2296b1510f9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:16.684559 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a35f1170-f526-4274-b550-c2296b1510f9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:16.691576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a35f1170-f526-4274-b550-c2296b1510f9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:16.692065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a35f1170-f526-4274-b550-c2296b1510f9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:16.692469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a35f1170-f526-4274-b550-c2296b1510f9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:16.693163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a35f1170-f526-4274-b550-c2296b1510f9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:16.693622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a35f1170-f526-4274-b550-c2296b1510f9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:16.694045 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a35f1170-f526-4274-b550-c2296b1510f9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:16.832661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a35f1170-f526-4274-b550-c2296b1510f9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:16.841245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a35f1170-f526-4274-b550-c2296b1510f9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.161526 Sep 13 20:19:16.841829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1087/2089] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:16 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:17.122203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a3df41a9-2801-4174-8c1f-66c4533054b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:17.123182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a3df41a9-2801-4174-8c1f-66c4533054b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:17.134523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3df41a9-2801-4174-8c1f-66c4533054b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:17.135305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3df41a9-2801-4174-8c1f-66c4533054b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:17.136134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3df41a9-2801-4174-8c1f-66c4533054b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:17.136888 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3df41a9-2801-4174-8c1f-66c4533054b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:17.137335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3df41a9-2801-4174-8c1f-66c4533054b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:17.137753 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3df41a9-2801-4174-8c1f-66c4533054b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:17.281484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a3df41a9-2801-4174-8c1f-66c4533054b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:17.294929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a3df41a9-2801-4174-8c1f-66c4533054b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:17.297207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a3df41a9-2801-4174-8c1f-66c4533054b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:17.299018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a3df41a9-2801-4174-8c1f-66c4533054b1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.183108 Sep 13 20:19:17.299768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1003/2090] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:17 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:17.869109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-88fd690f-681e-49ea-86e1-664561541df8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:17.870015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-88fd690f-681e-49ea-86e1-664561541df8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:17.880866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88fd690f-681e-49ea-86e1-664561541df8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:17.881663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88fd690f-681e-49ea-86e1-664561541df8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:17.882437 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88fd690f-681e-49ea-86e1-664561541df8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:17.883575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88fd690f-681e-49ea-86e1-664561541df8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:17.884302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88fd690f-681e-49ea-86e1-664561541df8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:17.884999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-88fd690f-681e-49ea-86e1-664561541df8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:18.018317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-88fd690f-681e-49ea-86e1-664561541df8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:18.026674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-88fd690f-681e-49ea-86e1-664561541df8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164340 Sep 13 20:19:18.027278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1088/2091] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:17 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:18.328261 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d1b981f9-83b9-455d-9147-342c9a55756e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:18.328873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d1b981f9-83b9-455d-9147-342c9a55756e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:18.336110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1b981f9-83b9-455d-9147-342c9a55756e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:18.336596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1b981f9-83b9-455d-9147-342c9a55756e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:18.337004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1b981f9-83b9-455d-9147-342c9a55756e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:18.337699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1b981f9-83b9-455d-9147-342c9a55756e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:18.338436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1b981f9-83b9-455d-9147-342c9a55756e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:18.338862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1b981f9-83b9-455d-9147-342c9a55756e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:18.472002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1b981f9-83b9-455d-9147-342c9a55756e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:18.481123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1b981f9-83b9-455d-9147-342c9a55756e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:18.482608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1b981f9-83b9-455d-9147-342c9a55756e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:18.483782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d1b981f9-83b9-455d-9147-342c9a55756e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159576 Sep 13 20:19:18.484302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1004/2092] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:19.049640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8b831228-e3a4-4f2e-bcc4-a6e56027fd82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:19.050259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8b831228-e3a4-4f2e-bcc4-a6e56027fd82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:19.056928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b831228-e3a4-4f2e-bcc4-a6e56027fd82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:19.057410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b831228-e3a4-4f2e-bcc4-a6e56027fd82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:19.057835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b831228-e3a4-4f2e-bcc4-a6e56027fd82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:19.058556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b831228-e3a4-4f2e-bcc4-a6e56027fd82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:19.059001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b831228-e3a4-4f2e-bcc4-a6e56027fd82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:19.059420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8b831228-e3a4-4f2e-bcc4-a6e56027fd82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:19.188037 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8b831228-e3a4-4f2e-bcc4-a6e56027fd82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:19.196626 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8b831228-e3a4-4f2e-bcc4-a6e56027fd82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.151446 Sep 13 20:19:19.197200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1089/2093] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:19 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:19.513646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-70912228-8ffb-48b5-b91a-c5a7aec22f54 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:19.514548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-70912228-8ffb-48b5-b91a-c5a7aec22f54 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:19.525324 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70912228-8ffb-48b5-b91a-c5a7aec22f54 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:19.526107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70912228-8ffb-48b5-b91a-c5a7aec22f54 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:19.526881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70912228-8ffb-48b5-b91a-c5a7aec22f54 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:19.528005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70912228-8ffb-48b5-b91a-c5a7aec22f54 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:19.528688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70912228-8ffb-48b5-b91a-c5a7aec22f54 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:19.529106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70912228-8ffb-48b5-b91a-c5a7aec22f54 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:19.662837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-70912228-8ffb-48b5-b91a-c5a7aec22f54 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:19.676371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-70912228-8ffb-48b5-b91a-c5a7aec22f54 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:19.678673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-70912228-8ffb-48b5-b91a-c5a7aec22f54 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:19.680434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-70912228-8ffb-48b5-b91a-c5a7aec22f54 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173189 Sep 13 20:19:19.681160 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1005/2094] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:20.225527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-084bcb4a-e2b0-491d-8b72-d51d643edd9d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:20.226764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-084bcb4a-e2b0-491d-8b72-d51d643edd9d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:20.237730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-084bcb4a-e2b0-491d-8b72-d51d643edd9d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:20.238574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-084bcb4a-e2b0-491d-8b72-d51d643edd9d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:20.239336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-084bcb4a-e2b0-491d-8b72-d51d643edd9d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:20.240471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-084bcb4a-e2b0-491d-8b72-d51d643edd9d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:20.241221 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-084bcb4a-e2b0-491d-8b72-d51d643edd9d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:20.241918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-084bcb4a-e2b0-491d-8b72-d51d643edd9d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:20.378746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-084bcb4a-e2b0-491d-8b72-d51d643edd9d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:20.388988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-084bcb4a-e2b0-491d-8b72-d51d643edd9d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.170554 Sep 13 20:19:20.389592 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1090/2095] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:20 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:20.713893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-73fdaea9-d939-4eb8-8de6-65783cb10b29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:20.714959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-73fdaea9-d939-4eb8-8de6-65783cb10b29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:20.728008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73fdaea9-d939-4eb8-8de6-65783cb10b29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:20.728851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73fdaea9-d939-4eb8-8de6-65783cb10b29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:20.729574 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73fdaea9-d939-4eb8-8de6-65783cb10b29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:20.730779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73fdaea9-d939-4eb8-8de6-65783cb10b29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:20.731544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73fdaea9-d939-4eb8-8de6-65783cb10b29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:20.732278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-73fdaea9-d939-4eb8-8de6-65783cb10b29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:20.866092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-73fdaea9-d939-4eb8-8de6-65783cb10b29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:20.879601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-73fdaea9-d939-4eb8-8de6-65783cb10b29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:20.881877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-73fdaea9-d939-4eb8-8de6-65783cb10b29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:20.883651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-73fdaea9-d939-4eb8-8de6-65783cb10b29 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.176439 Sep 13 20:19:20.884364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1006/2096] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:21.421658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9c634bf5-1a6f-4569-acaf-87f587a1d66d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:21.422354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9c634bf5-1a6f-4569-acaf-87f587a1d66d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:21.429456 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c634bf5-1a6f-4569-acaf-87f587a1d66d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:21.429927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c634bf5-1a6f-4569-acaf-87f587a1d66d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:21.430352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c634bf5-1a6f-4569-acaf-87f587a1d66d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:21.431064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c634bf5-1a6f-4569-acaf-87f587a1d66d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:21.431505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c634bf5-1a6f-4569-acaf-87f587a1d66d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:21.431918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c634bf5-1a6f-4569-acaf-87f587a1d66d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:21.560476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9c634bf5-1a6f-4569-acaf-87f587a1d66d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:21.569266 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9c634bf5-1a6f-4569-acaf-87f587a1d66d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.153877 Sep 13 20:19:21.569838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1091/2097] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:21 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:21.913691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a949b73b-ad3a-45b1-a1b6-2dbfdb533ad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:21.914902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a949b73b-ad3a-45b1-a1b6-2dbfdb533ad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:21.926362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a949b73b-ad3a-45b1-a1b6-2dbfdb533ad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:21.927234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a949b73b-ad3a-45b1-a1b6-2dbfdb533ad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:21.927962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a949b73b-ad3a-45b1-a1b6-2dbfdb533ad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:21.929114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a949b73b-ad3a-45b1-a1b6-2dbfdb533ad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:21.929879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a949b73b-ad3a-45b1-a1b6-2dbfdb533ad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:21.930632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a949b73b-ad3a-45b1-a1b6-2dbfdb533ad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:22.062815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a949b73b-ad3a-45b1-a1b6-2dbfdb533ad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:22.065056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:22.073215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a949b73b-ad3a-45b1-a1b6-2dbfdb533ad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:22.074690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a949b73b-ad3a-45b1-a1b6-2dbfdb533ad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:22.075974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a949b73b-ad3a-45b1-a1b6-2dbfdb533ad9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168855 Sep 13 20:19:22.076533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1007/2098] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:22.594983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ba1d8022-4fbc-458b-822a-8226ca16abaf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:22.595594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ba1d8022-4fbc-458b-822a-8226ca16abaf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:22.602463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba1d8022-4fbc-458b-822a-8226ca16abaf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:22.602946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba1d8022-4fbc-458b-822a-8226ca16abaf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:22.603377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba1d8022-4fbc-458b-822a-8226ca16abaf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:22.604069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba1d8022-4fbc-458b-822a-8226ca16abaf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:22.604518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba1d8022-4fbc-458b-822a-8226ca16abaf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:22.604944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba1d8022-4fbc-458b-822a-8226ca16abaf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:22.746244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ba1d8022-4fbc-458b-822a-8226ca16abaf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:22.755061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ba1d8022-4fbc-458b-822a-8226ca16abaf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164576 Sep 13 20:19:22.755640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1092/2099] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:22 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:23.105411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-eec69c4d-f4cd-410f-8444-955dafa7e659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:23.106429 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-eec69c4d-f4cd-410f-8444-955dafa7e659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:23.113599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eec69c4d-f4cd-410f-8444-955dafa7e659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:23.114077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eec69c4d-f4cd-410f-8444-955dafa7e659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:23.114552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eec69c4d-f4cd-410f-8444-955dafa7e659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:23.115248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eec69c4d-f4cd-410f-8444-955dafa7e659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:23.115698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eec69c4d-f4cd-410f-8444-955dafa7e659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:23.116125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eec69c4d-f4cd-410f-8444-955dafa7e659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:23.247102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eec69c4d-f4cd-410f-8444-955dafa7e659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:23.260061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eec69c4d-f4cd-410f-8444-955dafa7e659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:23.261549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eec69c4d-f4cd-410f-8444-955dafa7e659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:23.263127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-eec69c4d-f4cd-410f-8444-955dafa7e659 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.164152 Sep 13 20:19:23.263968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1008/2100] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:23 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:23.782806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8c6611ab-bede-4670-be45-63a0a9f9af93 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:23.783794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8c6611ab-bede-4670-be45-63a0a9f9af93 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:23.795327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c6611ab-bede-4670-be45-63a0a9f9af93 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:23.795802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c6611ab-bede-4670-be45-63a0a9f9af93 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:23.796235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c6611ab-bede-4670-be45-63a0a9f9af93 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:23.796928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c6611ab-bede-4670-be45-63a0a9f9af93 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:23.797369 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c6611ab-bede-4670-be45-63a0a9f9af93 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:23.797795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c6611ab-bede-4670-be45-63a0a9f9af93 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:23.934137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8c6611ab-bede-4670-be45-63a0a9f9af93 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:23.942562 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8c6611ab-bede-4670-be45-63a0a9f9af93 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166373 Sep 13 20:19:23.943133 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1093/2101] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:23 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:24.296578 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-977793c0-d66d-495c-83af-797db79b7e7a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:24.297587 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-977793c0-d66d-495c-83af-797db79b7e7a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:24.308345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-977793c0-d66d-495c-83af-797db79b7e7a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:24.309126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-977793c0-d66d-495c-83af-797db79b7e7a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:24.309829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-977793c0-d66d-495c-83af-797db79b7e7a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:24.310737 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-977793c0-d66d-495c-83af-797db79b7e7a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:24.311164 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-977793c0-d66d-495c-83af-797db79b7e7a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:24.311598 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-977793c0-d66d-495c-83af-797db79b7e7a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:24.442757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-977793c0-d66d-495c-83af-797db79b7e7a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:24.451487 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-977793c0-d66d-495c-83af-797db79b7e7a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:24.452905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-977793c0-d66d-495c-83af-797db79b7e7a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:24.454048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-977793c0-d66d-495c-83af-797db79b7e7a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.164116 Sep 13 20:19:24.454658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1009/2102] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:24.974121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0d2e7bf2-62fa-444a-a652-f71b36cbce5d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:24.975222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0d2e7bf2-62fa-444a-a652-f71b36cbce5d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:24.986076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d2e7bf2-62fa-444a-a652-f71b36cbce5d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:24.986924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d2e7bf2-62fa-444a-a652-f71b36cbce5d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:24.987718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d2e7bf2-62fa-444a-a652-f71b36cbce5d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:24.988870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d2e7bf2-62fa-444a-a652-f71b36cbce5d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:24.989617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d2e7bf2-62fa-444a-a652-f71b36cbce5d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:24.990576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0d2e7bf2-62fa-444a-a652-f71b36cbce5d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:25.130755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0d2e7bf2-62fa-444a-a652-f71b36cbce5d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:25.139220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0d2e7bf2-62fa-444a-a652-f71b36cbce5d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.171866 Sep 13 20:19:25.139790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1094/2103] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:24 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:25.480029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5c6b06df-cf5b-446f-a18a-a2299bad9ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:25.480593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5c6b06df-cf5b-446f-a18a-a2299bad9ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:25.487594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c6b06df-cf5b-446f-a18a-a2299bad9ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:25.488067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c6b06df-cf5b-446f-a18a-a2299bad9ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:25.488493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c6b06df-cf5b-446f-a18a-a2299bad9ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:25.489179 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c6b06df-cf5b-446f-a18a-a2299bad9ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:25.489617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c6b06df-cf5b-446f-a18a-a2299bad9ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:25.490035 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c6b06df-cf5b-446f-a18a-a2299bad9ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:25.630904 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5c6b06df-cf5b-446f-a18a-a2299bad9ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:25.640082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5c6b06df-cf5b-446f-a18a-a2299bad9ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:25.641439 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5c6b06df-cf5b-446f-a18a-a2299bad9ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:25.642788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5c6b06df-cf5b-446f-a18a-a2299bad9ab3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166476 Sep 13 20:19:25.643347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1010/2104] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:26.165172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b7ae83cc-a6ac-468f-afe1-bb05ce265df7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:26.165793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b7ae83cc-a6ac-468f-afe1-bb05ce265df7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:26.174032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7ae83cc-a6ac-468f-afe1-bb05ce265df7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:26.174530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7ae83cc-a6ac-468f-afe1-bb05ce265df7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:26.174963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7ae83cc-a6ac-468f-afe1-bb05ce265df7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:26.175708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7ae83cc-a6ac-468f-afe1-bb05ce265df7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:26.176148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7ae83cc-a6ac-468f-afe1-bb05ce265df7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:26.176564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b7ae83cc-a6ac-468f-afe1-bb05ce265df7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:26.312438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b7ae83cc-a6ac-468f-afe1-bb05ce265df7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:26.325372 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b7ae83cc-a6ac-468f-afe1-bb05ce265df7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165660 Sep 13 20:19:26.326139 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1095/2105] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:26 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:26.668520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-090da975-78cf-46bd-8f91-5072032a74e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:26.669131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-090da975-78cf-46bd-8f91-5072032a74e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:26.675947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-090da975-78cf-46bd-8f91-5072032a74e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:26.676415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-090da975-78cf-46bd-8f91-5072032a74e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:26.677151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-090da975-78cf-46bd-8f91-5072032a74e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:26.677981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-090da975-78cf-46bd-8f91-5072032a74e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:26.678467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-090da975-78cf-46bd-8f91-5072032a74e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:26.678911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-090da975-78cf-46bd-8f91-5072032a74e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:26.810115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-090da975-78cf-46bd-8f91-5072032a74e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:26.819364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-090da975-78cf-46bd-8f91-5072032a74e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:26.820807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-090da975-78cf-46bd-8f91-5072032a74e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:26.821992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-090da975-78cf-46bd-8f91-5072032a74e8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.157540 Sep 13 20:19:26.822594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1011/2106] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:27.353860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-85ee9a77-e27b-4c81-bcd1-79a06b923ab9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:27.354837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-85ee9a77-e27b-4c81-bcd1-79a06b923ab9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:27.365640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85ee9a77-e27b-4c81-bcd1-79a06b923ab9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:27.366457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85ee9a77-e27b-4c81-bcd1-79a06b923ab9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:27.367199 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85ee9a77-e27b-4c81-bcd1-79a06b923ab9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:27.368331 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85ee9a77-e27b-4c81-bcd1-79a06b923ab9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:27.369084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85ee9a77-e27b-4c81-bcd1-79a06b923ab9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:27.369778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-85ee9a77-e27b-4c81-bcd1-79a06b923ab9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:27.509065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-85ee9a77-e27b-4c81-bcd1-79a06b923ab9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:27.520512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-85ee9a77-e27b-4c81-bcd1-79a06b923ab9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.173080 Sep 13 20:19:27.521083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1096/2107] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:27 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:27.857983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b5140948-4520-409d-bace-cadaeba02356 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:27.858651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b5140948-4520-409d-bace-cadaeba02356 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:27.866905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b5140948-4520-409d-bace-cadaeba02356 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:27.867377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b5140948-4520-409d-bace-cadaeba02356 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:27.867800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b5140948-4520-409d-bace-cadaeba02356 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:27.868842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b5140948-4520-409d-bace-cadaeba02356 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:27.869510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b5140948-4520-409d-bace-cadaeba02356 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:27.870244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b5140948-4520-409d-bace-cadaeba02356 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:28.001595 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b5140948-4520-409d-bace-cadaeba02356 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:28.011652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b5140948-4520-409d-bace-cadaeba02356 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:28.013149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b5140948-4520-409d-bace-cadaeba02356 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:28.014316 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b5140948-4520-409d-bace-cadaeba02356 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.160750 Sep 13 20:19:28.014994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1012/2108] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:27 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:28.548919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-55220905-0b3e-461c-8b31-a6fc815d9626 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:28.549849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-55220905-0b3e-461c-8b31-a6fc815d9626 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:28.560793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55220905-0b3e-461c-8b31-a6fc815d9626 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:28.561791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55220905-0b3e-461c-8b31-a6fc815d9626 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:28.562215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55220905-0b3e-461c-8b31-a6fc815d9626 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:28.562942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55220905-0b3e-461c-8b31-a6fc815d9626 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:28.563387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55220905-0b3e-461c-8b31-a6fc815d9626 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:28.563811 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55220905-0b3e-461c-8b31-a6fc815d9626 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:28.697274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-55220905-0b3e-461c-8b31-a6fc815d9626 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:28.705841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-55220905-0b3e-461c-8b31-a6fc815d9626 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.163664 Sep 13 20:19:28.706525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1097/2109] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:28 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:29.043864 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6227d6d7-5d19-4e87-9fc8-7ae8743bb524 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:29.044779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6227d6d7-5d19-4e87-9fc8-7ae8743bb524 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:29.052833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6227d6d7-5d19-4e87-9fc8-7ae8743bb524 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:29.053349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6227d6d7-5d19-4e87-9fc8-7ae8743bb524 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:29.053883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6227d6d7-5d19-4e87-9fc8-7ae8743bb524 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:29.054683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6227d6d7-5d19-4e87-9fc8-7ae8743bb524 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:29.055178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6227d6d7-5d19-4e87-9fc8-7ae8743bb524 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:29.055654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6227d6d7-5d19-4e87-9fc8-7ae8743bb524 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:29.192898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6227d6d7-5d19-4e87-9fc8-7ae8743bb524 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:29.202134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6227d6d7-5d19-4e87-9fc8-7ae8743bb524 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:29.203619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6227d6d7-5d19-4e87-9fc8-7ae8743bb524 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:29.204785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6227d6d7-5d19-4e87-9fc8-7ae8743bb524 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167604 Sep 13 20:19:29.205359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1013/2110] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:29 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:29.729669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6826b3b2-75e3-451e-a310-252cf7f1d33d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:29.730293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6826b3b2-75e3-451e-a310-252cf7f1d33d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:29.737185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6826b3b2-75e3-451e-a310-252cf7f1d33d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:29.737643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6826b3b2-75e3-451e-a310-252cf7f1d33d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:29.738082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6826b3b2-75e3-451e-a310-252cf7f1d33d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:29.738796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6826b3b2-75e3-451e-a310-252cf7f1d33d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:29.739220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6826b3b2-75e3-451e-a310-252cf7f1d33d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:29.739629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6826b3b2-75e3-451e-a310-252cf7f1d33d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:29.867441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6826b3b2-75e3-451e-a310-252cf7f1d33d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:29.876858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6826b3b2-75e3-451e-a310-252cf7f1d33d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.151154 Sep 13 20:19:29.877424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1098/2111] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:29 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:30.239761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7a2f4cd6-9b38-4b2b-ae9f-070775a8e930 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:30.240704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7a2f4cd6-9b38-4b2b-ae9f-070775a8e930 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:30.250298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a2f4cd6-9b38-4b2b-ae9f-070775a8e930 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:30.250802 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a2f4cd6-9b38-4b2b-ae9f-070775a8e930 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:30.251236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a2f4cd6-9b38-4b2b-ae9f-070775a8e930 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:30.251926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a2f4cd6-9b38-4b2b-ae9f-070775a8e930 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:30.252368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a2f4cd6-9b38-4b2b-ae9f-070775a8e930 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:30.252781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a2f4cd6-9b38-4b2b-ae9f-070775a8e930 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:30.380319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7a2f4cd6-9b38-4b2b-ae9f-070775a8e930 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:30.389504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7a2f4cd6-9b38-4b2b-ae9f-070775a8e930 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:30.391063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7a2f4cd6-9b38-4b2b-ae9f-070775a8e930 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:30.392208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7a2f4cd6-9b38-4b2b-ae9f-070775a8e930 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159394 Sep 13 20:19:30.392758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1014/2112] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:30 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:30.900528 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-091f8035-478e-4ba1-bc13-dc13558ecb18 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:30.901127 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-091f8035-478e-4ba1-bc13-dc13558ecb18 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:30.907995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-091f8035-478e-4ba1-bc13-dc13558ecb18 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:30.908474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-091f8035-478e-4ba1-bc13-dc13558ecb18 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:30.908900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-091f8035-478e-4ba1-bc13-dc13558ecb18 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:30.909962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-091f8035-478e-4ba1-bc13-dc13558ecb18 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:30.910422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-091f8035-478e-4ba1-bc13-dc13558ecb18 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:30.910866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-091f8035-478e-4ba1-bc13-dc13558ecb18 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:31.045284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-091f8035-478e-4ba1-bc13-dc13558ecb18 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:31.053672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-091f8035-478e-4ba1-bc13-dc13558ecb18 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.157143 Sep 13 20:19:31.054242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1099/2113] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:30 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:31.421818 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-323b7fda-60e2-48bd-9f41-87b63ca59ba5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:31.422551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-323b7fda-60e2-48bd-9f41-87b63ca59ba5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:31.429959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-323b7fda-60e2-48bd-9f41-87b63ca59ba5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:31.430469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-323b7fda-60e2-48bd-9f41-87b63ca59ba5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:31.430906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-323b7fda-60e2-48bd-9f41-87b63ca59ba5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:31.431596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-323b7fda-60e2-48bd-9f41-87b63ca59ba5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:31.432047 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-323b7fda-60e2-48bd-9f41-87b63ca59ba5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:31.432470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-323b7fda-60e2-48bd-9f41-87b63ca59ba5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:31.571004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-323b7fda-60e2-48bd-9f41-87b63ca59ba5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:31.579791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-323b7fda-60e2-48bd-9f41-87b63ca59ba5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:31.581277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-323b7fda-60e2-48bd-9f41-87b63ca59ba5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:31.582856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-323b7fda-60e2-48bd-9f41-87b63ca59ba5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167733 Sep 13 20:19:31.583780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1015/2114] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:32.080855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c1518f37-49ed-46b3-a13d-f66c5214761b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:32.081593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c1518f37-49ed-46b3-a13d-f66c5214761b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:32.090727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1518f37-49ed-46b3-a13d-f66c5214761b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:32.091368 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1518f37-49ed-46b3-a13d-f66c5214761b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:32.091942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1518f37-49ed-46b3-a13d-f66c5214761b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:32.092851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1518f37-49ed-46b3-a13d-f66c5214761b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:32.093449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1518f37-49ed-46b3-a13d-f66c5214761b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:32.094012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c1518f37-49ed-46b3-a13d-f66c5214761b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:32.232703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c1518f37-49ed-46b3-a13d-f66c5214761b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:32.242551 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c1518f37-49ed-46b3-a13d-f66c5214761b tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167758 Sep 13 20:19:32.243129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1100/2115] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:32 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:32.610501 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-84672ae4-d455-486e-975d-73cc43312a41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:32.611093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-84672ae4-d455-486e-975d-73cc43312a41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:32.618286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84672ae4-d455-486e-975d-73cc43312a41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:32.618951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84672ae4-d455-486e-975d-73cc43312a41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:32.619386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84672ae4-d455-486e-975d-73cc43312a41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:32.620086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84672ae4-d455-486e-975d-73cc43312a41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:32.620533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84672ae4-d455-486e-975d-73cc43312a41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:32.620954 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84672ae4-d455-486e-975d-73cc43312a41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:32.772939 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-84672ae4-d455-486e-975d-73cc43312a41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:32.786734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-84672ae4-d455-486e-975d-73cc43312a41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:32.788796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-84672ae4-d455-486e-975d-73cc43312a41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:32.790669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-84672ae4-d455-486e-975d-73cc43312a41 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.185399 Sep 13 20:19:32.791411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1016/2116] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:33.273783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7038461a-f874-4148-bca3-28ff4c815ac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:33.274785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7038461a-f874-4148-bca3-28ff4c815ac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:33.283751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7038461a-f874-4148-bca3-28ff4c815ac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:33.284225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7038461a-f874-4148-bca3-28ff4c815ac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:33.284645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7038461a-f874-4148-bca3-28ff4c815ac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:33.285319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7038461a-f874-4148-bca3-28ff4c815ac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:33.285757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7038461a-f874-4148-bca3-28ff4c815ac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:33.286171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7038461a-f874-4148-bca3-28ff4c815ac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:33.428369 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7038461a-f874-4148-bca3-28ff4c815ac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:33.437017 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7038461a-f874-4148-bca3-28ff4c815ac1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169927 Sep 13 20:19:33.437589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1101/2117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:33 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:33.822026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-87265e6f-88fc-4bf7-b5c2-39a52a5e4130 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:33.822997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-87265e6f-88fc-4bf7-b5c2-39a52a5e4130 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:33.826530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=50 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:33.836735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87265e6f-88fc-4bf7-b5c2-39a52a5e4130 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:33.837507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87265e6f-88fc-4bf7-b5c2-39a52a5e4130 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:33.838215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87265e6f-88fc-4bf7-b5c2-39a52a5e4130 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:33.839385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87265e6f-88fc-4bf7-b5c2-39a52a5e4130 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:33.840109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87265e6f-88fc-4bf7-b5c2-39a52a5e4130 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:33.840788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87265e6f-88fc-4bf7-b5c2-39a52a5e4130 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:33.976484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-87265e6f-88fc-4bf7-b5c2-39a52a5e4130 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:33.985306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-87265e6f-88fc-4bf7-b5c2-39a52a5e4130 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:33.986758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-87265e6f-88fc-4bf7-b5c2-39a52a5e4130 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:33.987956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-87265e6f-88fc-4bf7-b5c2-39a52a5e4130 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172577 Sep 13 20:19:33.988523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1017/2118] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:34.465472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a2cdc73d-5a86-4c81-a22d-3260eea172cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:34.466452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a2cdc73d-5a86-4c81-a22d-3260eea172cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:34.474283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2cdc73d-5a86-4c81-a22d-3260eea172cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:34.474869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2cdc73d-5a86-4c81-a22d-3260eea172cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:34.475305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2cdc73d-5a86-4c81-a22d-3260eea172cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:34.475991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2cdc73d-5a86-4c81-a22d-3260eea172cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:34.476440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2cdc73d-5a86-4c81-a22d-3260eea172cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:34.476863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2cdc73d-5a86-4c81-a22d-3260eea172cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:34.613875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a2cdc73d-5a86-4c81-a22d-3260eea172cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:34.616176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:34.623868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a2cdc73d-5a86-4c81-a22d-3260eea172cc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165054 Sep 13 20:19:34.624498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1102/2119] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:34 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:35.013487 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b9ea5a4b-3f5a-415f-8c59-0015c12e7b7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:35.014090 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b9ea5a4b-3f5a-415f-8c59-0015c12e7b7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:35.020792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9ea5a4b-3f5a-415f-8c59-0015c12e7b7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:35.021307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9ea5a4b-3f5a-415f-8c59-0015c12e7b7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:35.021763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9ea5a4b-3f5a-415f-8c59-0015c12e7b7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:35.022444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9ea5a4b-3f5a-415f-8c59-0015c12e7b7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:35.022904 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9ea5a4b-3f5a-415f-8c59-0015c12e7b7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:35.023324 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b9ea5a4b-3f5a-415f-8c59-0015c12e7b7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:35.152881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b9ea5a4b-3f5a-415f-8c59-0015c12e7b7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:35.162017 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b9ea5a4b-3f5a-415f-8c59-0015c12e7b7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:35.163492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b9ea5a4b-3f5a-415f-8c59-0015c12e7b7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:35.164659 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b9ea5a4b-3f5a-415f-8c59-0015c12e7b7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.155382 Sep 13 20:19:35.165220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1018/2120] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:35 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:35.649401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-67fa2fa3-fa46-4a9d-bedd-ae9b874349d4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:35.650200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-67fa2fa3-fa46-4a9d-bedd-ae9b874349d4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:35.653356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:35.660930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67fa2fa3-fa46-4a9d-bedd-ae9b874349d4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:35.661562 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67fa2fa3-fa46-4a9d-bedd-ae9b874349d4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:35.662138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67fa2fa3-fa46-4a9d-bedd-ae9b874349d4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:35.663066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67fa2fa3-fa46-4a9d-bedd-ae9b874349d4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:35.663652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67fa2fa3-fa46-4a9d-bedd-ae9b874349d4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:35.664211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-67fa2fa3-fa46-4a9d-bedd-ae9b874349d4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:35.797413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-67fa2fa3-fa46-4a9d-bedd-ae9b874349d4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:35.810137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-67fa2fa3-fa46-4a9d-bedd-ae9b874349d4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165646 Sep 13 20:19:35.810948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1103/2121] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:35 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:36.191086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-49a8508f-92f5-45d7-b027-86968dc75f17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:36.191696 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-49a8508f-92f5-45d7-b027-86968dc75f17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:36.198673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49a8508f-92f5-45d7-b027-86968dc75f17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:36.199157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49a8508f-92f5-45d7-b027-86968dc75f17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:36.199623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49a8508f-92f5-45d7-b027-86968dc75f17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:36.200313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49a8508f-92f5-45d7-b027-86968dc75f17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:36.200763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49a8508f-92f5-45d7-b027-86968dc75f17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:36.201183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-49a8508f-92f5-45d7-b027-86968dc75f17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:36.335239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-49a8508f-92f5-45d7-b027-86968dc75f17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:36.347420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-49a8508f-92f5-45d7-b027-86968dc75f17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:36.348863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-49a8508f-92f5-45d7-b027-86968dc75f17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:36.350104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-49a8508f-92f5-45d7-b027-86968dc75f17 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.163563 Sep 13 20:19:36.351032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1019/2122] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:36.838693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-635ea1cc-b67a-463e-87b8-39ae8d019671 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:36.839754 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-635ea1cc-b67a-463e-87b8-39ae8d019671 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:36.848503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-635ea1cc-b67a-463e-87b8-39ae8d019671 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:36.848983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-635ea1cc-b67a-463e-87b8-39ae8d019671 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:36.849415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-635ea1cc-b67a-463e-87b8-39ae8d019671 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:36.850101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-635ea1cc-b67a-463e-87b8-39ae8d019671 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:36.850597 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-635ea1cc-b67a-463e-87b8-39ae8d019671 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:36.851021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-635ea1cc-b67a-463e-87b8-39ae8d019671 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:36.991296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-635ea1cc-b67a-463e-87b8-39ae8d019671 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:37.000144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-635ea1cc-b67a-463e-87b8-39ae8d019671 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.168325 Sep 13 20:19:37.000737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1104/2123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:36 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:37.379919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8e9d6fcd-9888-4073-a438-7b6f3a7f8cbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:37.380524 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8e9d6fcd-9888-4073-a438-7b6f3a7f8cbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:37.387506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e9d6fcd-9888-4073-a438-7b6f3a7f8cbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:37.387995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e9d6fcd-9888-4073-a438-7b6f3a7f8cbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:37.388431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e9d6fcd-9888-4073-a438-7b6f3a7f8cbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:37.389134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e9d6fcd-9888-4073-a438-7b6f3a7f8cbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:37.389581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e9d6fcd-9888-4073-a438-7b6f3a7f8cbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:37.390005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e9d6fcd-9888-4073-a438-7b6f3a7f8cbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:37.651667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8e9d6fcd-9888-4073-a438-7b6f3a7f8cbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:37.661164 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8e9d6fcd-9888-4073-a438-7b6f3a7f8cbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:37.662722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8e9d6fcd-9888-4073-a438-7b6f3a7f8cbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:37.663998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8e9d6fcd-9888-4073-a438-7b6f3a7f8cbf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.288206 Sep 13 20:19:37.664644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1020/2124] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:38.027715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a1d1ca59-4c3e-4fbc-a107-21c98da30929 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:38.028735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a1d1ca59-4c3e-4fbc-a107-21c98da30929 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:38.039824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1d1ca59-4c3e-4fbc-a107-21c98da30929 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:38.040615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1d1ca59-4c3e-4fbc-a107-21c98da30929 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:38.041333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1d1ca59-4c3e-4fbc-a107-21c98da30929 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:38.042489 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1d1ca59-4c3e-4fbc-a107-21c98da30929 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:38.043308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1d1ca59-4c3e-4fbc-a107-21c98da30929 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:38.044010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1d1ca59-4c3e-4fbc-a107-21c98da30929 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:38.178952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a1d1ca59-4c3e-4fbc-a107-21c98da30929 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:38.187468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a1d1ca59-4c3e-4fbc-a107-21c98da30929 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166287 Sep 13 20:19:38.188014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1105/2125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:38 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:38.693780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-949d293f-b283-4969-a691-237bbf7f5bd3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:38.694863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-949d293f-b283-4969-a691-237bbf7f5bd3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:38.705139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-949d293f-b283-4969-a691-237bbf7f5bd3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:38.705622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-949d293f-b283-4969-a691-237bbf7f5bd3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:38.706062 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-949d293f-b283-4969-a691-237bbf7f5bd3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:38.707157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-949d293f-b283-4969-a691-237bbf7f5bd3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:38.707642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-949d293f-b283-4969-a691-237bbf7f5bd3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:38.708064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-949d293f-b283-4969-a691-237bbf7f5bd3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:38.843567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-949d293f-b283-4969-a691-237bbf7f5bd3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:38.852705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-949d293f-b283-4969-a691-237bbf7f5bd3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:38.854131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-949d293f-b283-4969-a691-237bbf7f5bd3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:38.855327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-949d293f-b283-4969-a691-237bbf7f5bd3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168260 Sep 13 20:19:38.855885 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1021/2126] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:39.215398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d7d047c3-6b6b-41c1-a996-7e56503e3421 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:39.216474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d7d047c3-6b6b-41c1-a996-7e56503e3421 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:39.224952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7d047c3-6b6b-41c1-a996-7e56503e3421 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:39.225437 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7d047c3-6b6b-41c1-a996-7e56503e3421 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:39.225868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7d047c3-6b6b-41c1-a996-7e56503e3421 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:39.226590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7d047c3-6b6b-41c1-a996-7e56503e3421 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:39.227024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7d047c3-6b6b-41c1-a996-7e56503e3421 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:39.227442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7d047c3-6b6b-41c1-a996-7e56503e3421 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:39.365423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d7d047c3-6b6b-41c1-a996-7e56503e3421 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:39.373742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d7d047c3-6b6b-41c1-a996-7e56503e3421 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165061 Sep 13 20:19:39.374290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1106/2127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:39 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:39.883021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a6cfdf52-af19-4374-becc-aa2b4e22e1a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:39.883726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a6cfdf52-af19-4374-becc-aa2b4e22e1a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:39.892107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6cfdf52-af19-4374-becc-aa2b4e22e1a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:39.892702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6cfdf52-af19-4374-becc-aa2b4e22e1a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:39.893242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6cfdf52-af19-4374-becc-aa2b4e22e1a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:39.894095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6cfdf52-af19-4374-becc-aa2b4e22e1a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:39.894702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6cfdf52-af19-4374-becc-aa2b4e22e1a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:39.895225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6cfdf52-af19-4374-becc-aa2b4e22e1a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:40.029787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a6cfdf52-af19-4374-becc-aa2b4e22e1a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:40.038972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a6cfdf52-af19-4374-becc-aa2b4e22e1a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:40.040406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a6cfdf52-af19-4374-becc-aa2b4e22e1a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:40.041575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a6cfdf52-af19-4374-becc-aa2b4e22e1a0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.163673 Sep 13 20:19:40.042138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1022/2128] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:40.397358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1e76d78f-925f-4cc5-84a9-880b2038c1f8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:40.397975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1e76d78f-925f-4cc5-84a9-880b2038c1f8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:40.404655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e76d78f-925f-4cc5-84a9-880b2038c1f8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:40.405128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e76d78f-925f-4cc5-84a9-880b2038c1f8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:40.405555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e76d78f-925f-4cc5-84a9-880b2038c1f8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:40.406240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e76d78f-925f-4cc5-84a9-880b2038c1f8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:40.406714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e76d78f-925f-4cc5-84a9-880b2038c1f8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:40.407202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1e76d78f-925f-4cc5-84a9-880b2038c1f8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:40.539071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1e76d78f-925f-4cc5-84a9-880b2038c1f8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:40.549212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1e76d78f-925f-4cc5-84a9-880b2038c1f8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.155377 Sep 13 20:19:40.550020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1107/2129] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:40 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:41.072027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-90608c97-8996-4c43-880c-43c09101077a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:41.073004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-90608c97-8996-4c43-880c-43c09101077a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:41.082761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90608c97-8996-4c43-880c-43c09101077a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:41.083173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90608c97-8996-4c43-880c-43c09101077a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:41.083597 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90608c97-8996-4c43-880c-43c09101077a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:41.084294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90608c97-8996-4c43-880c-43c09101077a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:41.084750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90608c97-8996-4c43-880c-43c09101077a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:41.085152 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-90608c97-8996-4c43-880c-43c09101077a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:41.215118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-90608c97-8996-4c43-880c-43c09101077a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:41.224108 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-90608c97-8996-4c43-880c-43c09101077a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:41.225546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-90608c97-8996-4c43-880c-43c09101077a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:41.226851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-90608c97-8996-4c43-880c-43c09101077a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161437 Sep 13 20:19:41.227425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1023/2130] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:41 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:41.579501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5a1dfd39-7b65-4cf2-9930-91032e250b3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:41.580273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5a1dfd39-7b65-4cf2-9930-91032e250b3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:41.587714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a1dfd39-7b65-4cf2-9930-91032e250b3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:41.588194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a1dfd39-7b65-4cf2-9930-91032e250b3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:41.588618 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a1dfd39-7b65-4cf2-9930-91032e250b3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:41.589307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a1dfd39-7b65-4cf2-9930-91032e250b3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:41.589757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a1dfd39-7b65-4cf2-9930-91032e250b3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:41.590316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a1dfd39-7b65-4cf2-9930-91032e250b3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:41.721684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5a1dfd39-7b65-4cf2-9930-91032e250b3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:41.733704 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5a1dfd39-7b65-4cf2-9930-91032e250b3e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.160005 Sep 13 20:19:41.734482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1108/2131] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:41 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:42.256882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-48e949b7-6829-4a3b-85f0-751105ba218a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:42.257872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-48e949b7-6829-4a3b-85f0-751105ba218a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:42.268309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48e949b7-6829-4a3b-85f0-751105ba218a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:42.268815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48e949b7-6829-4a3b-85f0-751105ba218a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:42.269249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48e949b7-6829-4a3b-85f0-751105ba218a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:42.269935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48e949b7-6829-4a3b-85f0-751105ba218a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:42.270405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48e949b7-6829-4a3b-85f0-751105ba218a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:42.270834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48e949b7-6829-4a3b-85f0-751105ba218a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:42.285386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:42.406799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-48e949b7-6829-4a3b-85f0-751105ba218a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:42.420007 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-48e949b7-6829-4a3b-85f0-751105ba218a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:42.422270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-48e949b7-6829-4a3b-85f0-751105ba218a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:42.424016 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-48e949b7-6829-4a3b-85f0-751105ba218a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.174020 Sep 13 20:19:42.424580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1024/2132] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:42.762818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e7b4c65b-41c8-442d-90c7-c1e7d680ab48 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:42.763656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e7b4c65b-41c8-442d-90c7-c1e7d680ab48 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:42.775385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7b4c65b-41c8-442d-90c7-c1e7d680ab48 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:42.776191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7b4c65b-41c8-442d-90c7-c1e7d680ab48 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:42.776916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7b4c65b-41c8-442d-90c7-c1e7d680ab48 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:42.778033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7b4c65b-41c8-442d-90c7-c1e7d680ab48 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:42.778830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7b4c65b-41c8-442d-90c7-c1e7d680ab48 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:42.779529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e7b4c65b-41c8-442d-90c7-c1e7d680ab48 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:42.926148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e7b4c65b-41c8-442d-90c7-c1e7d680ab48 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:42.934622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e7b4c65b-41c8-442d-90c7-c1e7d680ab48 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.179011 Sep 13 20:19:42.935257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1109/2133] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:42 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:43.451491 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c5d93b4a-c73f-482a-bce4-bb83fed3d8d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:43.452341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c5d93b4a-c73f-482a-bce4-bb83fed3d8d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:43.459631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5d93b4a-c73f-482a-bce4-bb83fed3d8d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:43.460116 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5d93b4a-c73f-482a-bce4-bb83fed3d8d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:43.460548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5d93b4a-c73f-482a-bce4-bb83fed3d8d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:43.461251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5d93b4a-c73f-482a-bce4-bb83fed3d8d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:43.461691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5d93b4a-c73f-482a-bce4-bb83fed3d8d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:43.462129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c5d93b4a-c73f-482a-bce4-bb83fed3d8d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:43.600791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c5d93b4a-c73f-482a-bce4-bb83fed3d8d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:43.609692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c5d93b4a-c73f-482a-bce4-bb83fed3d8d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:43.611204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c5d93b4a-c73f-482a-bce4-bb83fed3d8d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:43.612352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c5d93b4a-c73f-482a-bce4-bb83fed3d8d7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166455 Sep 13 20:19:43.612868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1025/2134] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:43.959985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0592aa7b-f62c-4eb0-9728-36c936f6afb9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:43.960621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0592aa7b-f62c-4eb0-9728-36c936f6afb9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:43.967126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0592aa7b-f62c-4eb0-9728-36c936f6afb9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:43.967607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0592aa7b-f62c-4eb0-9728-36c936f6afb9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:43.968031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0592aa7b-f62c-4eb0-9728-36c936f6afb9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:43.968715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0592aa7b-f62c-4eb0-9728-36c936f6afb9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:43.969164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0592aa7b-f62c-4eb0-9728-36c936f6afb9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:43.969587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0592aa7b-f62c-4eb0-9728-36c936f6afb9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:44.115012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0592aa7b-f62c-4eb0-9728-36c936f6afb9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:44.123355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0592aa7b-f62c-4eb0-9728-36c936f6afb9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167851 Sep 13 20:19:44.123925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1110/2135] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:43 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:44.637318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e41d91eb-07a5-4142-b734-53e97138ebcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:44.637881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e41d91eb-07a5-4142-b734-53e97138ebcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:44.645218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e41d91eb-07a5-4142-b734-53e97138ebcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:44.645791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e41d91eb-07a5-4142-b734-53e97138ebcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:44.646234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e41d91eb-07a5-4142-b734-53e97138ebcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:44.646951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e41d91eb-07a5-4142-b734-53e97138ebcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:44.647399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e41d91eb-07a5-4142-b734-53e97138ebcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:44.647817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e41d91eb-07a5-4142-b734-53e97138ebcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:44.784286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e41d91eb-07a5-4142-b734-53e97138ebcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:44.795521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e41d91eb-07a5-4142-b734-53e97138ebcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:44.797711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e41d91eb-07a5-4142-b734-53e97138ebcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:44.799145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e41d91eb-07a5-4142-b734-53e97138ebcf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165870 Sep 13 20:19:44.799712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1026/2136] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:45.151040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6b08fe96-b329-4d45-888d-7fce9f6e4d26 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:45.151977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6b08fe96-b329-4d45-888d-7fce9f6e4d26 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:45.160931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b08fe96-b329-4d45-888d-7fce9f6e4d26 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:45.161412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b08fe96-b329-4d45-888d-7fce9f6e4d26 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:45.161841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b08fe96-b329-4d45-888d-7fce9f6e4d26 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:45.162569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b08fe96-b329-4d45-888d-7fce9f6e4d26 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:45.163028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b08fe96-b329-4d45-888d-7fce9f6e4d26 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:45.163451 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6b08fe96-b329-4d45-888d-7fce9f6e4d26 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:45.294974 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6b08fe96-b329-4d45-888d-7fce9f6e4d26 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:45.304710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6b08fe96-b329-4d45-888d-7fce9f6e4d26 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.160363 Sep 13 20:19:45.305284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1111/2137] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:45 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:45.829043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-68e2d37c-9466-4d45-bfa9-1a009deb978f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:45.830052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-68e2d37c-9466-4d45-bfa9-1a009deb978f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:45.841764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-68e2d37c-9466-4d45-bfa9-1a009deb978f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:45.842627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-68e2d37c-9466-4d45-bfa9-1a009deb978f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:45.843340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-68e2d37c-9466-4d45-bfa9-1a009deb978f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:45.844458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-68e2d37c-9466-4d45-bfa9-1a009deb978f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:45.845333 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-68e2d37c-9466-4d45-bfa9-1a009deb978f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:45.845766 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-68e2d37c-9466-4d45-bfa9-1a009deb978f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:45.978060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-68e2d37c-9466-4d45-bfa9-1a009deb978f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:45.987313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-68e2d37c-9466-4d45-bfa9-1a009deb978f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:45.988740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-68e2d37c-9466-4d45-bfa9-1a009deb978f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:45.989895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-68e2d37c-9466-4d45-bfa9-1a009deb978f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167995 Sep 13 20:19:45.990783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1027/2138] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:46.332256 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fb85e331-7386-4ebd-b4cf-015fe05feebf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:46.332981 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fb85e331-7386-4ebd-b4cf-015fe05feebf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:46.341585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb85e331-7386-4ebd-b4cf-015fe05feebf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:46.342177 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb85e331-7386-4ebd-b4cf-015fe05feebf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:46.342793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb85e331-7386-4ebd-b4cf-015fe05feebf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:46.343640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb85e331-7386-4ebd-b4cf-015fe05feebf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:46.344195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb85e331-7386-4ebd-b4cf-015fe05feebf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:46.344714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb85e331-7386-4ebd-b4cf-015fe05feebf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:46.487294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fb85e331-7386-4ebd-b4cf-015fe05feebf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:46.495810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fb85e331-7386-4ebd-b4cf-015fe05feebf tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169939 Sep 13 20:19:46.496386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1112/2139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:46 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:47.023618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bd3a07d0-540b-43fa-b1a7-f29e65865999 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:47.024674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bd3a07d0-540b-43fa-b1a7-f29e65865999 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:47.035717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bd3a07d0-540b-43fa-b1a7-f29e65865999 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:47.036510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bd3a07d0-540b-43fa-b1a7-f29e65865999 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:47.037228 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bd3a07d0-540b-43fa-b1a7-f29e65865999 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:47.038361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bd3a07d0-540b-43fa-b1a7-f29e65865999 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:47.039155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bd3a07d0-540b-43fa-b1a7-f29e65865999 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:47.039870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bd3a07d0-540b-43fa-b1a7-f29e65865999 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:47.187878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bd3a07d0-540b-43fa-b1a7-f29e65865999 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:47.196730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bd3a07d0-540b-43fa-b1a7-f29e65865999 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:47.198150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bd3a07d0-540b-43fa-b1a7-f29e65865999 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:47.199328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bd3a07d0-540b-43fa-b1a7-f29e65865999 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.182526 Sep 13 20:19:47.199859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1028/2140] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:47 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:47.521765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f56b4357-ac7e-4249-8103-6fd8e9e41ad2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:47.522507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f56b4357-ac7e-4249-8103-6fd8e9e41ad2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:47.530396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f56b4357-ac7e-4249-8103-6fd8e9e41ad2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:47.531047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f56b4357-ac7e-4249-8103-6fd8e9e41ad2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:47.531553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f56b4357-ac7e-4249-8103-6fd8e9e41ad2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:47.532358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f56b4357-ac7e-4249-8103-6fd8e9e41ad2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:47.532889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f56b4357-ac7e-4249-8103-6fd8e9e41ad2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:47.533380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f56b4357-ac7e-4249-8103-6fd8e9e41ad2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:47.678993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f56b4357-ac7e-4249-8103-6fd8e9e41ad2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:47.687652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f56b4357-ac7e-4249-8103-6fd8e9e41ad2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.170863 Sep 13 20:19:47.688204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1113/2141] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:47 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:48.228716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1680a835-df56-470c-ab94-03bde5790e55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:48.229706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1680a835-df56-470c-ab94-03bde5790e55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:48.240672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1680a835-df56-470c-ab94-03bde5790e55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:48.241469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1680a835-df56-470c-ab94-03bde5790e55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:48.242181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1680a835-df56-470c-ab94-03bde5790e55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:48.243388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1680a835-df56-470c-ab94-03bde5790e55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:48.244137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1680a835-df56-470c-ab94-03bde5790e55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:48.244843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1680a835-df56-470c-ab94-03bde5790e55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:48.394778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1680a835-df56-470c-ab94-03bde5790e55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:48.409053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1680a835-df56-470c-ab94-03bde5790e55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:48.411139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1680a835-df56-470c-ab94-03bde5790e55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:48.412861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1680a835-df56-470c-ab94-03bde5790e55 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.190575 Sep 13 20:19:48.413672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1029/2142] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:48 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:48.714805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e84a8e06-cdc2-4e73-bb6e-14e84d79058d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:48.715865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e84a8e06-cdc2-4e73-bb6e-14e84d79058d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:48.728482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e84a8e06-cdc2-4e73-bb6e-14e84d79058d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:48.729160 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e84a8e06-cdc2-4e73-bb6e-14e84d79058d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:48.729799 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e84a8e06-cdc2-4e73-bb6e-14e84d79058d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:48.732108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e84a8e06-cdc2-4e73-bb6e-14e84d79058d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:48.732765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e84a8e06-cdc2-4e73-bb6e-14e84d79058d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:48.733385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e84a8e06-cdc2-4e73-bb6e-14e84d79058d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:48.882094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e84a8e06-cdc2-4e73-bb6e-14e84d79058d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:48.891425 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e84a8e06-cdc2-4e73-bb6e-14e84d79058d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.183264 Sep 13 20:19:48.892199 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1114/2143] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:48 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:49.443962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-af56b489-57cd-42a2-bf79-de9b6212a2d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:49.444710 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-af56b489-57cd-42a2-bf79-de9b6212a2d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:49.453176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af56b489-57cd-42a2-bf79-de9b6212a2d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:49.453778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af56b489-57cd-42a2-bf79-de9b6212a2d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:49.454301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af56b489-57cd-42a2-bf79-de9b6212a2d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:49.455237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af56b489-57cd-42a2-bf79-de9b6212a2d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:49.455796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af56b489-57cd-42a2-bf79-de9b6212a2d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:49.456712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af56b489-57cd-42a2-bf79-de9b6212a2d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:49.588739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-af56b489-57cd-42a2-bf79-de9b6212a2d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:49.597877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-af56b489-57cd-42a2-bf79-de9b6212a2d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:49.599338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-af56b489-57cd-42a2-bf79-de9b6212a2d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:49.600507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-af56b489-57cd-42a2-bf79-de9b6212a2d6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161917 Sep 13 20:19:49.601154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1030/2144] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:49.918298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1a1e9174-e7e2-4127-b47c-509c80b1abef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:49.919342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1a1e9174-e7e2-4127-b47c-509c80b1abef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:49.927639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a1e9174-e7e2-4127-b47c-509c80b1abef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:49.928109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a1e9174-e7e2-4127-b47c-509c80b1abef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:49.928534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a1e9174-e7e2-4127-b47c-509c80b1abef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:49.929212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a1e9174-e7e2-4127-b47c-509c80b1abef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:49.929651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a1e9174-e7e2-4127-b47c-509c80b1abef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:49.930066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a1e9174-e7e2-4127-b47c-509c80b1abef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:50.060496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1a1e9174-e7e2-4127-b47c-509c80b1abef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:50.072996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1a1e9174-e7e2-4127-b47c-509c80b1abef tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.160809 Sep 13 20:19:50.073815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1115/2145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:49 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:50.630601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3f5827c1-48e6-4ac7-a154-db86a2ee5e4b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:50.631579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3f5827c1-48e6-4ac7-a154-db86a2ee5e4b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:50.642485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f5827c1-48e6-4ac7-a154-db86a2ee5e4b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:50.642969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f5827c1-48e6-4ac7-a154-db86a2ee5e4b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:50.643396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f5827c1-48e6-4ac7-a154-db86a2ee5e4b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:50.644349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f5827c1-48e6-4ac7-a154-db86a2ee5e4b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:50.644803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f5827c1-48e6-4ac7-a154-db86a2ee5e4b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:50.645223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f5827c1-48e6-4ac7-a154-db86a2ee5e4b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:50.775750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3f5827c1-48e6-4ac7-a154-db86a2ee5e4b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:50.784576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3f5827c1-48e6-4ac7-a154-db86a2ee5e4b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:50.786032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3f5827c1-48e6-4ac7-a154-db86a2ee5e4b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:50.787224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3f5827c1-48e6-4ac7-a154-db86a2ee5e4b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.163147 Sep 13 20:19:50.787825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1031/2146] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:51.099376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0759248c-edb4-4b72-99af-039d357f88a5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:51.099965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0759248c-edb4-4b72-99af-039d357f88a5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:51.106575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0759248c-edb4-4b72-99af-039d357f88a5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:51.107054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0759248c-edb4-4b72-99af-039d357f88a5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:51.107486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0759248c-edb4-4b72-99af-039d357f88a5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:51.108165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0759248c-edb4-4b72-99af-039d357f88a5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:51.108614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0759248c-edb4-4b72-99af-039d357f88a5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:51.109027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0759248c-edb4-4b72-99af-039d357f88a5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:51.243440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0759248c-edb4-4b72-99af-039d357f88a5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:51.251915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0759248c-edb4-4b72-99af-039d357f88a5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.156507 Sep 13 20:19:51.252455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1116/2147] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:51 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:51.817366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3bd54251-dcc1-4261-9b8f-b365348cf183 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:51.818337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3bd54251-dcc1-4261-9b8f-b365348cf183 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:51.829347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3bd54251-dcc1-4261-9b8f-b365348cf183 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:51.830053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3bd54251-dcc1-4261-9b8f-b365348cf183 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:51.830842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3bd54251-dcc1-4261-9b8f-b365348cf183 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:51.832386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3bd54251-dcc1-4261-9b8f-b365348cf183 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:51.833143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3bd54251-dcc1-4261-9b8f-b365348cf183 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:51.833847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3bd54251-dcc1-4261-9b8f-b365348cf183 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:51.971821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3bd54251-dcc1-4261-9b8f-b365348cf183 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:51.981137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3bd54251-dcc1-4261-9b8f-b365348cf183 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:51.982617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3bd54251-dcc1-4261-9b8f-b365348cf183 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:51.983780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3bd54251-dcc1-4261-9b8f-b365348cf183 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173075 Sep 13 20:19:51.984307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1032/2148] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:52.278621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e0a70f14-0ecc-4390-bd95-abb6016dd6ea tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:52.279686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e0a70f14-0ecc-4390-bd95-abb6016dd6ea tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:52.290616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0a70f14-0ecc-4390-bd95-abb6016dd6ea tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:52.291413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0a70f14-0ecc-4390-bd95-abb6016dd6ea tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:52.292127 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0a70f14-0ecc-4390-bd95-abb6016dd6ea tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:52.293257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0a70f14-0ecc-4390-bd95-abb6016dd6ea tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:52.293998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0a70f14-0ecc-4390-bd95-abb6016dd6ea tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:52.294756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0a70f14-0ecc-4390-bd95-abb6016dd6ea tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:52.429301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e0a70f14-0ecc-4390-bd95-abb6016dd6ea tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:52.437893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e0a70f14-0ecc-4390-bd95-abb6016dd6ea tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165906 Sep 13 20:19:52.438494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1117/2149] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:52 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:53.012602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8537e0df-4bc7-45ca-b722-1b32650ce172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:53.014751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8537e0df-4bc7-45ca-b722-1b32650ce172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:53.022735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8537e0df-4bc7-45ca-b722-1b32650ce172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:53.023219 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8537e0df-4bc7-45ca-b722-1b32650ce172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:53.023658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8537e0df-4bc7-45ca-b722-1b32650ce172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:53.024350 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8537e0df-4bc7-45ca-b722-1b32650ce172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:53.024802 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8537e0df-4bc7-45ca-b722-1b32650ce172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:53.025223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8537e0df-4bc7-45ca-b722-1b32650ce172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:53.165905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8537e0df-4bc7-45ca-b722-1b32650ce172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:53.174633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8537e0df-4bc7-45ca-b722-1b32650ce172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:53.176059 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8537e0df-4bc7-45ca-b722-1b32650ce172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:53.177197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8537e0df-4bc7-45ca-b722-1b32650ce172 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.171244 Sep 13 20:19:53.177750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1033/2150] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:53 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:53.463114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-869cbbf0-f7f3-4a27-a782-ded89e3d4589 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:53.463867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-869cbbf0-f7f3-4a27-a782-ded89e3d4589 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:53.471814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-869cbbf0-f7f3-4a27-a782-ded89e3d4589 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:53.472282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-869cbbf0-f7f3-4a27-a782-ded89e3d4589 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:53.472712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-869cbbf0-f7f3-4a27-a782-ded89e3d4589 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:53.473382 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-869cbbf0-f7f3-4a27-a782-ded89e3d4589 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:53.473824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-869cbbf0-f7f3-4a27-a782-ded89e3d4589 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:53.474235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-869cbbf0-f7f3-4a27-a782-ded89e3d4589 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:53.606399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-869cbbf0-f7f3-4a27-a782-ded89e3d4589 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:53.615282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-869cbbf0-f7f3-4a27-a782-ded89e3d4589 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.157028 Sep 13 20:19:53.615849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1118/2151] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:53 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:54.202944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a0e3fe7c-ae00-45a7-8273-c2c3fc4e8eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:54.203544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a0e3fe7c-ae00-45a7-8273-c2c3fc4e8eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:54.210516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a0e3fe7c-ae00-45a7-8273-c2c3fc4e8eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:54.210994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a0e3fe7c-ae00-45a7-8273-c2c3fc4e8eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:54.211433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a0e3fe7c-ae00-45a7-8273-c2c3fc4e8eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:54.212085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a0e3fe7c-ae00-45a7-8273-c2c3fc4e8eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:54.212528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a0e3fe7c-ae00-45a7-8273-c2c3fc4e8eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:54.212942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a0e3fe7c-ae00-45a7-8273-c2c3fc4e8eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:54.343968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a0e3fe7c-ae00-45a7-8273-c2c3fc4e8eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:54.352610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a0e3fe7c-ae00-45a7-8273-c2c3fc4e8eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:54.354022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a0e3fe7c-ae00-45a7-8273-c2c3fc4e8eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:54.355198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a0e3fe7c-ae00-45a7-8273-c2c3fc4e8eb1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.156161 Sep 13 20:19:54.355777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1034/2152] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:54 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:54.641948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a9e783ad-4bae-42d7-8f6e-e8e639fd04db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:54.642987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a9e783ad-4bae-42d7-8f6e-e8e639fd04db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:54.653875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9e783ad-4bae-42d7-8f6e-e8e639fd04db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:54.654734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9e783ad-4bae-42d7-8f6e-e8e639fd04db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:54.655441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9e783ad-4bae-42d7-8f6e-e8e639fd04db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:54.656605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9e783ad-4bae-42d7-8f6e-e8e639fd04db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:54.657290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9e783ad-4bae-42d7-8f6e-e8e639fd04db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:54.658039 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9e783ad-4bae-42d7-8f6e-e8e639fd04db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:54.672720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:54.798957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a9e783ad-4bae-42d7-8f6e-e8e639fd04db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:54.807320 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a9e783ad-4bae-42d7-8f6e-e8e639fd04db tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.171881 Sep 13 20:19:54.807881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1119/2153] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:54 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:55.384675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5a3cf946-2e8c-4f1a-87e8-49b237f16374 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:55.385669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5a3cf946-2e8c-4f1a-87e8-49b237f16374 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:55.396471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a3cf946-2e8c-4f1a-87e8-49b237f16374 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:55.397248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a3cf946-2e8c-4f1a-87e8-49b237f16374 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:55.397954 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a3cf946-2e8c-4f1a-87e8-49b237f16374 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:55.399129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a3cf946-2e8c-4f1a-87e8-49b237f16374 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:55.399921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a3cf946-2e8c-4f1a-87e8-49b237f16374 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:55.400610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a3cf946-2e8c-4f1a-87e8-49b237f16374 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:55.540384 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5a3cf946-2e8c-4f1a-87e8-49b237f16374 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:55.553005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5a3cf946-2e8c-4f1a-87e8-49b237f16374 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:55.555162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5a3cf946-2e8c-4f1a-87e8-49b237f16374 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:55.556842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5a3cf946-2e8c-4f1a-87e8-49b237f16374 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.178617 Sep 13 20:19:55.557692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1035/2154] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:55.836935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b2ae69f4-1391-40cd-97f7-495c579065e9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:55.837513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b2ae69f4-1391-40cd-97f7-495c579065e9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:55.844443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b2ae69f4-1391-40cd-97f7-495c579065e9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:55.844925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b2ae69f4-1391-40cd-97f7-495c579065e9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:55.845358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b2ae69f4-1391-40cd-97f7-495c579065e9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:55.846050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b2ae69f4-1391-40cd-97f7-495c579065e9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:55.846530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b2ae69f4-1391-40cd-97f7-495c579065e9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:55.846949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b2ae69f4-1391-40cd-97f7-495c579065e9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:55.994572 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b2ae69f4-1391-40cd-97f7-495c579065e9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:56.007175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b2ae69f4-1391-40cd-97f7-495c579065e9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.175855 Sep 13 20:19:56.007926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1120/2155] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:55 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:19:56.583729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1a876a37-86f4-4b2c-be75-26c787be77e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:56.584347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1a876a37-86f4-4b2c-be75-26c787be77e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:56.591200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1a876a37-86f4-4b2c-be75-26c787be77e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:56.591686 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1a876a37-86f4-4b2c-be75-26c787be77e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:56.592136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1a876a37-86f4-4b2c-be75-26c787be77e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:56.592798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1a876a37-86f4-4b2c-be75-26c787be77e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:56.593240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1a876a37-86f4-4b2c-be75-26c787be77e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:56.593653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1a876a37-86f4-4b2c-be75-26c787be77e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:56.727092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1a876a37-86f4-4b2c-be75-26c787be77e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:56.736146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1a876a37-86f4-4b2c-be75-26c787be77e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:56.737569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1a876a37-86f4-4b2c-be75-26c787be77e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:56.738768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1a876a37-86f4-4b2c-be75-26c787be77e7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159509 Sep 13 20:19:56.739604 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1036/2156] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:57.037303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-534ba421-1e38-452c-87dd-0051c4f39849 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:57.038285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-534ba421-1e38-452c-87dd-0051c4f39849 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:57.049313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-534ba421-1e38-452c-87dd-0051c4f39849 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:57.050109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-534ba421-1e38-452c-87dd-0051c4f39849 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:57.050870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-534ba421-1e38-452c-87dd-0051c4f39849 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:57.051999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-534ba421-1e38-452c-87dd-0051c4f39849 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:57.052742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-534ba421-1e38-452c-87dd-0051c4f39849 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:57.053435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-534ba421-1e38-452c-87dd-0051c4f39849 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:57.192298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-534ba421-1e38-452c-87dd-0051c4f39849 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:57.200598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-534ba421-1e38-452c-87dd-0051c4f39849 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169907 Sep 13 20:19:57.201173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1121/2157] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:57 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:57.768047 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-77450d3e-cd8a-4e9b-a145-b6cc1da1e0e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:57.768955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-77450d3e-cd8a-4e9b-a145-b6cc1da1e0e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:57.779953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-77450d3e-cd8a-4e9b-a145-b6cc1da1e0e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:57.780721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-77450d3e-cd8a-4e9b-a145-b6cc1da1e0e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:57.781432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-77450d3e-cd8a-4e9b-a145-b6cc1da1e0e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:57.782607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-77450d3e-cd8a-4e9b-a145-b6cc1da1e0e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:57.783262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-77450d3e-cd8a-4e9b-a145-b6cc1da1e0e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:57.783679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-77450d3e-cd8a-4e9b-a145-b6cc1da1e0e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:57.928916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-77450d3e-cd8a-4e9b-a145-b6cc1da1e0e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:57.937638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-77450d3e-cd8a-4e9b-a145-b6cc1da1e0e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:57.939304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-77450d3e-cd8a-4e9b-a145-b6cc1da1e0e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:57.940452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-77450d3e-cd8a-4e9b-a145-b6cc1da1e0e0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.179063 Sep 13 20:19:57.941006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1037/2158] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:58.228477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-41cf75a5-c966-4ffd-8c43-cba71e867050 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:58.229442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-41cf75a5-c966-4ffd-8c43-cba71e867050 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:58.239206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41cf75a5-c966-4ffd-8c43-cba71e867050 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:58.239726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41cf75a5-c966-4ffd-8c43-cba71e867050 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:58.240158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41cf75a5-c966-4ffd-8c43-cba71e867050 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:58.240888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41cf75a5-c966-4ffd-8c43-cba71e867050 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:58.241337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41cf75a5-c966-4ffd-8c43-cba71e867050 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:58.241753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41cf75a5-c966-4ffd-8c43-cba71e867050 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:58.377880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-41cf75a5-c966-4ffd-8c43-cba71e867050 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:58.386482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-41cf75a5-c966-4ffd-8c43-cba71e867050 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164524 Sep 13 20:19:58.387072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1122/2159] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:58 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:19:58.969346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b591b7f6-ed5b-484d-b37d-6aa2702f4813 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:58.970463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b591b7f6-ed5b-484d-b37d-6aa2702f4813 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:58.981249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b591b7f6-ed5b-484d-b37d-6aa2702f4813 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:58.982034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b591b7f6-ed5b-484d-b37d-6aa2702f4813 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:58.982814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b591b7f6-ed5b-484d-b37d-6aa2702f4813 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:58.983944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b591b7f6-ed5b-484d-b37d-6aa2702f4813 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:58.984686 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b591b7f6-ed5b-484d-b37d-6aa2702f4813 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:58.985386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b591b7f6-ed5b-484d-b37d-6aa2702f4813 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:59.128793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b591b7f6-ed5b-484d-b37d-6aa2702f4813 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:59.137862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b591b7f6-ed5b-484d-b37d-6aa2702f4813 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:59.139345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b591b7f6-ed5b-484d-b37d-6aa2702f4813 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:59.140510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b591b7f6-ed5b-484d-b37d-6aa2702f4813 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.177783 Sep 13 20:19:59.141076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1038/2160] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:19:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:19:59.413751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6dc7cdbb-1458-47b9-8c81-a92dcd200d98 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:59.414712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6dc7cdbb-1458-47b9-8c81-a92dcd200d98 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:59.425535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6dc7cdbb-1458-47b9-8c81-a92dcd200d98 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:59.426326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6dc7cdbb-1458-47b9-8c81-a92dcd200d98 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:59.427094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6dc7cdbb-1458-47b9-8c81-a92dcd200d98 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:59.428214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6dc7cdbb-1458-47b9-8c81-a92dcd200d98 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:59.428955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6dc7cdbb-1458-47b9-8c81-a92dcd200d98 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:59.429650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6dc7cdbb-1458-47b9-8c81-a92dcd200d98 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:59.577882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6dc7cdbb-1458-47b9-8c81-a92dcd200d98 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:59.587021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6dc7cdbb-1458-47b9-8c81-a92dcd200d98 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.180048 Sep 13 20:19:59.587604 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1123/2161] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:59 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:00.170604 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ff96bb6d-60e5-4608-8258-d66e4f38e535 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:00.171533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ff96bb6d-60e5-4608-8258-d66e4f38e535 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:00.181650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff96bb6d-60e5-4608-8258-d66e4f38e535 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:00.182596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff96bb6d-60e5-4608-8258-d66e4f38e535 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:00.183314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff96bb6d-60e5-4608-8258-d66e4f38e535 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:00.184436 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff96bb6d-60e5-4608-8258-d66e4f38e535 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:00.185166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff96bb6d-60e5-4608-8258-d66e4f38e535 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:00.185866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ff96bb6d-60e5-4608-8258-d66e4f38e535 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:00.324761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ff96bb6d-60e5-4608-8258-d66e4f38e535 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:00.334560 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ff96bb6d-60e5-4608-8258-d66e4f38e535 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:00.336000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ff96bb6d-60e5-4608-8258-d66e4f38e535 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:00.337138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ff96bb6d-60e5-4608-8258-d66e4f38e535 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173431 Sep 13 20:20:00.337666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1039/2162] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:00 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:00.611607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d4916313-fb02-4068-bd1a-2de1a2aadcd2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:00.612367 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d4916313-fb02-4068-bd1a-2de1a2aadcd2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:00.620356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4916313-fb02-4068-bd1a-2de1a2aadcd2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:00.620918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4916313-fb02-4068-bd1a-2de1a2aadcd2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:00.621427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4916313-fb02-4068-bd1a-2de1a2aadcd2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:00.622228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4916313-fb02-4068-bd1a-2de1a2aadcd2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:00.622832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4916313-fb02-4068-bd1a-2de1a2aadcd2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:00.623303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4916313-fb02-4068-bd1a-2de1a2aadcd2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:00.772796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d4916313-fb02-4068-bd1a-2de1a2aadcd2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:00.781859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d4916313-fb02-4068-bd1a-2de1a2aadcd2 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.174860 Sep 13 20:20:00.782419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1124/2163] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:00 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:01.366822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-67c64012-077a-46b1-bf4f-16339b2caad0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:01.367787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-67c64012-077a-46b1-bf4f-16339b2caad0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:01.378782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67c64012-077a-46b1-bf4f-16339b2caad0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:01.379260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67c64012-077a-46b1-bf4f-16339b2caad0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:01.379691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67c64012-077a-46b1-bf4f-16339b2caad0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:01.380371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67c64012-077a-46b1-bf4f-16339b2caad0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:01.380815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67c64012-077a-46b1-bf4f-16339b2caad0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:01.381233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67c64012-077a-46b1-bf4f-16339b2caad0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:01.520891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-67c64012-077a-46b1-bf4f-16339b2caad0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:01.529876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-67c64012-077a-46b1-bf4f-16339b2caad0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:01.531358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-67c64012-077a-46b1-bf4f-16339b2caad0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:01.532521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-67c64012-077a-46b1-bf4f-16339b2caad0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172336 Sep 13 20:20:01.533091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1040/2164] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:01.805236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8e1e72bf-3944-4dc9-9fe3-6730ac547eca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:01.805824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8e1e72bf-3944-4dc9-9fe3-6730ac547eca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:01.812456 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e1e72bf-3944-4dc9-9fe3-6730ac547eca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:01.812822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e1e72bf-3944-4dc9-9fe3-6730ac547eca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:01.813242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e1e72bf-3944-4dc9-9fe3-6730ac547eca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:01.813918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e1e72bf-3944-4dc9-9fe3-6730ac547eca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:01.814358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e1e72bf-3944-4dc9-9fe3-6730ac547eca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:01.814822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8e1e72bf-3944-4dc9-9fe3-6730ac547eca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:01.951008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8e1e72bf-3944-4dc9-9fe3-6730ac547eca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:01.960296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8e1e72bf-3944-4dc9-9fe3-6730ac547eca tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158882 Sep 13 20:20:01.960873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1125/2165] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:01 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:02.560368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-543b05fe-8e8d-455c-b916-29adc70201a1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:02.561124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-543b05fe-8e8d-455c-b916-29adc70201a1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:02.570018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-543b05fe-8e8d-455c-b916-29adc70201a1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:02.570746 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-543b05fe-8e8d-455c-b916-29adc70201a1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:02.571318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-543b05fe-8e8d-455c-b916-29adc70201a1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:02.572221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-543b05fe-8e8d-455c-b916-29adc70201a1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:02.572820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-543b05fe-8e8d-455c-b916-29adc70201a1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:02.573386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-543b05fe-8e8d-455c-b916-29adc70201a1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:02.576984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:20:02.711856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-543b05fe-8e8d-455c-b916-29adc70201a1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:02.725001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-543b05fe-8e8d-455c-b916-29adc70201a1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:02.727118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-543b05fe-8e8d-455c-b916-29adc70201a1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:02.728826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-543b05fe-8e8d-455c-b916-29adc70201a1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173485 Sep 13 20:20:02.729565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1041/2166] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:02.987396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c5ea65a9-23ff-43f0-a4f7-f235e3574713 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:02.988392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c5ea65a9-23ff-43f0-a4f7-f235e3574713 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:02.999353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c5ea65a9-23ff-43f0-a4f7-f235e3574713 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:03.000144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c5ea65a9-23ff-43f0-a4f7-f235e3574713 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:03.000880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c5ea65a9-23ff-43f0-a4f7-f235e3574713 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:03.001997 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c5ea65a9-23ff-43f0-a4f7-f235e3574713 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:03.002803 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c5ea65a9-23ff-43f0-a4f7-f235e3574713 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:03.003471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c5ea65a9-23ff-43f0-a4f7-f235e3574713 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:03.150693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c5ea65a9-23ff-43f0-a4f7-f235e3574713 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:03.159462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c5ea65a9-23ff-43f0-a4f7-f235e3574713 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.178531 Sep 13 20:20:03.160040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1126/2167] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:02 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:03.757804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c40c1ba6-139b-42bf-81d0-2bbb977b2707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:03.758466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c40c1ba6-139b-42bf-81d0-2bbb977b2707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:03.765573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c40c1ba6-139b-42bf-81d0-2bbb977b2707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:03.766048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c40c1ba6-139b-42bf-81d0-2bbb977b2707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:03.766516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c40c1ba6-139b-42bf-81d0-2bbb977b2707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:03.767209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c40c1ba6-139b-42bf-81d0-2bbb977b2707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:03.767659 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c40c1ba6-139b-42bf-81d0-2bbb977b2707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:03.768081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c40c1ba6-139b-42bf-81d0-2bbb977b2707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:03.902786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c40c1ba6-139b-42bf-81d0-2bbb977b2707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:03.912123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c40c1ba6-139b-42bf-81d0-2bbb977b2707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:03.913563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c40c1ba6-139b-42bf-81d0-2bbb977b2707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:03.914735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c40c1ba6-139b-42bf-81d0-2bbb977b2707 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161119 Sep 13 20:20:03.915335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1042/2168] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:04.184151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-df4cc57a-f166-4acc-b0d0-2ec480df0519 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:04.184749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-df4cc57a-f166-4acc-b0d0-2ec480df0519 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:04.192000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-df4cc57a-f166-4acc-b0d0-2ec480df0519 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:04.192548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-df4cc57a-f166-4acc-b0d0-2ec480df0519 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:04.192981 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-df4cc57a-f166-4acc-b0d0-2ec480df0519 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:04.193723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-df4cc57a-f166-4acc-b0d0-2ec480df0519 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:04.194238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-df4cc57a-f166-4acc-b0d0-2ec480df0519 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:04.194761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-df4cc57a-f166-4acc-b0d0-2ec480df0519 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:04.330680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-df4cc57a-f166-4acc-b0d0-2ec480df0519 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:04.339638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-df4cc57a-f166-4acc-b0d0-2ec480df0519 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.160310 Sep 13 20:20:04.340216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1127/2169] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:04 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:04.944772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-629fee51-344b-4cb5-b45a-3de77f1df955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:04.945641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-629fee51-344b-4cb5-b45a-3de77f1df955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:04.949448 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=52 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:20:04.958505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-629fee51-344b-4cb5-b45a-3de77f1df955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:04.959508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-629fee51-344b-4cb5-b45a-3de77f1df955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:04.959508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-629fee51-344b-4cb5-b45a-3de77f1df955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:04.960061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-629fee51-344b-4cb5-b45a-3de77f1df955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:04.960505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-629fee51-344b-4cb5-b45a-3de77f1df955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:04.960924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-629fee51-344b-4cb5-b45a-3de77f1df955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:05.097228 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-629fee51-344b-4cb5-b45a-3de77f1df955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:05.106466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-629fee51-344b-4cb5-b45a-3de77f1df955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:05.107878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-629fee51-344b-4cb5-b45a-3de77f1df955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:05.109026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-629fee51-344b-4cb5-b45a-3de77f1df955 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.171028 Sep 13 20:20:05.109572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1043/2170] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:05.364229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-37df4033-09ee-4d92-8a5b-27427ef677e1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:05.364923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-37df4033-09ee-4d92-8a5b-27427ef677e1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:05.374142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37df4033-09ee-4d92-8a5b-27427ef677e1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:05.374866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37df4033-09ee-4d92-8a5b-27427ef677e1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:05.375477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37df4033-09ee-4d92-8a5b-27427ef677e1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:05.376476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37df4033-09ee-4d92-8a5b-27427ef677e1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:05.377125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37df4033-09ee-4d92-8a5b-27427ef677e1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:05.377744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37df4033-09ee-4d92-8a5b-27427ef677e1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:05.525928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-37df4033-09ee-4d92-8a5b-27427ef677e1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:05.534524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-37df4033-09ee-4d92-8a5b-27427ef677e1 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.175162 Sep 13 20:20:05.535093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1128/2171] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:05 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:06.134752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-999f4439-0446-49a4-94eb-c40bfe1cf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:06.135330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-999f4439-0446-49a4-94eb-c40bfe1cf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:06.142148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-999f4439-0446-49a4-94eb-c40bfe1cf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:06.142655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-999f4439-0446-49a4-94eb-c40bfe1cf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:06.143086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-999f4439-0446-49a4-94eb-c40bfe1cf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:06.143760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-999f4439-0446-49a4-94eb-c40bfe1cf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:06.144205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-999f4439-0446-49a4-94eb-c40bfe1cf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:06.144621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-999f4439-0446-49a4-94eb-c40bfe1cf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:06.273504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-999f4439-0446-49a4-94eb-c40bfe1cf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:06.287220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-999f4439-0446-49a4-94eb-c40bfe1cf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:06.289277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-999f4439-0446-49a4-94eb-c40bfe1cf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:06.291080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-999f4439-0446-49a4-94eb-c40bfe1cf9aa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.160043 Sep 13 20:20:06.291994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1044/2172] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:06 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:06.559503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bfcf0633-d174-49a1-a4a9-40e4a8bcd552 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:06.560197 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bfcf0633-d174-49a1-a4a9-40e4a8bcd552 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:06.563178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:20:06.569709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfcf0633-d174-49a1-a4a9-40e4a8bcd552 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:06.570192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfcf0633-d174-49a1-a4a9-40e4a8bcd552 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:06.570670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfcf0633-d174-49a1-a4a9-40e4a8bcd552 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:06.571360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfcf0633-d174-49a1-a4a9-40e4a8bcd552 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:06.572316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfcf0633-d174-49a1-a4a9-40e4a8bcd552 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:06.572316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bfcf0633-d174-49a1-a4a9-40e4a8bcd552 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:06.704926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bfcf0633-d174-49a1-a4a9-40e4a8bcd552 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:06.715108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bfcf0633-d174-49a1-a4a9-40e4a8bcd552 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.160970 Sep 13 20:20:06.715731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1129/2173] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:06 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:07.324322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dd168764-c0d7-4c0c-abfa-89839f1c3552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:07.325357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dd168764-c0d7-4c0c-abfa-89839f1c3552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:07.336603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd168764-c0d7-4c0c-abfa-89839f1c3552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:07.337460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd168764-c0d7-4c0c-abfa-89839f1c3552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:07.338238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd168764-c0d7-4c0c-abfa-89839f1c3552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:07.339684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd168764-c0d7-4c0c-abfa-89839f1c3552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:07.340338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd168764-c0d7-4c0c-abfa-89839f1c3552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:07.341044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dd168764-c0d7-4c0c-abfa-89839f1c3552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:07.481294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dd168764-c0d7-4c0c-abfa-89839f1c3552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:07.494863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dd168764-c0d7-4c0c-abfa-89839f1c3552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:07.497232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dd168764-c0d7-4c0c-abfa-89839f1c3552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:07.499165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dd168764-c0d7-4c0c-abfa-89839f1c3552 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.181098 Sep 13 20:20:07.500021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1045/2174] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:07.742403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a40fd302-ec7a-4bc1-8795-3baac21f3ca5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:07.743550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a40fd302-ec7a-4bc1-8795-3baac21f3ca5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:07.754637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a40fd302-ec7a-4bc1-8795-3baac21f3ca5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:07.755428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a40fd302-ec7a-4bc1-8795-3baac21f3ca5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:07.756136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a40fd302-ec7a-4bc1-8795-3baac21f3ca5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:07.757255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a40fd302-ec7a-4bc1-8795-3baac21f3ca5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:07.757994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a40fd302-ec7a-4bc1-8795-3baac21f3ca5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:07.758740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a40fd302-ec7a-4bc1-8795-3baac21f3ca5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:07.900046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a40fd302-ec7a-4bc1-8795-3baac21f3ca5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:07.912527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a40fd302-ec7a-4bc1-8795-3baac21f3ca5 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.176345 Sep 13 20:20:07.913319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1130/2175] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:07 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:08.530428 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e942ae2c-76f8-44d1-9c3e-023df76e4e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:08.531456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e942ae2c-76f8-44d1-9c3e-023df76e4e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:08.542352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e942ae2c-76f8-44d1-9c3e-023df76e4e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:08.543195 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e942ae2c-76f8-44d1-9c3e-023df76e4e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:08.543907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e942ae2c-76f8-44d1-9c3e-023df76e4e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:08.545024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e942ae2c-76f8-44d1-9c3e-023df76e4e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:08.545756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e942ae2c-76f8-44d1-9c3e-023df76e4e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:08.546433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e942ae2c-76f8-44d1-9c3e-023df76e4e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:08.687091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e942ae2c-76f8-44d1-9c3e-023df76e4e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:08.700437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e942ae2c-76f8-44d1-9c3e-023df76e4e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:08.702625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e942ae2c-76f8-44d1-9c3e-023df76e4e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:08.704338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e942ae2c-76f8-44d1-9c3e-023df76e4e95 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.180076 Sep 13 20:20:08.705069 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1046/2176] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:08.945995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b2a084c4-4473-4d2a-9eba-3ed6d7021ad3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:08.946857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b2a084c4-4473-4d2a-9eba-3ed6d7021ad3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:08.958109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b2a084c4-4473-4d2a-9eba-3ed6d7021ad3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:08.958946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b2a084c4-4473-4d2a-9eba-3ed6d7021ad3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:08.959652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b2a084c4-4473-4d2a-9eba-3ed6d7021ad3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:08.960776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b2a084c4-4473-4d2a-9eba-3ed6d7021ad3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:08.961514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b2a084c4-4473-4d2a-9eba-3ed6d7021ad3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:08.962202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b2a084c4-4473-4d2a-9eba-3ed6d7021ad3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:09.099961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b2a084c4-4473-4d2a-9eba-3ed6d7021ad3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:09.108644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b2a084c4-4473-4d2a-9eba-3ed6d7021ad3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.169383 Sep 13 20:20:09.109257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1131/2177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:08 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:09.734820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2eb4b576-0279-4cdd-bf30-cb27a746ed32 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:09.735841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2eb4b576-0279-4cdd-bf30-cb27a746ed32 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:09.746921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eb4b576-0279-4cdd-bf30-cb27a746ed32 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:09.747724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eb4b576-0279-4cdd-bf30-cb27a746ed32 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:09.748448 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eb4b576-0279-4cdd-bf30-cb27a746ed32 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:09.749579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eb4b576-0279-4cdd-bf30-cb27a746ed32 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:09.750323 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eb4b576-0279-4cdd-bf30-cb27a746ed32 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:09.751070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2eb4b576-0279-4cdd-bf30-cb27a746ed32 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:09.904803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2eb4b576-0279-4cdd-bf30-cb27a746ed32 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:09.913596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2eb4b576-0279-4cdd-bf30-cb27a746ed32 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:09.915078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2eb4b576-0279-4cdd-bf30-cb27a746ed32 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:09.916234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2eb4b576-0279-4cdd-bf30-cb27a746ed32 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.188138 Sep 13 20:20:09.916805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1047/2178] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:10.136611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e2e79978-fd79-4cf9-adc6-c47d65a88f7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:10.137488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e2e79978-fd79-4cf9-adc6-c47d65a88f7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:10.147029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2e79978-fd79-4cf9-adc6-c47d65a88f7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:10.147499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2e79978-fd79-4cf9-adc6-c47d65a88f7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:10.147921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2e79978-fd79-4cf9-adc6-c47d65a88f7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:10.148589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2e79978-fd79-4cf9-adc6-c47d65a88f7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:10.149027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2e79978-fd79-4cf9-adc6-c47d65a88f7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:10.149438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e2e79978-fd79-4cf9-adc6-c47d65a88f7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:10.286556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e2e79978-fd79-4cf9-adc6-c47d65a88f7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:10.295266 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e2e79978-fd79-4cf9-adc6-c47d65a88f7e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.165331 Sep 13 20:20:10.295845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1132/2179] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:10 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:10.945732 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-271f0dd7-b37e-4d1c-8f2b-70d00473ed57 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:10.947637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-271f0dd7-b37e-4d1c-8f2b-70d00473ed57 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:10.958465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-271f0dd7-b37e-4d1c-8f2b-70d00473ed57 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:10.959281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-271f0dd7-b37e-4d1c-8f2b-70d00473ed57 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:10.959785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-271f0dd7-b37e-4d1c-8f2b-70d00473ed57 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:10.960440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-271f0dd7-b37e-4d1c-8f2b-70d00473ed57 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:10.961055 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-271f0dd7-b37e-4d1c-8f2b-70d00473ed57 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:10.961475 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-271f0dd7-b37e-4d1c-8f2b-70d00473ed57 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:11.100652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-271f0dd7-b37e-4d1c-8f2b-70d00473ed57 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:11.109986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-271f0dd7-b37e-4d1c-8f2b-70d00473ed57 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:11.111499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-271f0dd7-b37e-4d1c-8f2b-70d00473ed57 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:11.112662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-271f0dd7-b37e-4d1c-8f2b-70d00473ed57 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173272 Sep 13 20:20:11.113258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1048/2180] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:11.323247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-796c778e-6fb7-4301-abdd-a601ae1eb52a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:11.324263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-796c778e-6fb7-4301-abdd-a601ae1eb52a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:11.335644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-796c778e-6fb7-4301-abdd-a601ae1eb52a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:11.336450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-796c778e-6fb7-4301-abdd-a601ae1eb52a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:11.337167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-796c778e-6fb7-4301-abdd-a601ae1eb52a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:11.338300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-796c778e-6fb7-4301-abdd-a601ae1eb52a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:11.339048 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-796c778e-6fb7-4301-abdd-a601ae1eb52a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:11.339797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-796c778e-6fb7-4301-abdd-a601ae1eb52a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:11.489080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-796c778e-6fb7-4301-abdd-a601ae1eb52a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:11.499143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-796c778e-6fb7-4301-abdd-a601ae1eb52a tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.182431 Sep 13 20:20:11.499721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1133/2181] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:11 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:12.141666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-283643c0-33b1-4757-ba22-a3654468bee3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:12.142651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-283643c0-33b1-4757-ba22-a3654468bee3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:12.153510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-283643c0-33b1-4757-ba22-a3654468bee3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:12.154400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-283643c0-33b1-4757-ba22-a3654468bee3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:12.155139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-283643c0-33b1-4757-ba22-a3654468bee3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:12.156217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-283643c0-33b1-4757-ba22-a3654468bee3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:12.157014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-283643c0-33b1-4757-ba22-a3654468bee3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:12.157721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-283643c0-33b1-4757-ba22-a3654468bee3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:12.290850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-283643c0-33b1-4757-ba22-a3654468bee3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:12.299469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-283643c0-33b1-4757-ba22-a3654468bee3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:12.300892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-283643c0-33b1-4757-ba22-a3654468bee3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:12.302127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-283643c0-33b1-4757-ba22-a3654468bee3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167069 Sep 13 20:20:12.302746 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1049/2182] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:12 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:12.523013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0eae0e49-600e-4c54-90eb-baa13a3166fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:12.524180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0eae0e49-600e-4c54-90eb-baa13a3166fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:12.531124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0eae0e49-600e-4c54-90eb-baa13a3166fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:12.531601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0eae0e49-600e-4c54-90eb-baa13a3166fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:12.532021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0eae0e49-600e-4c54-90eb-baa13a3166fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:12.532700 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0eae0e49-600e-4c54-90eb-baa13a3166fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:12.533134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0eae0e49-600e-4c54-90eb-baa13a3166fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:12.533549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0eae0e49-600e-4c54-90eb-baa13a3166fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:12.667383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0eae0e49-600e-4c54-90eb-baa13a3166fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:12.675649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0eae0e49-600e-4c54-90eb-baa13a3166fc tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.156821 Sep 13 20:20:12.676220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1134/2183] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:12 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:13.332039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f6fc8e29-8ef0-45d9-957d-4a9d5aaf42e5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:13.332968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f6fc8e29-8ef0-45d9-957d-4a9d5aaf42e5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:13.343825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6fc8e29-8ef0-45d9-957d-4a9d5aaf42e5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:13.344624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6fc8e29-8ef0-45d9-957d-4a9d5aaf42e5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:13.345364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6fc8e29-8ef0-45d9-957d-4a9d5aaf42e5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:13.346551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6fc8e29-8ef0-45d9-957d-4a9d5aaf42e5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:13.347307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6fc8e29-8ef0-45d9-957d-4a9d5aaf42e5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:13.348093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6fc8e29-8ef0-45d9-957d-4a9d5aaf42e5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:13.496927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f6fc8e29-8ef0-45d9-957d-4a9d5aaf42e5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:13.507520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f6fc8e29-8ef0-45d9-957d-4a9d5aaf42e5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:13.508973 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f6fc8e29-8ef0-45d9-957d-4a9d5aaf42e5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:13.510420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f6fc8e29-8ef0-45d9-957d-4a9d5aaf42e5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.185103 Sep 13 20:20:13.510860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1050/2184] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:13.703209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4d847778-6d7e-4879-a1f7-9bee014dfe02 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:13.704165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4d847778-6d7e-4879-a1f7-9bee014dfe02 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:13.712009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d847778-6d7e-4879-a1f7-9bee014dfe02 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:13.712479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d847778-6d7e-4879-a1f7-9bee014dfe02 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:13.712902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d847778-6d7e-4879-a1f7-9bee014dfe02 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:13.713591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d847778-6d7e-4879-a1f7-9bee014dfe02 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:13.714050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d847778-6d7e-4879-a1f7-9bee014dfe02 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:13.714504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d847778-6d7e-4879-a1f7-9bee014dfe02 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:13.847067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4d847778-6d7e-4879-a1f7-9bee014dfe02 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:13.859817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4d847778-6d7e-4879-a1f7-9bee014dfe02 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.162968 Sep 13 20:20:13.860571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1135/2185] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:13 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:14.539995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d1bb0899-c729-4671-9b58-5c21fe0e4f81 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:14.540975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d1bb0899-c729-4671-9b58-5c21fe0e4f81 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:14.551919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1bb0899-c729-4671-9b58-5c21fe0e4f81 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:14.552409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1bb0899-c729-4671-9b58-5c21fe0e4f81 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:14.552847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1bb0899-c729-4671-9b58-5c21fe0e4f81 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:14.553512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1bb0899-c729-4671-9b58-5c21fe0e4f81 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:14.553997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1bb0899-c729-4671-9b58-5c21fe0e4f81 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:14.554423 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d1bb0899-c729-4671-9b58-5c21fe0e4f81 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:14.687403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1bb0899-c729-4671-9b58-5c21fe0e4f81 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:14.696268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1bb0899-c729-4671-9b58-5c21fe0e4f81 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:14.697708 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d1bb0899-c729-4671-9b58-5c21fe0e4f81 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:14.698899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d1bb0899-c729-4671-9b58-5c21fe0e4f81 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165654 Sep 13 20:20:14.699468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1051/2186] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:14.887253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-efc3985b-5562-4778-b156-a7eaa77eae4d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:14.887881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-efc3985b-5562-4778-b156-a7eaa77eae4d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:14.896357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efc3985b-5562-4778-b156-a7eaa77eae4d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:14.896950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efc3985b-5562-4778-b156-a7eaa77eae4d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:14.897484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efc3985b-5562-4778-b156-a7eaa77eae4d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:14.898333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efc3985b-5562-4778-b156-a7eaa77eae4d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:14.898941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efc3985b-5562-4778-b156-a7eaa77eae4d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:14.899467 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efc3985b-5562-4778-b156-a7eaa77eae4d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:14.902681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:20:14.906553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:20:14.906779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:20:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 (ip 10.222.0.52) !!! Sep 13 20:20:15.037197 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-efc3985b-5562-4778-b156-a7eaa77eae4d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:15.045910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-efc3985b-5562-4778-b156-a7eaa77eae4d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.163653 Sep 13 20:20:15.046550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1136/2187] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:14 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:15.725201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9f67bb1b-1f70-4a52-aa55-9a4bd346a5ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:15.725811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9f67bb1b-1f70-4a52-aa55-9a4bd346a5ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:15.733059 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f67bb1b-1f70-4a52-aa55-9a4bd346a5ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:15.733538 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f67bb1b-1f70-4a52-aa55-9a4bd346a5ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:15.733974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f67bb1b-1f70-4a52-aa55-9a4bd346a5ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:15.734688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f67bb1b-1f70-4a52-aa55-9a4bd346a5ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:15.735136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f67bb1b-1f70-4a52-aa55-9a4bd346a5ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:15.735558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f67bb1b-1f70-4a52-aa55-9a4bd346a5ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:15.876443 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9f67bb1b-1f70-4a52-aa55-9a4bd346a5ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:15.885655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9f67bb1b-1f70-4a52-aa55-9a4bd346a5ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:15.887128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9f67bb1b-1f70-4a52-aa55-9a4bd346a5ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:15.888256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9f67bb1b-1f70-4a52-aa55-9a4bd346a5ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167194 Sep 13 20:20:15.888809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1052/2188] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:16.073387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-53ba1daa-a2cc-421b-8ae4-6e5c66444662 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:16.074421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-53ba1daa-a2cc-421b-8ae4-6e5c66444662 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:16.084724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53ba1daa-a2cc-421b-8ae4-6e5c66444662 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:16.085201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53ba1daa-a2cc-421b-8ae4-6e5c66444662 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:16.085646 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53ba1daa-a2cc-421b-8ae4-6e5c66444662 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:16.086379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53ba1daa-a2cc-421b-8ae4-6e5c66444662 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:16.086829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53ba1daa-a2cc-421b-8ae4-6e5c66444662 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:16.087250 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53ba1daa-a2cc-421b-8ae4-6e5c66444662 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:16.225674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-53ba1daa-a2cc-421b-8ae4-6e5c66444662 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:16.238201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-53ba1daa-a2cc-421b-8ae4-6e5c66444662 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.171114 Sep 13 20:20:16.238997 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1137/2189] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:16 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:16.917908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f949a80b-7f10-4574-8c82-fb367fc7e8a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:16.918835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f949a80b-7f10-4574-8c82-fb367fc7e8a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:16.928679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f949a80b-7f10-4574-8c82-fb367fc7e8a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:16.929155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f949a80b-7f10-4574-8c82-fb367fc7e8a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:16.929582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f949a80b-7f10-4574-8c82-fb367fc7e8a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:16.930265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f949a80b-7f10-4574-8c82-fb367fc7e8a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:16.930742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f949a80b-7f10-4574-8c82-fb367fc7e8a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:16.931151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f949a80b-7f10-4574-8c82-fb367fc7e8a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:17.065002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f949a80b-7f10-4574-8c82-fb367fc7e8a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:17.074604 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f949a80b-7f10-4574-8c82-fb367fc7e8a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:17.076021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f949a80b-7f10-4574-8c82-fb367fc7e8a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:17.077199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f949a80b-7f10-4574-8c82-fb367fc7e8a7 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165984 Sep 13 20:20:17.077787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1053/2190] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:16 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:17.266263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-46714cfa-8d2b-4445-adb9-f5468225e474 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:17.267384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-46714cfa-8d2b-4445-adb9-f5468225e474 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:17.278228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46714cfa-8d2b-4445-adb9-f5468225e474 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:17.279067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46714cfa-8d2b-4445-adb9-f5468225e474 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:17.279784 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46714cfa-8d2b-4445-adb9-f5468225e474 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:17.280925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46714cfa-8d2b-4445-adb9-f5468225e474 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:17.281671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46714cfa-8d2b-4445-adb9-f5468225e474 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:17.282401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46714cfa-8d2b-4445-adb9-f5468225e474 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:17.417020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-46714cfa-8d2b-4445-adb9-f5468225e474 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:17.426008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-46714cfa-8d2b-4445-adb9-f5468225e474 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.166227 Sep 13 20:20:17.426670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1138/2191] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:17 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:18.107319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-17ff9ed4-012a-4a9b-b6ce-980c59217e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:18.108242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-17ff9ed4-012a-4a9b-b6ce-980c59217e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:18.119344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17ff9ed4-012a-4a9b-b6ce-980c59217e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:18.120140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17ff9ed4-012a-4a9b-b6ce-980c59217e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:18.120862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17ff9ed4-012a-4a9b-b6ce-980c59217e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:18.122002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17ff9ed4-012a-4a9b-b6ce-980c59217e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:18.122822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17ff9ed4-012a-4a9b-b6ce-980c59217e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:18.123529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-17ff9ed4-012a-4a9b-b6ce-980c59217e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:18.254133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-17ff9ed4-012a-4a9b-b6ce-980c59217e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:18.262945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-17ff9ed4-012a-4a9b-b6ce-980c59217e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:18.264390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-17ff9ed4-012a-4a9b-b6ce-980c59217e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:18.265553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-17ff9ed4-012a-4a9b-b6ce-980c59217e6c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.164938 Sep 13 20:20:18.266089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1054/2192] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:18.453517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8c74b383-caff-465d-8032-32d716a92f87 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:18.454502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8c74b383-caff-465d-8032-32d716a92f87 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:18.462786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c74b383-caff-465d-8032-32d716a92f87 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:18.463251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c74b383-caff-465d-8032-32d716a92f87 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:18.463675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c74b383-caff-465d-8032-32d716a92f87 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:18.464352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c74b383-caff-465d-8032-32d716a92f87 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:18.464795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c74b383-caff-465d-8032-32d716a92f87 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:18.465209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c74b383-caff-465d-8032-32d716a92f87 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:18.594891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8c74b383-caff-465d-8032-32d716a92f87 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:18.603276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8c74b383-caff-465d-8032-32d716a92f87 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.156365 Sep 13 20:20:18.603841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1139/2193] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:18 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:19.293667 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8a33385a-fc3e-4fe1-acaf-606b4e878e7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:19.294671 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8a33385a-fc3e-4fe1-acaf-606b4e878e7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:19.306021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a33385a-fc3e-4fe1-acaf-606b4e878e7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:19.306808 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a33385a-fc3e-4fe1-acaf-606b4e878e7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:19.307474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a33385a-fc3e-4fe1-acaf-606b4e878e7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:19.308511 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a33385a-fc3e-4fe1-acaf-606b4e878e7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:19.309210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a33385a-fc3e-4fe1-acaf-606b4e878e7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:19.309839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a33385a-fc3e-4fe1-acaf-606b4e878e7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:19.456381 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8a33385a-fc3e-4fe1-acaf-606b4e878e7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:19.469509 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8a33385a-fc3e-4fe1-acaf-606b4e878e7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:19.471670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8a33385a-fc3e-4fe1-acaf-606b4e878e7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:19.473387 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8a33385a-fc3e-4fe1-acaf-606b4e878e7f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.185633 Sep 13 20:20:19.474049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1055/2194] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:20:19.627200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-30dbb6d4-818d-4c0d-af03-911add2c794e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:19.627843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-30dbb6d4-818d-4c0d-af03-911add2c794e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:19.635247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30dbb6d4-818d-4c0d-af03-911add2c794e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:19.635726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30dbb6d4-818d-4c0d-af03-911add2c794e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:19.636161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30dbb6d4-818d-4c0d-af03-911add2c794e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:19.636840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30dbb6d4-818d-4c0d-af03-911add2c794e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:19.637291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30dbb6d4-818d-4c0d-af03-911add2c794e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:19.637707 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-30dbb6d4-818d-4c0d-af03-911add2c794e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:19.781872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-30dbb6d4-818d-4c0d-af03-911add2c794e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:19.790874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-30dbb6d4-818d-4c0d-af03-911add2c794e tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167749 Sep 13 20:20:19.791492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1140/2195] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:19 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:20.503129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2f8581c7-37ea-4917-9f87-37d5d46b70c5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:20.504227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2f8581c7-37ea-4917-9f87-37d5d46b70c5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:20.515001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2f8581c7-37ea-4917-9f87-37d5d46b70c5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:20.515798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2f8581c7-37ea-4917-9f87-37d5d46b70c5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:20.516520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2f8581c7-37ea-4917-9f87-37d5d46b70c5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:20.517652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2f8581c7-37ea-4917-9f87-37d5d46b70c5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:20.518449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2f8581c7-37ea-4917-9f87-37d5d46b70c5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:20.519156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2f8581c7-37ea-4917-9f87-37d5d46b70c5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:20.658159 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2f8581c7-37ea-4917-9f87-37d5d46b70c5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:20.667338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2f8581c7-37ea-4917-9f87-37d5d46b70c5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:20.668789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2f8581c7-37ea-4917-9f87-37d5d46b70c5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:20.669951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2f8581c7-37ea-4917-9f87-37d5d46b70c5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173592 Sep 13 20:20:20.670532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1056/2196] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:20.818444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cc5e6c2e-f17f-4903-8197-fd9003e4ffe3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:20.819106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cc5e6c2e-f17f-4903-8197-fd9003e4ffe3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:20.827403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc5e6c2e-f17f-4903-8197-fd9003e4ffe3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:20.827991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc5e6c2e-f17f-4903-8197-fd9003e4ffe3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:20.828515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc5e6c2e-f17f-4903-8197-fd9003e4ffe3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:20.829351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc5e6c2e-f17f-4903-8197-fd9003e4ffe3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:20.829894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc5e6c2e-f17f-4903-8197-fd9003e4ffe3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:20.830816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc5e6c2e-f17f-4903-8197-fd9003e4ffe3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:20.975760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cc5e6c2e-f17f-4903-8197-fd9003e4ffe3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:20.984518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cc5e6c2e-f17f-4903-8197-fd9003e4ffe3 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.172490 Sep 13 20:20:20.985101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1141/2197] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:20 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:21.699920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2a0efbee-036c-4789-9a19-9060760891dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:21.700921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2a0efbee-036c-4789-9a19-9060760891dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:21.712274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a0efbee-036c-4789-9a19-9060760891dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:21.713055 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a0efbee-036c-4789-9a19-9060760891dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:21.713776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a0efbee-036c-4789-9a19-9060760891dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:21.714984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a0efbee-036c-4789-9a19-9060760891dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:21.715741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a0efbee-036c-4789-9a19-9060760891dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:21.716444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a0efbee-036c-4789-9a19-9060760891dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:21.855729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2a0efbee-036c-4789-9a19-9060760891dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:21.857967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:20:21.865498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2a0efbee-036c-4789-9a19-9060760891dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:21.866995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2a0efbee-036c-4789-9a19-9060760891dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:21.868131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2a0efbee-036c-4789-9a19-9060760891dc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.174812 Sep 13 20:20:21.868702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1057/2198] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:22.012180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-74269ab2-1d5a-4f01-9e89-f7a2c7a30dcd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:22.013149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-74269ab2-1d5a-4f01-9e89-f7a2c7a30dcd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:22.022807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74269ab2-1d5a-4f01-9e89-f7a2c7a30dcd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:22.023288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74269ab2-1d5a-4f01-9e89-f7a2c7a30dcd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:22.023720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74269ab2-1d5a-4f01-9e89-f7a2c7a30dcd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:22.024407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74269ab2-1d5a-4f01-9e89-f7a2c7a30dcd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:22.024887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74269ab2-1d5a-4f01-9e89-f7a2c7a30dcd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:22.025308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74269ab2-1d5a-4f01-9e89-f7a2c7a30dcd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:22.156188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-74269ab2-1d5a-4f01-9e89-f7a2c7a30dcd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:22.164720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-74269ab2-1d5a-4f01-9e89-f7a2c7a30dcd tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.159567 Sep 13 20:20:22.165268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1142/2199] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:22 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:22.898037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d983c78b-a663-4746-9395-a9371880dc79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:22.898875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d983c78b-a663-4746-9395-a9371880dc79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:22.907300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d983c78b-a663-4746-9395-a9371880dc79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:22.907937 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d983c78b-a663-4746-9395-a9371880dc79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:22.908519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d983c78b-a663-4746-9395-a9371880dc79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:22.909432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d983c78b-a663-4746-9395-a9371880dc79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:22.910037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d983c78b-a663-4746-9395-a9371880dc79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:22.910652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d983c78b-a663-4746-9395-a9371880dc79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:23.046912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d983c78b-a663-4746-9395-a9371880dc79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:23.060527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d983c78b-a663-4746-9395-a9371880dc79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:23.062804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d983c78b-a663-4746-9395-a9371880dc79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:23.064522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d983c78b-a663-4746-9395-a9371880dc79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172939 Sep 13 20:20:23.065309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1058/2200] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:22 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:23.187235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-17d65435-5ad6-45ed-8ef2-4581964bc141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:23.187839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-17d65435-5ad6-45ed-8ef2-4581964bc141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:23.194930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d65435-5ad6-45ed-8ef2-4581964bc141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:23.195461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d65435-5ad6-45ed-8ef2-4581964bc141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:23.195918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d65435-5ad6-45ed-8ef2-4581964bc141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:23.196607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d65435-5ad6-45ed-8ef2-4581964bc141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:23.197053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d65435-5ad6-45ed-8ef2-4581964bc141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:23.197475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-17d65435-5ad6-45ed-8ef2-4581964bc141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:23.326986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-17d65435-5ad6-45ed-8ef2-4581964bc141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:23.336230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-17d65435-5ad6-45ed-8ef2-4581964bc141 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.152945 Sep 13 20:20:23.336804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1143/2201] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:23 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:24.095579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dda6d8ca-9fc0-4fa4-a18a-c2f9596f02ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:24.096542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dda6d8ca-9fc0-4fa4-a18a-c2f9596f02ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:24.104473 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dda6d8ca-9fc0-4fa4-a18a-c2f9596f02ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:24.104953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dda6d8ca-9fc0-4fa4-a18a-c2f9596f02ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:24.105391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dda6d8ca-9fc0-4fa4-a18a-c2f9596f02ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:24.106080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dda6d8ca-9fc0-4fa4-a18a-c2f9596f02ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:24.106575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dda6d8ca-9fc0-4fa4-a18a-c2f9596f02ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:24.106999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dda6d8ca-9fc0-4fa4-a18a-c2f9596f02ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:24.239997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dda6d8ca-9fc0-4fa4-a18a-c2f9596f02ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:24.248823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dda6d8ca-9fc0-4fa4-a18a-c2f9596f02ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:24.250268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dda6d8ca-9fc0-4fa4-a18a-c2f9596f02ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:24.251472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dda6d8ca-9fc0-4fa4-a18a-c2f9596f02ee tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162754 Sep 13 20:20:24.252028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1059/2202] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:24.363742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8d55b2a6-b3f8-4fc8-93c5-6ace6a7af2d8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:24.364603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8d55b2a6-b3f8-4fc8-93c5-6ace6a7af2d8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:24.373585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d55b2a6-b3f8-4fc8-93c5-6ace6a7af2d8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:24.374264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d55b2a6-b3f8-4fc8-93c5-6ace6a7af2d8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:24.374881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d55b2a6-b3f8-4fc8-93c5-6ace6a7af2d8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:24.375796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d55b2a6-b3f8-4fc8-93c5-6ace6a7af2d8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:24.376393 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d55b2a6-b3f8-4fc8-93c5-6ace6a7af2d8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:24.376961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d55b2a6-b3f8-4fc8-93c5-6ace6a7af2d8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:24.518655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8d55b2a6-b3f8-4fc8-93c5-6ace6a7af2d8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:24.527517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8d55b2a6-b3f8-4fc8-93c5-6ace6a7af2d8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.170467 Sep 13 20:20:24.528095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1144/2203] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:24 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:25.277630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8a741356-4f24-481b-8c94-ee85ad694978 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:25.278307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8a741356-4f24-481b-8c94-ee85ad694978 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:25.284989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a741356-4f24-481b-8c94-ee85ad694978 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:25.285441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a741356-4f24-481b-8c94-ee85ad694978 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:25.285936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a741356-4f24-481b-8c94-ee85ad694978 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:25.286799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a741356-4f24-481b-8c94-ee85ad694978 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:25.287088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a741356-4f24-481b-8c94-ee85ad694978 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:25.287514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a741356-4f24-481b-8c94-ee85ad694978 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:25.438170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8a741356-4f24-481b-8c94-ee85ad694978 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:25.447160 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8a741356-4f24-481b-8c94-ee85ad694978 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:25.448610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8a741356-4f24-481b-8c94-ee85ad694978 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:25.449764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8a741356-4f24-481b-8c94-ee85ad694978 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.176275 Sep 13 20:20:25.450331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1060/2204] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:25.557623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-466afec5-75a9-4539-9677-0291893a4b82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:25.558510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-466afec5-75a9-4539-9677-0291893a4b82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:25.568842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-466afec5-75a9-4539-9677-0291893a4b82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:25.569326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-466afec5-75a9-4539-9677-0291893a4b82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:25.569755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-466afec5-75a9-4539-9677-0291893a4b82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:25.570477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-466afec5-75a9-4539-9677-0291893a4b82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:25.570926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-466afec5-75a9-4539-9677-0291893a4b82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:25.571346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-466afec5-75a9-4539-9677-0291893a4b82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:25.699218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-466afec5-75a9-4539-9677-0291893a4b82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:25.709814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-466afec5-75a9-4539-9677-0291893a4b82 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.159061 Sep 13 20:20:25.710452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1145/2205] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:25 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:26.478674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2228de98-b6fb-4c63-8435-6ec096220787 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:26.479649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2228de98-b6fb-4c63-8435-6ec096220787 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:26.489998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2228de98-b6fb-4c63-8435-6ec096220787 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:26.490507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2228de98-b6fb-4c63-8435-6ec096220787 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:26.490933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2228de98-b6fb-4c63-8435-6ec096220787 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:26.491611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2228de98-b6fb-4c63-8435-6ec096220787 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:26.492054 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2228de98-b6fb-4c63-8435-6ec096220787 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:26.492465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2228de98-b6fb-4c63-8435-6ec096220787 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:26.631461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2228de98-b6fb-4c63-8435-6ec096220787 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:26.640492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2228de98-b6fb-4c63-8435-6ec096220787 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:26.641928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2228de98-b6fb-4c63-8435-6ec096220787 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:26.643116 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2228de98-b6fb-4c63-8435-6ec096220787 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.170114 Sep 13 20:20:26.643646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1061/2206] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:26.737383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f6c3fcaa-5047-4d01-8f4b-d5c761f7eea7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:26.738420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f6c3fcaa-5047-4d01-8f4b-d5c761f7eea7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:26.745596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f6c3fcaa-5047-4d01-8f4b-d5c761f7eea7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:26.746070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f6c3fcaa-5047-4d01-8f4b-d5c761f7eea7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:26.746529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f6c3fcaa-5047-4d01-8f4b-d5c761f7eea7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:26.747214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f6c3fcaa-5047-4d01-8f4b-d5c761f7eea7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:26.747657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f6c3fcaa-5047-4d01-8f4b-d5c761f7eea7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:26.748072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f6c3fcaa-5047-4d01-8f4b-d5c761f7eea7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:26.889593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f6c3fcaa-5047-4d01-8f4b-d5c761f7eea7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:26.898167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f6c3fcaa-5047-4d01-8f4b-d5c761f7eea7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.167401 Sep 13 20:20:26.898773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1146/2207] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:26 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:27.670994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-62bb9580-4406-4b17-bae7-f08f718af8cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:27.671621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-62bb9580-4406-4b17-bae7-f08f718af8cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:27.681637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-62bb9580-4406-4b17-bae7-f08f718af8cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:27.682291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-62bb9580-4406-4b17-bae7-f08f718af8cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:27.682947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-62bb9580-4406-4b17-bae7-f08f718af8cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:27.683945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-62bb9580-4406-4b17-bae7-f08f718af8cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:27.684406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-62bb9580-4406-4b17-bae7-f08f718af8cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:27.684940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-62bb9580-4406-4b17-bae7-f08f718af8cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:27.829517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-62bb9580-4406-4b17-bae7-f08f718af8cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:27.843547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-62bb9580-4406-4b17-bae7-f08f718af8cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:27.845847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-62bb9580-4406-4b17-bae7-f08f718af8cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:27.847691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-62bb9580-4406-4b17-bae7-f08f718af8cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.182370 Sep 13 20:20:27.848561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1062/2208] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:27 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:27.925574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-91d5cc29-d4f2-48c1-98ec-ac8a423771b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:27.926614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-91d5cc29-d4f2-48c1-98ec-ac8a423771b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:27.933333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91d5cc29-d4f2-48c1-98ec-ac8a423771b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:27.933806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91d5cc29-d4f2-48c1-98ec-ac8a423771b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:27.934229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91d5cc29-d4f2-48c1-98ec-ac8a423771b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:27.934943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91d5cc29-d4f2-48c1-98ec-ac8a423771b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:27.935384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91d5cc29-d4f2-48c1-98ec-ac8a423771b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:27.935798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91d5cc29-d4f2-48c1-98ec-ac8a423771b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:28.074816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-91d5cc29-d4f2-48c1-98ec-ac8a423771b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:28.083870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-91d5cc29-d4f2-48c1-98ec-ac8a423771b4 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.164937 Sep 13 20:20:28.084339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1147/2209] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:27 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:28.888876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-12ae0dad-af7e-46d9-b329-50f304836fd9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:28.889776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-12ae0dad-af7e-46d9-b329-50f304836fd9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:28.898721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12ae0dad-af7e-46d9-b329-50f304836fd9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:28.899193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12ae0dad-af7e-46d9-b329-50f304836fd9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:28.899625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12ae0dad-af7e-46d9-b329-50f304836fd9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:28.900304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12ae0dad-af7e-46d9-b329-50f304836fd9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:28.900744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12ae0dad-af7e-46d9-b329-50f304836fd9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:28.901166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12ae0dad-af7e-46d9-b329-50f304836fd9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:29.044951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-12ae0dad-af7e-46d9-b329-50f304836fd9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:29.058636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-12ae0dad-af7e-46d9-b329-50f304836fd9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:29.060525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-12ae0dad-af7e-46d9-b329-50f304836fd9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:29.062321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-12ae0dad-af7e-46d9-b329-50f304836fd9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.179780 Sep 13 20:20:29.063162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1063/2210] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:29.107887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1368c04c-d123-4de0-b9ce-c23d1efbe5e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:29.108458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1368c04c-d123-4de0-b9ce-c23d1efbe5e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:29.115702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1368c04c-d123-4de0-b9ce-c23d1efbe5e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:29.116183 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1368c04c-d123-4de0-b9ce-c23d1efbe5e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:29.116612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1368c04c-d123-4de0-b9ce-c23d1efbe5e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:29.117264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1368c04c-d123-4de0-b9ce-c23d1efbe5e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:29.117711 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1368c04c-d123-4de0-b9ce-c23d1efbe5e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:29.118129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1368c04c-d123-4de0-b9ce-c23d1efbe5e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:29.249520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1368c04c-d123-4de0-b9ce-c23d1efbe5e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:29.258230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1368c04c-d123-4de0-b9ce-c23d1efbe5e8 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.154347 Sep 13 20:20:29.258826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1148/2211] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:29 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:30.094085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-00d212e3-15ec-4c69-a87a-dac85e42a91d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:30.094914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-00d212e3-15ec-4c69-a87a-dac85e42a91d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:30.103292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00d212e3-15ec-4c69-a87a-dac85e42a91d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:30.103771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00d212e3-15ec-4c69-a87a-dac85e42a91d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:30.104208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00d212e3-15ec-4c69-a87a-dac85e42a91d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:30.104877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00d212e3-15ec-4c69-a87a-dac85e42a91d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:30.105328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00d212e3-15ec-4c69-a87a-dac85e42a91d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:30.105739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-00d212e3-15ec-4c69-a87a-dac85e42a91d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:30.245777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-00d212e3-15ec-4c69-a87a-dac85e42a91d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:30.258194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-00d212e3-15ec-4c69-a87a-dac85e42a91d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:30.260612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-00d212e3-15ec-4c69-a87a-dac85e42a91d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:30.262530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-00d212e3-15ec-4c69-a87a-dac85e42a91d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.174688 Sep 13 20:20:30.263477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1064/2212] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:30 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:30.281305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e730d618-3c2d-47fd-8843-169af2dbd3ce tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:30.281923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e730d618-3c2d-47fd-8843-169af2dbd3ce tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:30.288834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e730d618-3c2d-47fd-8843-169af2dbd3ce tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:30.289309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e730d618-3c2d-47fd-8843-169af2dbd3ce tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:30.289739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e730d618-3c2d-47fd-8843-169af2dbd3ce tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:30.290423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e730d618-3c2d-47fd-8843-169af2dbd3ce tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:30.290903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e730d618-3c2d-47fd-8843-169af2dbd3ce tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:30.291323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e730d618-3c2d-47fd-8843-169af2dbd3ce tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:30.420879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e730d618-3c2d-47fd-8843-169af2dbd3ce tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:30.429351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e730d618-3c2d-47fd-8843-169af2dbd3ce tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.151883 Sep 13 20:20:30.429941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1149/2213] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:30 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:31.296067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5a7c76d6-a25f-45fe-8bbf-8e13fb668c92 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:31.297057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5a7c76d6-a25f-45fe-8bbf-8e13fb668c92 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:31.307971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a7c76d6-a25f-45fe-8bbf-8e13fb668c92 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:31.308771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a7c76d6-a25f-45fe-8bbf-8e13fb668c92 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:31.309497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a7c76d6-a25f-45fe-8bbf-8e13fb668c92 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:31.310692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a7c76d6-a25f-45fe-8bbf-8e13fb668c92 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:31.311445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a7c76d6-a25f-45fe-8bbf-8e13fb668c92 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:31.312154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5a7c76d6-a25f-45fe-8bbf-8e13fb668c92 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:31.448917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5a7c76d6-a25f-45fe-8bbf-8e13fb668c92 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:31.453192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4dc1d02c-bade-4bf0-b362-6ebef62883d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:31.453796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4dc1d02c-bade-4bf0-b362-6ebef62883d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:31.458280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5a7c76d6-a25f-45fe-8bbf-8e13fb668c92 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:31.459820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5a7c76d6-a25f-45fe-8bbf-8e13fb668c92 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:31.460638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dc1d02c-bade-4bf0-b362-6ebef62883d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:31.461024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5a7c76d6-a25f-45fe-8bbf-8e13fb668c92 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.171581 Sep 13 20:20:31.461178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dc1d02c-bade-4bf0-b362-6ebef62883d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:31.461482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dc1d02c-bade-4bf0-b362-6ebef62883d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:31.461641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1065/2214] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:31.462198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dc1d02c-bade-4bf0-b362-6ebef62883d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:31.462662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dc1d02c-bade-4bf0-b362-6ebef62883d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:31.463057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4dc1d02c-bade-4bf0-b362-6ebef62883d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:31.591266 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4dc1d02c-bade-4bf0-b362-6ebef62883d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:31.599687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4dc1d02c-bade-4bf0-b362-6ebef62883d9 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.150704 Sep 13 20:20:31.600369 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1150/2215] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:31 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:32.490843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-62eb92ed-b838-47c2-bf74-d3b6ecd7a080 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:32.491656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-62eb92ed-b838-47c2-bf74-d3b6ecd7a080 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:32.501422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-62eb92ed-b838-47c2-bf74-d3b6ecd7a080 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:32.502168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-62eb92ed-b838-47c2-bf74-d3b6ecd7a080 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:32.502923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-62eb92ed-b838-47c2-bf74-d3b6ecd7a080 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:32.503989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-62eb92ed-b838-47c2-bf74-d3b6ecd7a080 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:32.504717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-62eb92ed-b838-47c2-bf74-d3b6ecd7a080 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:32.505366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-62eb92ed-b838-47c2-bf74-d3b6ecd7a080 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:32.623108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d6c632eb-33c1-4537-abe1-ca44790347f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:32.624333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d6c632eb-33c1-4537-abe1-ca44790347f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:32.631088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6c632eb-33c1-4537-abe1-ca44790347f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:32.631564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6c632eb-33c1-4537-abe1-ca44790347f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:32.631988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6c632eb-33c1-4537-abe1-ca44790347f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:32.632661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6c632eb-33c1-4537-abe1-ca44790347f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:32.633122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6c632eb-33c1-4537-abe1-ca44790347f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:32.633540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d6c632eb-33c1-4537-abe1-ca44790347f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:32.642401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-62eb92ed-b838-47c2-bf74-d3b6ecd7a080 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:32.651808 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-62eb92ed-b838-47c2-bf74-d3b6ecd7a080 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:32.653237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-62eb92ed-b838-47c2-bf74-d3b6ecd7a080 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:32.654462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-62eb92ed-b838-47c2-bf74-d3b6ecd7a080 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.170295 Sep 13 20:20:32.654966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1066/2216] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:32.769218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d6c632eb-33c1-4537-abe1-ca44790347f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:32.777975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d6c632eb-33c1-4537-abe1-ca44790347f6 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.158739 Sep 13 20:20:32.778675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1151/2217] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:32 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:33.684339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-eba41348-afef-430e-8aff-55ed41cd1c51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:33.685368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-eba41348-afef-430e-8aff-55ed41cd1c51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:33.695289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eba41348-afef-430e-8aff-55ed41cd1c51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:33.695758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eba41348-afef-430e-8aff-55ed41cd1c51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:33.696186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eba41348-afef-430e-8aff-55ed41cd1c51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:33.696861 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eba41348-afef-430e-8aff-55ed41cd1c51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:33.697298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eba41348-afef-430e-8aff-55ed41cd1c51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:33.697707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eba41348-afef-430e-8aff-55ed41cd1c51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:33.814803 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-164875a1-3993-4cd1-8191-c59f11f7460d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:33.815425 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-164875a1-3993-4cd1-8191-c59f11f7460d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:33.822042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-164875a1-3993-4cd1-8191-c59f11f7460d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:33.822625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-164875a1-3993-4cd1-8191-c59f11f7460d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:33.822980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-164875a1-3993-4cd1-8191-c59f11f7460d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:33.823735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-164875a1-3993-4cd1-8191-c59f11f7460d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:33.824113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-164875a1-3993-4cd1-8191-c59f11f7460d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:33.824531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-164875a1-3993-4cd1-8191-c59f11f7460d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:33.839148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eba41348-afef-430e-8aff-55ed41cd1c51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:33.847926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eba41348-afef-430e-8aff-55ed41cd1c51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:33.849357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eba41348-afef-430e-8aff-55ed41cd1c51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:33.850640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-eba41348-afef-430e-8aff-55ed41cd1c51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173257 Sep 13 20:20:33.851359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1067/2218] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:33.965041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-164875a1-3993-4cd1-8191-c59f11f7460d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:33.968622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:20:33.980206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-164875a1-3993-4cd1-8191-c59f11f7460d tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.182730 Sep 13 20:20:33.981023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1152/2219] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:33 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:20:34.877099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a3958c0d-5bfd-4568-bd20-97a441e107e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:34.877831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a3958c0d-5bfd-4568-bd20-97a441e107e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:34.885196 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3958c0d-5bfd-4568-bd20-97a441e107e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:34.885911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3958c0d-5bfd-4568-bd20-97a441e107e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:34.886353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3958c0d-5bfd-4568-bd20-97a441e107e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:34.887104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3958c0d-5bfd-4568-bd20-97a441e107e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:34.887573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3958c0d-5bfd-4568-bd20-97a441e107e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:34.888134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3958c0d-5bfd-4568-bd20-97a441e107e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:35.007258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-866fe8d7-fc92-4f06-a888-5fba5214dfa7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:35.007953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-866fe8d7-fc92-4f06-a888-5fba5214dfa7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] [instance: de498757-f0f1-4f8b-a415-4d6b12f64d37] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:35.015035 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-866fe8d7-fc92-4f06-a888-5fba5214dfa7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:35.015548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-866fe8d7-fc92-4f06-a888-5fba5214dfa7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:35.015979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-866fe8d7-fc92-4f06-a888-5fba5214dfa7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:35.016667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-866fe8d7-fc92-4f06-a888-5fba5214dfa7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:35.017113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-866fe8d7-fc92-4f06-a888-5fba5214dfa7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:35.017530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-866fe8d7-fc92-4f06-a888-5fba5214dfa7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:35.021684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a3958c0d-5bfd-4568-bd20-97a441e107e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:35.030793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a3958c0d-5bfd-4568-bd20-97a441e107e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:35.032247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a3958c0d-5bfd-4568-bd20-97a441e107e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:35.033400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a3958c0d-5bfd-4568-bd20-97a441e107e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161053 Sep 13 20:20:35.033984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1068/2220] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:34 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:35.145134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-866fe8d7-fc92-4f06-a888-5fba5214dfa7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c17f29c73f643ca83a08f4e44e6279b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a89bb1e9c24a3d8ee45633959e59ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:35.157928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-866fe8d7-fc92-4f06-a888-5fba5214dfa7 tempest-VolumesSnapshotTestJSON-1674542736 tempest-VolumesSnapshotTestJSON-1674542736-project] 10.222.0.52 "GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37" status: 200 len: 1559 microversion: 2.1 time: 0.154288 Sep 13 20:20:35.158828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1153/2221] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:20:35 2022] GET /compute/v2.1/servers/de498757-f0f1-4f8b-a415-4d6b12f64d37 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:20:36.059183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2dba565c-9439-44db-99c8-36ab22b6b3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:36.059764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2dba565c-9439-44db-99c8-36ab22b6b3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:36.062444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=52 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:20:36.068882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2dba565c-9439-44db-99c8-36ab22b6b3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:36.069426 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2dba565c-9439-44db-99c8-36ab22b6b3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:36.069920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2dba565c-9439-44db-99c8-36ab22b6b3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:36.070727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2dba565c-9439-44db-99c8-36ab22b6b3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:36.071256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2dba565c-9439-44db-99c8-36ab22b6b3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:36.071752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2dba565c-9439-44db-99c8-36ab22b6b3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:36.209203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2dba565c-9439-44db-99c8-36ab22b6b3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:36.218349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2dba565c-9439-44db-99c8-36ab22b6b3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:36.219800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2dba565c-9439-44db-99c8-36ab22b6b3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:36.220953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2dba565c-9439-44db-99c8-36ab22b6b3f8 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166461 Sep 13 20:20:36.221542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1069/2222] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:37.250681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c918cc17-3376-4269-ae2d-d183fb4c0d3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:37.251659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c918cc17-3376-4269-ae2d-d183fb4c0d3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:37.255418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=50 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:20:37.262282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c918cc17-3376-4269-ae2d-d183fb4c0d3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:37.262941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c918cc17-3376-4269-ae2d-d183fb4c0d3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:37.263370 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c918cc17-3376-4269-ae2d-d183fb4c0d3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:37.264055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c918cc17-3376-4269-ae2d-d183fb4c0d3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:37.264497 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c918cc17-3376-4269-ae2d-d183fb4c0d3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:37.264918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c918cc17-3376-4269-ae2d-d183fb4c0d3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:37.410229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c918cc17-3376-4269-ae2d-d183fb4c0d3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:37.419469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c918cc17-3376-4269-ae2d-d183fb4c0d3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:37.420946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c918cc17-3376-4269-ae2d-d183fb4c0d3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:37.422118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c918cc17-3376-4269-ae2d-d183fb4c0d3a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.178125 Sep 13 20:20:37.422725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1154/2223] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:38.449014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a6a3a1e9-41c5-4b4e-8738-8a65fb059ddf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:38.449744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a6a3a1e9-41c5-4b4e-8738-8a65fb059ddf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:38.457170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6a3a1e9-41c5-4b4e-8738-8a65fb059ddf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:38.457654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6a3a1e9-41c5-4b4e-8738-8a65fb059ddf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:38.458090 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6a3a1e9-41c5-4b4e-8738-8a65fb059ddf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:38.458816 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6a3a1e9-41c5-4b4e-8738-8a65fb059ddf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:38.459263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6a3a1e9-41c5-4b4e-8738-8a65fb059ddf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:38.459687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6a3a1e9-41c5-4b4e-8738-8a65fb059ddf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:38.673518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a6a3a1e9-41c5-4b4e-8738-8a65fb059ddf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:38.684078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a6a3a1e9-41c5-4b4e-8738-8a65fb059ddf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:38.685534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a6a3a1e9-41c5-4b4e-8738-8a65fb059ddf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:38.686737 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a6a3a1e9-41c5-4b4e-8738-8a65fb059ddf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.243333 Sep 13 20:20:38.687298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1070/2224] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:39.716442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c6628581-d5cb-4ec5-b4ee-16c56f83b995 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:39.717426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c6628581-d5cb-4ec5-b4ee-16c56f83b995 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:39.728633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c6628581-d5cb-4ec5-b4ee-16c56f83b995 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:39.729114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c6628581-d5cb-4ec5-b4ee-16c56f83b995 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:39.729539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c6628581-d5cb-4ec5-b4ee-16c56f83b995 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:39.730215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c6628581-d5cb-4ec5-b4ee-16c56f83b995 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:39.730681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c6628581-d5cb-4ec5-b4ee-16c56f83b995 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:39.731093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c6628581-d5cb-4ec5-b4ee-16c56f83b995 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:39.865958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c6628581-d5cb-4ec5-b4ee-16c56f83b995 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:39.875286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c6628581-d5cb-4ec5-b4ee-16c56f83b995 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:39.876726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c6628581-d5cb-4ec5-b4ee-16c56f83b995 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:39.877892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c6628581-d5cb-4ec5-b4ee-16c56f83b995 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168056 Sep 13 20:20:39.878671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1155/2225] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:40.902699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4a0568e8-b44e-4f51-9193-2dc019b3dc3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:40.903300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4a0568e8-b44e-4f51-9193-2dc019b3dc3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:40.910071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a0568e8-b44e-4f51-9193-2dc019b3dc3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:40.910623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a0568e8-b44e-4f51-9193-2dc019b3dc3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:40.911041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a0568e8-b44e-4f51-9193-2dc019b3dc3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:40.911731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a0568e8-b44e-4f51-9193-2dc019b3dc3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:40.912161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a0568e8-b44e-4f51-9193-2dc019b3dc3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:40.912593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4a0568e8-b44e-4f51-9193-2dc019b3dc3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:41.047044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4a0568e8-b44e-4f51-9193-2dc019b3dc3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:41.056107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4a0568e8-b44e-4f51-9193-2dc019b3dc3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:41.057618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4a0568e8-b44e-4f51-9193-2dc019b3dc3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:41.058824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4a0568e8-b44e-4f51-9193-2dc019b3dc3f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159996 Sep 13 20:20:41.059385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1071/2226] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:42.087316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a9e9ed6f-89b3-45cb-b43a-05325e16e3d2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:42.088365 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a9e9ed6f-89b3-45cb-b43a-05325e16e3d2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:42.095353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9e9ed6f-89b3-45cb-b43a-05325e16e3d2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:42.095836 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9e9ed6f-89b3-45cb-b43a-05325e16e3d2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:42.096270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9e9ed6f-89b3-45cb-b43a-05325e16e3d2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:42.096959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9e9ed6f-89b3-45cb-b43a-05325e16e3d2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:42.097410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9e9ed6f-89b3-45cb-b43a-05325e16e3d2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:42.097813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a9e9ed6f-89b3-45cb-b43a-05325e16e3d2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:42.228349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a9e9ed6f-89b3-45cb-b43a-05325e16e3d2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:42.237085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a9e9ed6f-89b3-45cb-b43a-05325e16e3d2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:42.238558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a9e9ed6f-89b3-45cb-b43a-05325e16e3d2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:42.239723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a9e9ed6f-89b3-45cb-b43a-05325e16e3d2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.157822 Sep 13 20:20:42.240322 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1156/2227] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:43.269891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-13a95c40-4a55-41ee-ad99-c06cef06c890 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:43.270824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-13a95c40-4a55-41ee-ad99-c06cef06c890 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:43.282075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-13a95c40-4a55-41ee-ad99-c06cef06c890 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:43.282886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-13a95c40-4a55-41ee-ad99-c06cef06c890 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:43.283676 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-13a95c40-4a55-41ee-ad99-c06cef06c890 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:43.284827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-13a95c40-4a55-41ee-ad99-c06cef06c890 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:43.285569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-13a95c40-4a55-41ee-ad99-c06cef06c890 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:43.286279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-13a95c40-4a55-41ee-ad99-c06cef06c890 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:43.419189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-13a95c40-4a55-41ee-ad99-c06cef06c890 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:43.428971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-13a95c40-4a55-41ee-ad99-c06cef06c890 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:43.430447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-13a95c40-4a55-41ee-ad99-c06cef06c890 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:43.431623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-13a95c40-4a55-41ee-ad99-c06cef06c890 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.168519 Sep 13 20:20:43.432365 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1072/2228] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:44.461567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8af6e1c0-8982-49cb-b95b-6913026a8345 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:44.462693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8af6e1c0-8982-49cb-b95b-6913026a8345 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:44.469440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8af6e1c0-8982-49cb-b95b-6913026a8345 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:44.469949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8af6e1c0-8982-49cb-b95b-6913026a8345 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:44.470407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8af6e1c0-8982-49cb-b95b-6913026a8345 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:44.471108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8af6e1c0-8982-49cb-b95b-6913026a8345 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:44.471548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8af6e1c0-8982-49cb-b95b-6913026a8345 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:44.471956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8af6e1c0-8982-49cb-b95b-6913026a8345 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:44.609442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8af6e1c0-8982-49cb-b95b-6913026a8345 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:44.618589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8af6e1c0-8982-49cb-b95b-6913026a8345 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:44.620143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8af6e1c0-8982-49cb-b95b-6913026a8345 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:44.621332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8af6e1c0-8982-49cb-b95b-6913026a8345 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166779 Sep 13 20:20:44.621893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1157/2229] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:45.647031 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d9d6e82c-0ae0-487b-b1e6-02d9e65ce284 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:45.647626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d9d6e82c-0ae0-487b-b1e6-02d9e65ce284 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:45.654589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d9d6e82c-0ae0-487b-b1e6-02d9e65ce284 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:45.655063 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d9d6e82c-0ae0-487b-b1e6-02d9e65ce284 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:45.655469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d9d6e82c-0ae0-487b-b1e6-02d9e65ce284 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:45.656215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d9d6e82c-0ae0-487b-b1e6-02d9e65ce284 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:45.656661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d9d6e82c-0ae0-487b-b1e6-02d9e65ce284 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:45.657073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d9d6e82c-0ae0-487b-b1e6-02d9e65ce284 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:45.793924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d9d6e82c-0ae0-487b-b1e6-02d9e65ce284 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:45.807227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d9d6e82c-0ae0-487b-b1e6-02d9e65ce284 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:45.809119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d9d6e82c-0ae0-487b-b1e6-02d9e65ce284 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:45.810897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d9d6e82c-0ae0-487b-b1e6-02d9e65ce284 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167561 Sep 13 20:20:45.811662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1073/2230] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:46.846639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c9f74ee0-6d6e-4ba2-a47a-106ca407918c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:46.847545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c9f74ee0-6d6e-4ba2-a47a-106ca407918c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:46.857317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9f74ee0-6d6e-4ba2-a47a-106ca407918c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:46.857804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9f74ee0-6d6e-4ba2-a47a-106ca407918c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:46.858233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9f74ee0-6d6e-4ba2-a47a-106ca407918c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:46.858956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9f74ee0-6d6e-4ba2-a47a-106ca407918c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:46.859438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9f74ee0-6d6e-4ba2-a47a-106ca407918c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:46.859858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9f74ee0-6d6e-4ba2-a47a-106ca407918c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:46.988260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c9f74ee0-6d6e-4ba2-a47a-106ca407918c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:46.998006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c9f74ee0-6d6e-4ba2-a47a-106ca407918c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:46.999492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c9f74ee0-6d6e-4ba2-a47a-106ca407918c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:47.000656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c9f74ee0-6d6e-4ba2-a47a-106ca407918c tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.160634 Sep 13 20:20:47.001218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1158/2231] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:48.030457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3ba621e2-fd8e-4dfa-a7f0-35095d1fcece tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:48.031462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3ba621e2-fd8e-4dfa-a7f0-35095d1fcece tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:48.043398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ba621e2-fd8e-4dfa-a7f0-35095d1fcece tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:48.043876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ba621e2-fd8e-4dfa-a7f0-35095d1fcece tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:48.044316 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ba621e2-fd8e-4dfa-a7f0-35095d1fcece tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:48.045004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ba621e2-fd8e-4dfa-a7f0-35095d1fcece tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:48.045453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ba621e2-fd8e-4dfa-a7f0-35095d1fcece tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:48.045873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ba621e2-fd8e-4dfa-a7f0-35095d1fcece tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:48.060709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:20:48.180517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3ba621e2-fd8e-4dfa-a7f0-35095d1fcece tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:48.193025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3ba621e2-fd8e-4dfa-a7f0-35095d1fcece tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:48.195064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3ba621e2-fd8e-4dfa-a7f0-35095d1fcece tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:48.196792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3ba621e2-fd8e-4dfa-a7f0-35095d1fcece tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172644 Sep 13 20:20:48.197566 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1074/2232] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:48 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:49.227484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-162d1b5d-3823-4b9c-9bb3-2ede994ca9df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:49.228494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-162d1b5d-3823-4b9c-9bb3-2ede994ca9df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:49.239653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-162d1b5d-3823-4b9c-9bb3-2ede994ca9df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:49.240438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-162d1b5d-3823-4b9c-9bb3-2ede994ca9df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:49.241155 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-162d1b5d-3823-4b9c-9bb3-2ede994ca9df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:49.242287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-162d1b5d-3823-4b9c-9bb3-2ede994ca9df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:49.243080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-162d1b5d-3823-4b9c-9bb3-2ede994ca9df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:49.243747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-162d1b5d-3823-4b9c-9bb3-2ede994ca9df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:49.381920 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-162d1b5d-3823-4b9c-9bb3-2ede994ca9df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:49.390848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-162d1b5d-3823-4b9c-9bb3-2ede994ca9df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:49.392359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-162d1b5d-3823-4b9c-9bb3-2ede994ca9df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:49.393500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-162d1b5d-3823-4b9c-9bb3-2ede994ca9df tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172665 Sep 13 20:20:49.394089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1159/2233] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:50.423685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6879efc2-78b0-45a0-abd8-3231dd3c463a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:50.424694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6879efc2-78b0-45a0-abd8-3231dd3c463a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:50.435808 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6879efc2-78b0-45a0-abd8-3231dd3c463a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:50.436559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6879efc2-78b0-45a0-abd8-3231dd3c463a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:50.437070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6879efc2-78b0-45a0-abd8-3231dd3c463a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:50.438238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6879efc2-78b0-45a0-abd8-3231dd3c463a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:50.438966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6879efc2-78b0-45a0-abd8-3231dd3c463a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:50.439690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6879efc2-78b0-45a0-abd8-3231dd3c463a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:50.574022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6879efc2-78b0-45a0-abd8-3231dd3c463a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:50.583377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6879efc2-78b0-45a0-abd8-3231dd3c463a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:50.584808 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6879efc2-78b0-45a0-abd8-3231dd3c463a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:50.585974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6879efc2-78b0-45a0-abd8-3231dd3c463a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169076 Sep 13 20:20:50.586560 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1075/2234] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:51.611088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5a8f3013-bb9b-4212-99cf-816e6be7a2e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:51.611742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5a8f3013-bb9b-4212-99cf-816e6be7a2e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:51.618863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a8f3013-bb9b-4212-99cf-816e6be7a2e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:51.619342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a8f3013-bb9b-4212-99cf-816e6be7a2e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:51.619772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a8f3013-bb9b-4212-99cf-816e6be7a2e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:51.620459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a8f3013-bb9b-4212-99cf-816e6be7a2e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:51.620904 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a8f3013-bb9b-4212-99cf-816e6be7a2e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:51.621416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a8f3013-bb9b-4212-99cf-816e6be7a2e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:51.758192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5a8f3013-bb9b-4212-99cf-816e6be7a2e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:51.768439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5a8f3013-bb9b-4212-99cf-816e6be7a2e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:51.769878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5a8f3013-bb9b-4212-99cf-816e6be7a2e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:51.771143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5a8f3013-bb9b-4212-99cf-816e6be7a2e9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.163972 Sep 13 20:20:51.771717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1160/2235] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:52.801021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-13a1ad9e-d6af-4417-91e0-b357853d9288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:52.801975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-13a1ad9e-d6af-4417-91e0-b357853d9288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:52.812711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-13a1ad9e-d6af-4417-91e0-b357853d9288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:52.813500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-13a1ad9e-d6af-4417-91e0-b357853d9288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:52.814215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-13a1ad9e-d6af-4417-91e0-b357853d9288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:52.815395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-13a1ad9e-d6af-4417-91e0-b357853d9288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:52.816194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-13a1ad9e-d6af-4417-91e0-b357853d9288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:52.816888 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-13a1ad9e-d6af-4417-91e0-b357853d9288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:52.951789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-13a1ad9e-d6af-4417-91e0-b357853d9288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:52.965494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-13a1ad9e-d6af-4417-91e0-b357853d9288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:52.967032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-13a1ad9e-d6af-4417-91e0-b357853d9288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:52.968188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-13a1ad9e-d6af-4417-91e0-b357853d9288 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173888 Sep 13 20:20:52.968948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1076/2236] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:53.997583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fe72586c-6969-4217-9718-91fed4155ad3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:53.998719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fe72586c-6969-4217-9718-91fed4155ad3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:54.010176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe72586c-6969-4217-9718-91fed4155ad3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:54.010786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe72586c-6969-4217-9718-91fed4155ad3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:54.011444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe72586c-6969-4217-9718-91fed4155ad3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:54.012459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe72586c-6969-4217-9718-91fed4155ad3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:54.012908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe72586c-6969-4217-9718-91fed4155ad3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:54.013315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fe72586c-6969-4217-9718-91fed4155ad3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:54.153924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fe72586c-6969-4217-9718-91fed4155ad3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:54.162846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fe72586c-6969-4217-9718-91fed4155ad3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:54.164284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fe72586c-6969-4217-9718-91fed4155ad3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:54.165472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fe72586c-6969-4217-9718-91fed4155ad3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.174009 Sep 13 20:20:54.166034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1161/2237] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:53 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:55.190884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a345d7e9-235e-4c5b-9f84-035bd47ac68f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:55.191485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a345d7e9-235e-4c5b-9f84-035bd47ac68f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:55.193907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:20:55.194048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:20:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 (ip 10.222.0.52) !!! Sep 13 20:20:55.195268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:20:55.195268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:20:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 (ip 10.222.0.52) !!! Sep 13 20:20:55.203278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a345d7e9-235e-4c5b-9f84-035bd47ac68f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:55.203860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a345d7e9-235e-4c5b-9f84-035bd47ac68f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:55.204729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a345d7e9-235e-4c5b-9f84-035bd47ac68f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:55.205536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a345d7e9-235e-4c5b-9f84-035bd47ac68f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:55.206145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a345d7e9-235e-4c5b-9f84-035bd47ac68f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:55.206731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a345d7e9-235e-4c5b-9f84-035bd47ac68f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:55.345177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a345d7e9-235e-4c5b-9f84-035bd47ac68f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:55.355710 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a345d7e9-235e-4c5b-9f84-035bd47ac68f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:55.357164 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a345d7e9-235e-4c5b-9f84-035bd47ac68f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:55.358329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a345d7e9-235e-4c5b-9f84-035bd47ac68f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.171589 Sep 13 20:20:55.359017 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1077/2238] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:56.387797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b50c9bae-2978-4d46-81f7-a965f81e80c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:56.388572 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b50c9bae-2978-4d46-81f7-a965f81e80c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:56.396982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b50c9bae-2978-4d46-81f7-a965f81e80c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:56.397589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b50c9bae-2978-4d46-81f7-a965f81e80c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:56.398148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b50c9bae-2978-4d46-81f7-a965f81e80c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:56.399075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b50c9bae-2978-4d46-81f7-a965f81e80c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:56.399659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b50c9bae-2978-4d46-81f7-a965f81e80c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:56.400235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b50c9bae-2978-4d46-81f7-a965f81e80c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:56.548928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b50c9bae-2978-4d46-81f7-a965f81e80c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:56.561984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b50c9bae-2978-4d46-81f7-a965f81e80c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:56.563458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b50c9bae-2978-4d46-81f7-a965f81e80c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:56.564632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b50c9bae-2978-4d46-81f7-a965f81e80c9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.183502 Sep 13 20:20:56.585559 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1162/2239] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:57.594725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-758c29b1-7116-4386-ab9d-d5cd7fb9579f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:57.595340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-758c29b1-7116-4386-ab9d-d5cd7fb9579f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:57.602234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-758c29b1-7116-4386-ab9d-d5cd7fb9579f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:57.602756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-758c29b1-7116-4386-ab9d-d5cd7fb9579f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:57.603193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-758c29b1-7116-4386-ab9d-d5cd7fb9579f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:57.603881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-758c29b1-7116-4386-ab9d-d5cd7fb9579f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:57.604339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-758c29b1-7116-4386-ab9d-d5cd7fb9579f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:57.604754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-758c29b1-7116-4386-ab9d-d5cd7fb9579f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:57.738118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-758c29b1-7116-4386-ab9d-d5cd7fb9579f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:57.747071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-758c29b1-7116-4386-ab9d-d5cd7fb9579f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:57.748503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-758c29b1-7116-4386-ab9d-d5cd7fb9579f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:57.749669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-758c29b1-7116-4386-ab9d-d5cd7fb9579f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159013 Sep 13 20:20:57.750231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1078/2240] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:58.779859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-73a6bfee-c993-4adc-9a0a-d5d9a2b54eba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:58.780911 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-73a6bfee-c993-4adc-9a0a-d5d9a2b54eba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:58.791614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73a6bfee-c993-4adc-9a0a-d5d9a2b54eba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:58.792434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73a6bfee-c993-4adc-9a0a-d5d9a2b54eba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:58.793258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73a6bfee-c993-4adc-9a0a-d5d9a2b54eba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:58.793946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73a6bfee-c993-4adc-9a0a-d5d9a2b54eba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:58.794397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73a6bfee-c993-4adc-9a0a-d5d9a2b54eba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:58.794858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73a6bfee-c993-4adc-9a0a-d5d9a2b54eba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:58.927570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-73a6bfee-c993-4adc-9a0a-d5d9a2b54eba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:58.936562 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-73a6bfee-c993-4adc-9a0a-d5d9a2b54eba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:58.938011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-73a6bfee-c993-4adc-9a0a-d5d9a2b54eba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:20:58.939204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-73a6bfee-c993-4adc-9a0a-d5d9a2b54eba tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166319 Sep 13 20:20:58.939767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1163/2241] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:20:59.968952 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7c84da67-6804-426e-8ec1-236eaf918fb9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:20:59.970007 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7c84da67-6804-426e-8ec1-236eaf918fb9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:20:59.980104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7c84da67-6804-426e-8ec1-236eaf918fb9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:59.980844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7c84da67-6804-426e-8ec1-236eaf918fb9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:59.981283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7c84da67-6804-426e-8ec1-236eaf918fb9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:20:59.981964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7c84da67-6804-426e-8ec1-236eaf918fb9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:20:59.982396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7c84da67-6804-426e-8ec1-236eaf918fb9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:20:59.982866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7c84da67-6804-426e-8ec1-236eaf918fb9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:00.114210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7c84da67-6804-426e-8ec1-236eaf918fb9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:00.130136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7c84da67-6804-426e-8ec1-236eaf918fb9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:00.132594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7c84da67-6804-426e-8ec1-236eaf918fb9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:00.134583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7c84da67-6804-426e-8ec1-236eaf918fb9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172214 Sep 13 20:21:00.135549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1079/2242] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:20:59 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:01.165290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f892afb6-8d62-42aa-968f-260a7179cc11 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:01.166305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f892afb6-8d62-42aa-968f-260a7179cc11 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:01.177171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f892afb6-8d62-42aa-968f-260a7179cc11 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:01.177957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f892afb6-8d62-42aa-968f-260a7179cc11 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:01.178734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f892afb6-8d62-42aa-968f-260a7179cc11 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:01.179853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f892afb6-8d62-42aa-968f-260a7179cc11 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:01.180590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f892afb6-8d62-42aa-968f-260a7179cc11 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:01.181283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f892afb6-8d62-42aa-968f-260a7179cc11 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:01.318941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f892afb6-8d62-42aa-968f-260a7179cc11 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:01.333335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f892afb6-8d62-42aa-968f-260a7179cc11 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:01.335321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f892afb6-8d62-42aa-968f-260a7179cc11 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:01.337092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f892afb6-8d62-42aa-968f-260a7179cc11 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.178300 Sep 13 20:21:01.337915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1164/2243] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:02.367652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a6020422-870f-4183-9336-68736b141bb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:02.368515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a6020422-870f-4183-9336-68736b141bb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:02.379478 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6020422-870f-4183-9336-68736b141bb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:02.380262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6020422-870f-4183-9336-68736b141bb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:02.380972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6020422-870f-4183-9336-68736b141bb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:02.382088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6020422-870f-4183-9336-68736b141bb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:02.382875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6020422-870f-4183-9336-68736b141bb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:02.383561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6020422-870f-4183-9336-68736b141bb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:02.516740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a6020422-870f-4183-9336-68736b141bb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:02.525938 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a6020422-870f-4183-9336-68736b141bb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:02.527395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a6020422-870f-4183-9336-68736b141bb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:02.528544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a6020422-870f-4183-9336-68736b141bb6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167619 Sep 13 20:21:02.529077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1080/2244] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:03.555167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4454bb2a-e77a-4331-96c7-5bcd544ff83f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:03.555789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4454bb2a-e77a-4331-96c7-5bcd544ff83f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:03.563240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4454bb2a-e77a-4331-96c7-5bcd544ff83f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:03.563713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4454bb2a-e77a-4331-96c7-5bcd544ff83f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:03.564143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4454bb2a-e77a-4331-96c7-5bcd544ff83f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:03.564848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4454bb2a-e77a-4331-96c7-5bcd544ff83f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:03.565291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4454bb2a-e77a-4331-96c7-5bcd544ff83f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:03.565710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4454bb2a-e77a-4331-96c7-5bcd544ff83f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:03.697767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4454bb2a-e77a-4331-96c7-5bcd544ff83f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:03.708373 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4454bb2a-e77a-4331-96c7-5bcd544ff83f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:03.709849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4454bb2a-e77a-4331-96c7-5bcd544ff83f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:03.711033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4454bb2a-e77a-4331-96c7-5bcd544ff83f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.160499 Sep 13 20:21:03.711776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1165/2245] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:04.736836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-35bc27bb-7b4c-40eb-9b1f-7e00760cecfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:04.737447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-35bc27bb-7b4c-40eb-9b1f-7e00760cecfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:04.744049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35bc27bb-7b4c-40eb-9b1f-7e00760cecfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:04.744541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35bc27bb-7b4c-40eb-9b1f-7e00760cecfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:04.744966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35bc27bb-7b4c-40eb-9b1f-7e00760cecfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:04.745681 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35bc27bb-7b4c-40eb-9b1f-7e00760cecfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:04.746124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35bc27bb-7b4c-40eb-9b1f-7e00760cecfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:04.746604 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-35bc27bb-7b4c-40eb-9b1f-7e00760cecfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:04.897723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-35bc27bb-7b4c-40eb-9b1f-7e00760cecfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:04.909257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-35bc27bb-7b4c-40eb-9b1f-7e00760cecfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:04.911332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-35bc27bb-7b4c-40eb-9b1f-7e00760cecfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:04.913008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-35bc27bb-7b4c-40eb-9b1f-7e00760cecfa tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.179885 Sep 13 20:21:04.913742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1081/2246] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:05.950126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-50fba51d-e6f7-4922-a51b-7b8db41b1800 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:05.951013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-50fba51d-e6f7-4922-a51b-7b8db41b1800 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:05.958398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50fba51d-e6f7-4922-a51b-7b8db41b1800 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:05.958919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50fba51d-e6f7-4922-a51b-7b8db41b1800 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:05.959338 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50fba51d-e6f7-4922-a51b-7b8db41b1800 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:05.960010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50fba51d-e6f7-4922-a51b-7b8db41b1800 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:05.960445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50fba51d-e6f7-4922-a51b-7b8db41b1800 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:05.960852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-50fba51d-e6f7-4922-a51b-7b8db41b1800 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:05.963388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=80 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:21:06.092277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-50fba51d-e6f7-4922-a51b-7b8db41b1800 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:06.100906 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-50fba51d-e6f7-4922-a51b-7b8db41b1800 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:06.102324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-50fba51d-e6f7-4922-a51b-7b8db41b1800 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:06.103501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-50fba51d-e6f7-4922-a51b-7b8db41b1800 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159817 Sep 13 20:21:06.104032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1166/2247] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:07.133646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a3d3bd7e-1558-4b48-8571-36a67a401450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:07.134573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a3d3bd7e-1558-4b48-8571-36a67a401450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:07.138232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=26 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:21:07.147668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3d3bd7e-1558-4b48-8571-36a67a401450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:07.148477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3d3bd7e-1558-4b48-8571-36a67a401450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:07.149205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3d3bd7e-1558-4b48-8571-36a67a401450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:07.150328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3d3bd7e-1558-4b48-8571-36a67a401450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:07.151134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3d3bd7e-1558-4b48-8571-36a67a401450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:07.151838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a3d3bd7e-1558-4b48-8571-36a67a401450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:07.281161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a3d3bd7e-1558-4b48-8571-36a67a401450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:07.290530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a3d3bd7e-1558-4b48-8571-36a67a401450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:07.291981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a3d3bd7e-1558-4b48-8571-36a67a401450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:07.293147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a3d3bd7e-1558-4b48-8571-36a67a401450 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166343 Sep 13 20:21:07.293705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1082/2248] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:08.322160 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0aaa3dda-20db-432c-b6c2-bc61f1db606e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:08.323160 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0aaa3dda-20db-432c-b6c2-bc61f1db606e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:08.326658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=26 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:21:08.332414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0aaa3dda-20db-432c-b6c2-bc61f1db606e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:08.332891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0aaa3dda-20db-432c-b6c2-bc61f1db606e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:08.333323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0aaa3dda-20db-432c-b6c2-bc61f1db606e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:08.334004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0aaa3dda-20db-432c-b6c2-bc61f1db606e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:08.334474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0aaa3dda-20db-432c-b6c2-bc61f1db606e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:08.334896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0aaa3dda-20db-432c-b6c2-bc61f1db606e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:08.464684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0aaa3dda-20db-432c-b6c2-bc61f1db606e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:08.473972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0aaa3dda-20db-432c-b6c2-bc61f1db606e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:08.475457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0aaa3dda-20db-432c-b6c2-bc61f1db606e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:08.476632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0aaa3dda-20db-432c-b6c2-bc61f1db606e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161196 Sep 13 20:21:08.477202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1167/2249] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:09.035296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7bcb9593-b3df-49f9-bdef-bd2f938e2995 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:09.035833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7bcb9593-b3df-49f9-bdef-bd2f938e2995 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:09.042612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7bcb9593-b3df-49f9-bdef-bd2f938e2995 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:09.043107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7bcb9593-b3df-49f9-bdef-bd2f938e2995 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:09.043542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7bcb9593-b3df-49f9-bdef-bd2f938e2995 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:09.044248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7bcb9593-b3df-49f9-bdef-bd2f938e2995 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:09.044826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7bcb9593-b3df-49f9-bdef-bd2f938e2995 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:09.045254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7bcb9593-b3df-49f9-bdef-bd2f938e2995 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:09.070717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7bcb9593-b3df-49f9-bdef-bd2f938e2995 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Going to try to terminate instance {{(pid=120845) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:21:09.162260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7bcb9593-b3df-49f9-bdef-bd2f938e2995 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 204 len: 0 microversion: 2.1 time: 0.130314 Sep 13 20:21:09.163039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1083/2250] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:21:09 2022] DELETE /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:21:09.171681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f5452117-911a-4127-a553-d51620bfdb49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:09.172316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f5452117-911a-4127-a553-d51620bfdb49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:09.178524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5452117-911a-4127-a553-d51620bfdb49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:09.178993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5452117-911a-4127-a553-d51620bfdb49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:09.179452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5452117-911a-4127-a553-d51620bfdb49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:09.180125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5452117-911a-4127-a553-d51620bfdb49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:09.180573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5452117-911a-4127-a553-d51620bfdb49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:09.180985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5452117-911a-4127-a553-d51620bfdb49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:09.313084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f5452117-911a-4127-a553-d51620bfdb49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:09.321724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f5452117-911a-4127-a553-d51620bfdb49 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1719 microversion: 2.1 time: 0.154141 Sep 13 20:21:09.322301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1168/2251] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:21:09.503470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-80e85cd2-ce55-495d-a85b-c983a927daab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:09.504308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-80e85cd2-ce55-495d-a85b-c983a927daab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:09.510783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80e85cd2-ce55-495d-a85b-c983a927daab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:09.511199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80e85cd2-ce55-495d-a85b-c983a927daab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:09.511640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80e85cd2-ce55-495d-a85b-c983a927daab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:09.512334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80e85cd2-ce55-495d-a85b-c983a927daab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:09.512779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80e85cd2-ce55-495d-a85b-c983a927daab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:09.513199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80e85cd2-ce55-495d-a85b-c983a927daab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:09.648753 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-80e85cd2-ce55-495d-a85b-c983a927daab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:09.657976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-80e85cd2-ce55-495d-a85b-c983a927daab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:09.659488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-80e85cd2-ce55-495d-a85b-c983a927daab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:09.660652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-80e85cd2-ce55-495d-a85b-c983a927daab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161698 Sep 13 20:21:09.661214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1084/2252] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:09 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:10.353690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a1563fcf-1ad0-414f-ae86-bdc9132f7bc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:10.354476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a1563fcf-1ad0-414f-ae86-bdc9132f7bc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:10.361252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1563fcf-1ad0-414f-ae86-bdc9132f7bc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:10.361735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1563fcf-1ad0-414f-ae86-bdc9132f7bc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:10.362163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1563fcf-1ad0-414f-ae86-bdc9132f7bc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:10.362886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1563fcf-1ad0-414f-ae86-bdc9132f7bc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:10.363407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1563fcf-1ad0-414f-ae86-bdc9132f7bc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:10.363832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1563fcf-1ad0-414f-ae86-bdc9132f7bc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:10.495100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a1563fcf-1ad0-414f-ae86-bdc9132f7bc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:10.503944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a1563fcf-1ad0-414f-ae86-bdc9132f7bc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1719 microversion: 2.1 time: 0.154451 Sep 13 20:21:10.504505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1169/2253] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:10 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:10.685697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-84a65d11-9b21-46e3-8a99-a36b43e16b5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:10.686304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-84a65d11-9b21-46e3-8a99-a36b43e16b5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:10.693040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84a65d11-9b21-46e3-8a99-a36b43e16b5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:10.693519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84a65d11-9b21-46e3-8a99-a36b43e16b5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:10.693949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84a65d11-9b21-46e3-8a99-a36b43e16b5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:10.694688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84a65d11-9b21-46e3-8a99-a36b43e16b5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:10.695136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84a65d11-9b21-46e3-8a99-a36b43e16b5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:10.695553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-84a65d11-9b21-46e3-8a99-a36b43e16b5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:10.907953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-84a65d11-9b21-46e3-8a99-a36b43e16b5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:10.916688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-84a65d11-9b21-46e3-8a99-a36b43e16b5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:10.918114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-84a65d11-9b21-46e3-8a99-a36b43e16b5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:10.919297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-84a65d11-9b21-46e3-8a99-a36b43e16b5f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.237703 Sep 13 20:21:10.919859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1085/2254] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:10 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:11.148821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-5c2e57a1-91e4-4ee8-b5fc-5403615d9e31 req-c6dee6fd-52ff-48c2-bab7-b6f10709dd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6c34670-16a4-4b3b-9a8d-1d77974d355e", "name": "network-vif-deleted", "tag": "7a33c927-0f1f-4566-9bf6-1b28ad675d14"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:21:11.159341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-5c2e57a1-91e4-4ee8-b5fc-5403615d9e31 req-c6dee6fd-52ff-48c2-bab7-b6f10709dd71 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:11.159815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-5c2e57a1-91e4-4ee8-b5fc-5403615d9e31 req-c6dee6fd-52ff-48c2-bab7-b6f10709dd71 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:11.160444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-5c2e57a1-91e4-4ee8-b5fc-5403615d9e31 req-c6dee6fd-52ff-48c2-bab7-b6f10709dd71 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:11.174293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-5c2e57a1-91e4-4ee8-b5fc-5403615d9e31 req-c6dee6fd-52ff-48c2-bab7-b6f10709dd71 service nova] Creating event network-vif-deleted:7a33c927-0f1f-4566-9bf6-1b28ad675d14 for instance b6c34670-16a4-4b3b-9a8d-1d77974d355e on hv-cinder-85427 Sep 13 20:21:11.181815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-5c2e57a1-91e4-4ee8-b5fc-5403615d9e31 req-c6dee6fd-52ff-48c2-bab7-b6f10709dd71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113671 Sep 13 20:21:11.183042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1170/2255] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:21:11.528022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-de5836a3-e1ae-4791-b7cd-0d3688b2876a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:11.528661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-de5836a3-e1ae-4791-b7cd-0d3688b2876a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:11.535022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de5836a3-e1ae-4791-b7cd-0d3688b2876a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:11.535507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de5836a3-e1ae-4791-b7cd-0d3688b2876a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:11.535929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de5836a3-e1ae-4791-b7cd-0d3688b2876a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:11.536629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de5836a3-e1ae-4791-b7cd-0d3688b2876a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:11.537078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de5836a3-e1ae-4791-b7cd-0d3688b2876a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:11.537503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de5836a3-e1ae-4791-b7cd-0d3688b2876a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:11.607089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-de5836a3-e1ae-4791-b7cd-0d3688b2876a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:11.615627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-de5836a3-e1ae-4791-b7cd-0d3688b2876a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091584 Sep 13 20:21:11.616465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1086/2256] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:11 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:11.946273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d7f0d648-1401-4d42-b1a4-71527c91f68d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:11.946993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d7f0d648-1401-4d42-b1a4-71527c91f68d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:11.954078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7f0d648-1401-4d42-b1a4-71527c91f68d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:11.954605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7f0d648-1401-4d42-b1a4-71527c91f68d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:11.955041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7f0d648-1401-4d42-b1a4-71527c91f68d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:11.955713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7f0d648-1401-4d42-b1a4-71527c91f68d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:11.956155 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7f0d648-1401-4d42-b1a4-71527c91f68d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:11.956569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7f0d648-1401-4d42-b1a4-71527c91f68d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:12.088530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d7f0d648-1401-4d42-b1a4-71527c91f68d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:12.097431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d7f0d648-1401-4d42-b1a4-71527c91f68d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:12.098902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d7f0d648-1401-4d42-b1a4-71527c91f68d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:12.100069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d7f0d648-1401-4d42-b1a4-71527c91f68d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158715 Sep 13 20:21:12.100604 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1171/2257] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:11 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:12.642895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7e5219c4-a22c-4c88-93a2-6501105f1322 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:12.643957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7e5219c4-a22c-4c88-93a2-6501105f1322 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:12.654841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e5219c4-a22c-4c88-93a2-6501105f1322 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:12.655331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e5219c4-a22c-4c88-93a2-6501105f1322 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:12.655760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e5219c4-a22c-4c88-93a2-6501105f1322 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:12.656448 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e5219c4-a22c-4c88-93a2-6501105f1322 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:12.656887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e5219c4-a22c-4c88-93a2-6501105f1322 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:12.657305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7e5219c4-a22c-4c88-93a2-6501105f1322 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:12.718241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7e5219c4-a22c-4c88-93a2-6501105f1322 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:12.726633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7e5219c4-a22c-4c88-93a2-6501105f1322 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090724 Sep 13 20:21:12.727186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1087/2258] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:12 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:13.130510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ab05e911-51a0-4863-be03-684f029dfe13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:13.131515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ab05e911-51a0-4863-be03-684f029dfe13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:13.142268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ab05e911-51a0-4863-be03-684f029dfe13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:13.143166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ab05e911-51a0-4863-be03-684f029dfe13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:13.143865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ab05e911-51a0-4863-be03-684f029dfe13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:13.144940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ab05e911-51a0-4863-be03-684f029dfe13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:13.145717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ab05e911-51a0-4863-be03-684f029dfe13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:13.146439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ab05e911-51a0-4863-be03-684f029dfe13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:13.484569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ab05e911-51a0-4863-be03-684f029dfe13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:13.495084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ab05e911-51a0-4863-be03-684f029dfe13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:13.496495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ab05e911-51a0-4863-be03-684f029dfe13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:13.497671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ab05e911-51a0-4863-be03-684f029dfe13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.373853 Sep 13 20:21:13.498228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1172/2259] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:13 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:13.753501 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f6118c37-046e-4c11-bccb-79f41c2df275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:13.754418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f6118c37-046e-4c11-bccb-79f41c2df275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:13.764430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6118c37-046e-4c11-bccb-79f41c2df275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:13.764897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6118c37-046e-4c11-bccb-79f41c2df275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:13.765351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6118c37-046e-4c11-bccb-79f41c2df275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:13.766029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6118c37-046e-4c11-bccb-79f41c2df275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:13.766509 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6118c37-046e-4c11-bccb-79f41c2df275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:13.766925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6118c37-046e-4c11-bccb-79f41c2df275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:13.833594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f6118c37-046e-4c11-bccb-79f41c2df275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:13.842018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f6118c37-046e-4c11-bccb-79f41c2df275 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095216 Sep 13 20:21:13.842615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1088/2260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:14.531061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c0fa0756-fdda-4ff8-ba3d-9f3efd6213ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:14.532030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c0fa0756-fdda-4ff8-ba3d-9f3efd6213ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:14.543262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0fa0756-fdda-4ff8-ba3d-9f3efd6213ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:14.544057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0fa0756-fdda-4ff8-ba3d-9f3efd6213ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:14.544753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0fa0756-fdda-4ff8-ba3d-9f3efd6213ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:14.545485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0fa0756-fdda-4ff8-ba3d-9f3efd6213ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:14.545962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0fa0756-fdda-4ff8-ba3d-9f3efd6213ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:14.546396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0fa0756-fdda-4ff8-ba3d-9f3efd6213ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:14.677838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c0fa0756-fdda-4ff8-ba3d-9f3efd6213ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:14.686878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c0fa0756-fdda-4ff8-ba3d-9f3efd6213ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:14.688305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c0fa0756-fdda-4ff8-ba3d-9f3efd6213ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:14.689444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c0fa0756-fdda-4ff8-ba3d-9f3efd6213ff tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165138 Sep 13 20:21:14.690003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1173/2261] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:14 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:14.869190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-23e086ac-5388-4080-85a6-ef4cc2f557c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:14.870158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-23e086ac-5388-4080-85a6-ef4cc2f557c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:14.878199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23e086ac-5388-4080-85a6-ef4cc2f557c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:14.878704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23e086ac-5388-4080-85a6-ef4cc2f557c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:14.879131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23e086ac-5388-4080-85a6-ef4cc2f557c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:14.879805 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23e086ac-5388-4080-85a6-ef4cc2f557c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:14.880247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23e086ac-5388-4080-85a6-ef4cc2f557c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:14.880663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23e086ac-5388-4080-85a6-ef4cc2f557c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:14.895453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:21:14.945035 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-23e086ac-5388-4080-85a6-ef4cc2f557c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:14.954109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-23e086ac-5388-4080-85a6-ef4cc2f557c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091210 Sep 13 20:21:14.954719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1089/2262] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:14 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:15.719579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5ecb49bf-9071-4d51-85bd-1e45bdda50b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:15.720605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5ecb49bf-9071-4d51-85bd-1e45bdda50b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:15.731674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ecb49bf-9071-4d51-85bd-1e45bdda50b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:15.732341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ecb49bf-9071-4d51-85bd-1e45bdda50b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:15.732774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ecb49bf-9071-4d51-85bd-1e45bdda50b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:15.733464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ecb49bf-9071-4d51-85bd-1e45bdda50b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:15.733913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ecb49bf-9071-4d51-85bd-1e45bdda50b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:15.734332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5ecb49bf-9071-4d51-85bd-1e45bdda50b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:15.875877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5ecb49bf-9071-4d51-85bd-1e45bdda50b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:15.885202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5ecb49bf-9071-4d51-85bd-1e45bdda50b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:15.886695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5ecb49bf-9071-4d51-85bd-1e45bdda50b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:15.887867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5ecb49bf-9071-4d51-85bd-1e45bdda50b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.174979 Sep 13 20:21:15.888445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1174/2263] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:15 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:15.981203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1ead9b92-a1a4-4550-aef4-c139484cd82b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:15.982317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1ead9b92-a1a4-4550-aef4-c139484cd82b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:15.990675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ead9b92-a1a4-4550-aef4-c139484cd82b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:15.991261 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ead9b92-a1a4-4550-aef4-c139484cd82b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:15.991795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ead9b92-a1a4-4550-aef4-c139484cd82b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:15.992643 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ead9b92-a1a4-4550-aef4-c139484cd82b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:15.993193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ead9b92-a1a4-4550-aef4-c139484cd82b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:15.993712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1ead9b92-a1a4-4550-aef4-c139484cd82b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:16.062744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1ead9b92-a1a4-4550-aef4-c139484cd82b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:16.074851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1ead9b92-a1a4-4550-aef4-c139484cd82b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099672 Sep 13 20:21:16.075958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1090/2264] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:16.917690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fea234e1-8a17-420c-a866-2438fa1505a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:16.918759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fea234e1-8a17-420c-a866-2438fa1505a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:16.929444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fea234e1-8a17-420c-a866-2438fa1505a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:16.930280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fea234e1-8a17-420c-a866-2438fa1505a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:16.931003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fea234e1-8a17-420c-a866-2438fa1505a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:16.932132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fea234e1-8a17-420c-a866-2438fa1505a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:16.932873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fea234e1-8a17-420c-a866-2438fa1505a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:16.933566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fea234e1-8a17-420c-a866-2438fa1505a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:17.074214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fea234e1-8a17-420c-a866-2438fa1505a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:17.088105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fea234e1-8a17-420c-a866-2438fa1505a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:17.090343 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fea234e1-8a17-420c-a866-2438fa1505a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:17.091870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fea234e1-8a17-420c-a866-2438fa1505a4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.180880 Sep 13 20:21:17.092434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1175/2265] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:16 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:17.099359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cbb44257-1990-47b5-9d75-53ca2f2cd4ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:17.099952 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cbb44257-1990-47b5-9d75-53ca2f2cd4ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:17.106547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbb44257-1990-47b5-9d75-53ca2f2cd4ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:17.107018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbb44257-1990-47b5-9d75-53ca2f2cd4ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:17.107450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbb44257-1990-47b5-9d75-53ca2f2cd4ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:17.108129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbb44257-1990-47b5-9d75-53ca2f2cd4ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:17.108574 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbb44257-1990-47b5-9d75-53ca2f2cd4ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:17.108986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbb44257-1990-47b5-9d75-53ca2f2cd4ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:17.176607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-cbb44257-1990-47b5-9d75-53ca2f2cd4ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:17.190088 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cbb44257-1990-47b5-9d75-53ca2f2cd4ac tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094340 Sep 13 20:21:17.190714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1091/2266] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:17 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:18.121521 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e38d09c4-b23e-4fca-82f3-538b8f11d826 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:18.122510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e38d09c4-b23e-4fca-82f3-538b8f11d826 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:18.133355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e38d09c4-b23e-4fca-82f3-538b8f11d826 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:18.134134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e38d09c4-b23e-4fca-82f3-538b8f11d826 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:18.136151 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e38d09c4-b23e-4fca-82f3-538b8f11d826 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:18.137327 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e38d09c4-b23e-4fca-82f3-538b8f11d826 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:18.138097 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e38d09c4-b23e-4fca-82f3-538b8f11d826 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:18.138859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e38d09c4-b23e-4fca-82f3-538b8f11d826 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:18.213294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-edaaa982-4c76-43a8-8137-b739b1ebc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:18.213873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-edaaa982-4c76-43a8-8137-b739b1ebc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:18.220733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-edaaa982-4c76-43a8-8137-b739b1ebc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:18.221243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-edaaa982-4c76-43a8-8137-b739b1ebc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:18.221675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-edaaa982-4c76-43a8-8137-b739b1ebc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:18.222390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-edaaa982-4c76-43a8-8137-b739b1ebc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:18.222931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-edaaa982-4c76-43a8-8137-b739b1ebc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:18.223356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-edaaa982-4c76-43a8-8137-b739b1ebc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:18.269841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e38d09c4-b23e-4fca-82f3-538b8f11d826 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:18.279307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e38d09c4-b23e-4fca-82f3-538b8f11d826 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:18.281066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e38d09c4-b23e-4fca-82f3-538b8f11d826 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:18.283177 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e38d09c4-b23e-4fca-82f3-538b8f11d826 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167413 Sep 13 20:21:18.283806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1176/2267] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:18 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:18.285571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-edaaa982-4c76-43a8-8137-b739b1ebc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:18.294763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-edaaa982-4c76-43a8-8137-b739b1ebc106 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085343 Sep 13 20:21:18.295327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1092/2268] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:19.307728 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-af0a506b-d714-4788-9291-2e9488c4383e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:19.308369 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-af0a506b-d714-4788-9291-2e9488c4383e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:19.315288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af0a506b-d714-4788-9291-2e9488c4383e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:19.315752 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af0a506b-d714-4788-9291-2e9488c4383e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:19.316185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af0a506b-d714-4788-9291-2e9488c4383e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:19.316874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af0a506b-d714-4788-9291-2e9488c4383e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:19.317230 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7356156b-ea0b-4896-933d-d2cf3af2b8d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:19.317651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af0a506b-d714-4788-9291-2e9488c4383e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:19.317779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-af0a506b-d714-4788-9291-2e9488c4383e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:19.317869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7356156b-ea0b-4896-933d-d2cf3af2b8d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:19.324504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7356156b-ea0b-4896-933d-d2cf3af2b8d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:19.324986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7356156b-ea0b-4896-933d-d2cf3af2b8d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:19.325417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7356156b-ea0b-4896-933d-d2cf3af2b8d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:19.326110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7356156b-ea0b-4896-933d-d2cf3af2b8d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:19.326576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7356156b-ea0b-4896-933d-d2cf3af2b8d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:19.327001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7356156b-ea0b-4896-933d-d2cf3af2b8d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:19.390357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7356156b-ea0b-4896-933d-d2cf3af2b8d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:19.398935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7356156b-ea0b-4896-933d-d2cf3af2b8d9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085412 Sep 13 20:21:19.399455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1093/2269] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:19.450615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-af0a506b-d714-4788-9291-2e9488c4383e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:19.460419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-af0a506b-d714-4788-9291-2e9488c4383e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:19.461857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-af0a506b-d714-4788-9291-2e9488c4383e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:19.463074 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-af0a506b-d714-4788-9291-2e9488c4383e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159416 Sep 13 20:21:19.463634 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1177/2270] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:19 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:20.425297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-42e3d136-8eba-45f4-b05b-7301d91d1b24 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:20.426250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-42e3d136-8eba-45f4-b05b-7301d91d1b24 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:20.437188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42e3d136-8eba-45f4-b05b-7301d91d1b24 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:20.437978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42e3d136-8eba-45f4-b05b-7301d91d1b24 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:20.438770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42e3d136-8eba-45f4-b05b-7301d91d1b24 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:20.439951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42e3d136-8eba-45f4-b05b-7301d91d1b24 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:20.440698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42e3d136-8eba-45f4-b05b-7301d91d1b24 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:20.441398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42e3d136-8eba-45f4-b05b-7301d91d1b24 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:20.488406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5fa5cb3a-4849-4c0b-9135-94e16a4497c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:20.489015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5fa5cb3a-4849-4c0b-9135-94e16a4497c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:20.495842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5fa5cb3a-4849-4c0b-9135-94e16a4497c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:20.496326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5fa5cb3a-4849-4c0b-9135-94e16a4497c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:20.496758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5fa5cb3a-4849-4c0b-9135-94e16a4497c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:20.497447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5fa5cb3a-4849-4c0b-9135-94e16a4497c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:20.497893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5fa5cb3a-4849-4c0b-9135-94e16a4497c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:20.498335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5fa5cb3a-4849-4c0b-9135-94e16a4497c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:20.513218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-42e3d136-8eba-45f4-b05b-7301d91d1b24 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:20.527920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-42e3d136-8eba-45f4-b05b-7301d91d1b24 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.109301 Sep 13 20:21:20.528541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1094/2271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:20.639404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5fa5cb3a-4849-4c0b-9135-94e16a4497c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:20.654424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5fa5cb3a-4849-4c0b-9135-94e16a4497c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:20.655246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5fa5cb3a-4849-4c0b-9135-94e16a4497c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:20.656419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5fa5cb3a-4849-4c0b-9135-94e16a4497c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.172057 Sep 13 20:21:20.657019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1178/2272] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:20 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:21.555985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ef0f3802-a8f2-498b-b43d-5eca239d6ad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:21.557137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ef0f3802-a8f2-498b-b43d-5eca239d6ad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:21.566345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef0f3802-a8f2-498b-b43d-5eca239d6ad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:21.566871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef0f3802-a8f2-498b-b43d-5eca239d6ad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:21.567311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef0f3802-a8f2-498b-b43d-5eca239d6ad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:21.568019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef0f3802-a8f2-498b-b43d-5eca239d6ad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:21.568451 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef0f3802-a8f2-498b-b43d-5eca239d6ad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:21.568871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef0f3802-a8f2-498b-b43d-5eca239d6ad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:21.631873 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ef0f3802-a8f2-498b-b43d-5eca239d6ad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:21.640519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ef0f3802-a8f2-498b-b43d-5eca239d6ad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091231 Sep 13 20:21:21.641140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1095/2273] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:21 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:21.681226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-504e0121-6bf8-4bbd-9a6b-78221d0dbfb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:21.681827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-504e0121-6bf8-4bbd-9a6b-78221d0dbfb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:21.688679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-504e0121-6bf8-4bbd-9a6b-78221d0dbfb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:21.689149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-504e0121-6bf8-4bbd-9a6b-78221d0dbfb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:21.689569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-504e0121-6bf8-4bbd-9a6b-78221d0dbfb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:21.690249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-504e0121-6bf8-4bbd-9a6b-78221d0dbfb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:21.690723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-504e0121-6bf8-4bbd-9a6b-78221d0dbfb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:21.691136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-504e0121-6bf8-4bbd-9a6b-78221d0dbfb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:21.827463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-504e0121-6bf8-4bbd-9a6b-78221d0dbfb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:21.837101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-504e0121-6bf8-4bbd-9a6b-78221d0dbfb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:21.838560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-504e0121-6bf8-4bbd-9a6b-78221d0dbfb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:21.839716 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-504e0121-6bf8-4bbd-9a6b-78221d0dbfb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.162483 Sep 13 20:21:21.840246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1179/2274] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:21 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:22.667948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-39eebbc4-bb8f-4b33-b218-a0a29dea526d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:22.668845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-39eebbc4-bb8f-4b33-b218-a0a29dea526d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:22.677051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39eebbc4-bb8f-4b33-b218-a0a29dea526d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:22.677531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39eebbc4-bb8f-4b33-b218-a0a29dea526d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:22.677958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39eebbc4-bb8f-4b33-b218-a0a29dea526d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:22.678664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39eebbc4-bb8f-4b33-b218-a0a29dea526d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:22.679136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39eebbc4-bb8f-4b33-b218-a0a29dea526d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:22.679575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39eebbc4-bb8f-4b33-b218-a0a29dea526d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:22.743498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-39eebbc4-bb8f-4b33-b218-a0a29dea526d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:22.752542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-39eebbc4-bb8f-4b33-b218-a0a29dea526d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090966 Sep 13 20:21:22.753111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1096/2275] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:22.869658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d7a7b598-7fe7-4835-89b5-b03062311cca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:22.870541 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d7a7b598-7fe7-4835-89b5-b03062311cca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:22.879248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7a7b598-7fe7-4835-89b5-b03062311cca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:22.879720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7a7b598-7fe7-4835-89b5-b03062311cca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:22.880140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7a7b598-7fe7-4835-89b5-b03062311cca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:22.880813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7a7b598-7fe7-4835-89b5-b03062311cca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:22.881254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7a7b598-7fe7-4835-89b5-b03062311cca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:22.881660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7a7b598-7fe7-4835-89b5-b03062311cca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:23.011400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d7a7b598-7fe7-4835-89b5-b03062311cca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:23.020121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d7a7b598-7fe7-4835-89b5-b03062311cca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:23.021536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d7a7b598-7fe7-4835-89b5-b03062311cca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:23.022708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d7a7b598-7fe7-4835-89b5-b03062311cca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159950 Sep 13 20:21:23.023244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1180/2276] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:22 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:23.780111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9ab25ffa-df70-4c6c-bc74-586140c8b5ea tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:23.781060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9ab25ffa-df70-4c6c-bc74-586140c8b5ea tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:23.788551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ab25ffa-df70-4c6c-bc74-586140c8b5ea tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:23.789059 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ab25ffa-df70-4c6c-bc74-586140c8b5ea tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:23.789515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ab25ffa-df70-4c6c-bc74-586140c8b5ea tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:23.790272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ab25ffa-df70-4c6c-bc74-586140c8b5ea tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:23.790859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ab25ffa-df70-4c6c-bc74-586140c8b5ea tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:23.791305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9ab25ffa-df70-4c6c-bc74-586140c8b5ea tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:23.855342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9ab25ffa-df70-4c6c-bc74-586140c8b5ea tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:23.865756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9ab25ffa-df70-4c6c-bc74-586140c8b5ea tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092328 Sep 13 20:21:23.866331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1097/2277] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:24.052463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3d279298-f961-4737-9dc5-e1d66b648ab0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:24.053397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3d279298-f961-4737-9dc5-e1d66b648ab0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:24.064240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d279298-f961-4737-9dc5-e1d66b648ab0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:24.065031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d279298-f961-4737-9dc5-e1d66b648ab0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:24.065750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d279298-f961-4737-9dc5-e1d66b648ab0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:24.066926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d279298-f961-4737-9dc5-e1d66b648ab0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:24.067676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d279298-f961-4737-9dc5-e1d66b648ab0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:24.068374 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d279298-f961-4737-9dc5-e1d66b648ab0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:24.205224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3d279298-f961-4737-9dc5-e1d66b648ab0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:24.214104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3d279298-f961-4737-9dc5-e1d66b648ab0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:24.215578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3d279298-f961-4737-9dc5-e1d66b648ab0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:24.216751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3d279298-f961-4737-9dc5-e1d66b648ab0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.171039 Sep 13 20:21:24.217323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1181/2278] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:24 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:24.901350 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-cbe86e24-e66a-4c07-a37b-cc29d8fe936e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:24.902200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-cbe86e24-e66a-4c07-a37b-cc29d8fe936e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:24.912970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbe86e24-e66a-4c07-a37b-cc29d8fe936e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:24.913765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbe86e24-e66a-4c07-a37b-cc29d8fe936e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:24.914470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbe86e24-e66a-4c07-a37b-cc29d8fe936e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:24.915631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbe86e24-e66a-4c07-a37b-cc29d8fe936e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:24.916414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbe86e24-e66a-4c07-a37b-cc29d8fe936e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:24.917067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-cbe86e24-e66a-4c07-a37b-cc29d8fe936e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:24.985178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-cbe86e24-e66a-4c07-a37b-cc29d8fe936e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:24.998134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-cbe86e24-e66a-4c07-a37b-cc29d8fe936e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.103049 Sep 13 20:21:24.999001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1098/2279] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:24 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:25.242477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5603b152-9e1e-4531-b97f-bdfd2fd2c237 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:25.243063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5603b152-9e1e-4531-b97f-bdfd2fd2c237 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:25.249690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5603b152-9e1e-4531-b97f-bdfd2fd2c237 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:25.250296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5603b152-9e1e-4531-b97f-bdfd2fd2c237 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:25.250758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5603b152-9e1e-4531-b97f-bdfd2fd2c237 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:25.251438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5603b152-9e1e-4531-b97f-bdfd2fd2c237 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:25.251882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5603b152-9e1e-4531-b97f-bdfd2fd2c237 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:25.252298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5603b152-9e1e-4531-b97f-bdfd2fd2c237 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:25.398589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5603b152-9e1e-4531-b97f-bdfd2fd2c237 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:25.411953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5603b152-9e1e-4531-b97f-bdfd2fd2c237 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:25.414112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5603b152-9e1e-4531-b97f-bdfd2fd2c237 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:25.415966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5603b152-9e1e-4531-b97f-bdfd2fd2c237 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.177129 Sep 13 20:21:25.416690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1182/2280] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:25 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:26.025884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5e299a7b-de6e-44b1-81b3-8089995664c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:26.026903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5e299a7b-de6e-44b1-81b3-8089995664c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:26.035340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e299a7b-de6e-44b1-81b3-8089995664c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:26.035816 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e299a7b-de6e-44b1-81b3-8089995664c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:26.036243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e299a7b-de6e-44b1-81b3-8089995664c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:26.036920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e299a7b-de6e-44b1-81b3-8089995664c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:26.037362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e299a7b-de6e-44b1-81b3-8089995664c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:26.037792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5e299a7b-de6e-44b1-81b3-8089995664c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:26.109421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5e299a7b-de6e-44b1-81b3-8089995664c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:26.117777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5e299a7b-de6e-44b1-81b3-8089995664c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098509 Sep 13 20:21:26.118338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1099/2281] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:26.446753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8704da37-04aa-4c40-b920-8e9bb7c3ddb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:26.447637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8704da37-04aa-4c40-b920-8e9bb7c3ddb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:26.456928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8704da37-04aa-4c40-b920-8e9bb7c3ddb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:26.457412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8704da37-04aa-4c40-b920-8e9bb7c3ddb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:26.457840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8704da37-04aa-4c40-b920-8e9bb7c3ddb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:26.458898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8704da37-04aa-4c40-b920-8e9bb7c3ddb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:26.459341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8704da37-04aa-4c40-b920-8e9bb7c3ddb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:26.459760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8704da37-04aa-4c40-b920-8e9bb7c3ddb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:26.474652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:21:26.592557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8704da37-04aa-4c40-b920-8e9bb7c3ddb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:26.601409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8704da37-04aa-4c40-b920-8e9bb7c3ddb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:26.602889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8704da37-04aa-4c40-b920-8e9bb7c3ddb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:26.604093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8704da37-04aa-4c40-b920-8e9bb7c3ddb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.164094 Sep 13 20:21:26.604629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1183/2282] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:26 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:27.145254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d306abe2-2361-4d34-80f0-23d2f8e7eb07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:27.146239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d306abe2-2361-4d34-80f0-23d2f8e7eb07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:27.157155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d306abe2-2361-4d34-80f0-23d2f8e7eb07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:27.157935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d306abe2-2361-4d34-80f0-23d2f8e7eb07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:27.158745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d306abe2-2361-4d34-80f0-23d2f8e7eb07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:27.159807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d306abe2-2361-4d34-80f0-23d2f8e7eb07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:27.160588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d306abe2-2361-4d34-80f0-23d2f8e7eb07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:27.161286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d306abe2-2361-4d34-80f0-23d2f8e7eb07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:27.236238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d306abe2-2361-4d34-80f0-23d2f8e7eb07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:27.244836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d306abe2-2361-4d34-80f0-23d2f8e7eb07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.106292 Sep 13 20:21:27.245409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1100/2283] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:27 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:27.634397 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-613d98d4-1936-4a8f-9c74-4e96b618a07f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:27.635434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-613d98d4-1936-4a8f-9c74-4e96b618a07f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:27.645462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-613d98d4-1936-4a8f-9c74-4e96b618a07f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:27.645856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-613d98d4-1936-4a8f-9c74-4e96b618a07f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:27.646303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-613d98d4-1936-4a8f-9c74-4e96b618a07f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:27.647019 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-613d98d4-1936-4a8f-9c74-4e96b618a07f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:27.647463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-613d98d4-1936-4a8f-9c74-4e96b618a07f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:27.647881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-613d98d4-1936-4a8f-9c74-4e96b618a07f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:27.781632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-613d98d4-1936-4a8f-9c74-4e96b618a07f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:27.795198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-613d98d4-1936-4a8f-9c74-4e96b618a07f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:27.797342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-613d98d4-1936-4a8f-9c74-4e96b618a07f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:27.798527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-613d98d4-1936-4a8f-9c74-4e96b618a07f tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.171146 Sep 13 20:21:27.799101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1184/2284] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:27 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:28.271759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4cb30780-8386-4131-9fde-53eb19231837 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:28.272752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4cb30780-8386-4131-9fde-53eb19231837 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:28.282811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cb30780-8386-4131-9fde-53eb19231837 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:28.283296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cb30780-8386-4131-9fde-53eb19231837 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:28.283694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cb30780-8386-4131-9fde-53eb19231837 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:28.284452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cb30780-8386-4131-9fde-53eb19231837 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:28.284871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cb30780-8386-4131-9fde-53eb19231837 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:28.285309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4cb30780-8386-4131-9fde-53eb19231837 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:28.348554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4cb30780-8386-4131-9fde-53eb19231837 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:28.357190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4cb30780-8386-4131-9fde-53eb19231837 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092120 Sep 13 20:21:28.357758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1101/2285] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:28.828608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-755098ab-67a6-453c-9a86-88e7dbcebf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:28.829460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-755098ab-67a6-453c-9a86-88e7dbcebf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:28.840352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-755098ab-67a6-453c-9a86-88e7dbcebf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:28.841143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-755098ab-67a6-453c-9a86-88e7dbcebf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:28.841910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-755098ab-67a6-453c-9a86-88e7dbcebf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:28.843190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-755098ab-67a6-453c-9a86-88e7dbcebf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:28.843980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-755098ab-67a6-453c-9a86-88e7dbcebf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:28.844402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-755098ab-67a6-453c-9a86-88e7dbcebf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:28.975500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-755098ab-67a6-453c-9a86-88e7dbcebf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:28.984853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-755098ab-67a6-453c-9a86-88e7dbcebf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:28.986296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-755098ab-67a6-453c-9a86-88e7dbcebf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:28.987548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-755098ab-67a6-453c-9a86-88e7dbcebf80 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.166052 Sep 13 20:21:28.988119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1185/2286] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:29.384714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7f6a8df1-25ac-4fc9-a6dc-7520dfd8bf5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:29.385620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7f6a8df1-25ac-4fc9-a6dc-7520dfd8bf5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:29.394190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f6a8df1-25ac-4fc9-a6dc-7520dfd8bf5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:29.394690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f6a8df1-25ac-4fc9-a6dc-7520dfd8bf5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:29.395117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f6a8df1-25ac-4fc9-a6dc-7520dfd8bf5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:29.395791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f6a8df1-25ac-4fc9-a6dc-7520dfd8bf5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:29.396233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f6a8df1-25ac-4fc9-a6dc-7520dfd8bf5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:29.396658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f6a8df1-25ac-4fc9-a6dc-7520dfd8bf5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:29.461991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7f6a8df1-25ac-4fc9-a6dc-7520dfd8bf5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:29.470709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7f6a8df1-25ac-4fc9-a6dc-7520dfd8bf5c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092116 Sep 13 20:21:29.471281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1102/2287] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:30.017749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ea3d5479-f18a-4727-abe5-99fe985510d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:30.018792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ea3d5479-f18a-4727-abe5-99fe985510d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:30.029519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ea3d5479-f18a-4727-abe5-99fe985510d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:30.030294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ea3d5479-f18a-4727-abe5-99fe985510d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:30.031022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ea3d5479-f18a-4727-abe5-99fe985510d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:30.032161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ea3d5479-f18a-4727-abe5-99fe985510d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:30.032902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ea3d5479-f18a-4727-abe5-99fe985510d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:30.033624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ea3d5479-f18a-4727-abe5-99fe985510d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:30.172632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ea3d5479-f18a-4727-abe5-99fe985510d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:30.181853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ea3d5479-f18a-4727-abe5-99fe985510d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:30.183335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ea3d5479-f18a-4727-abe5-99fe985510d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:30.184454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ea3d5479-f18a-4727-abe5-99fe985510d3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173290 Sep 13 20:21:30.185009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1186/2288] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:30 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:30.497790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1455abaa-23e7-4ccf-8cb9-897744ca1d90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:30.498878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1455abaa-23e7-4ccf-8cb9-897744ca1d90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:30.506421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1455abaa-23e7-4ccf-8cb9-897744ca1d90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:30.507017 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1455abaa-23e7-4ccf-8cb9-897744ca1d90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:30.507467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1455abaa-23e7-4ccf-8cb9-897744ca1d90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:30.508223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1455abaa-23e7-4ccf-8cb9-897744ca1d90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:30.508720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1455abaa-23e7-4ccf-8cb9-897744ca1d90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:30.509248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1455abaa-23e7-4ccf-8cb9-897744ca1d90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:30.577252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1455abaa-23e7-4ccf-8cb9-897744ca1d90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:30.586092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1455abaa-23e7-4ccf-8cb9-897744ca1d90 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094827 Sep 13 20:21:30.586695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1103/2289] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:30 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:31.220351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1946c4ac-a9c0-4492-9e64-ec899663aa13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:31.220991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1946c4ac-a9c0-4492-9e64-ec899663aa13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:31.227842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1946c4ac-a9c0-4492-9e64-ec899663aa13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:31.228317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1946c4ac-a9c0-4492-9e64-ec899663aa13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:31.228750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1946c4ac-a9c0-4492-9e64-ec899663aa13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:31.229431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1946c4ac-a9c0-4492-9e64-ec899663aa13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:31.229875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1946c4ac-a9c0-4492-9e64-ec899663aa13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:31.230292 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1946c4ac-a9c0-4492-9e64-ec899663aa13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:31.364504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1946c4ac-a9c0-4492-9e64-ec899663aa13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:31.373648 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1946c4ac-a9c0-4492-9e64-ec899663aa13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:31.375125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1946c4ac-a9c0-4492-9e64-ec899663aa13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:31.376288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1946c4ac-a9c0-4492-9e64-ec899663aa13 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161664 Sep 13 20:21:31.376876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1187/2290] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:31 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:31.614795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-826bff85-0b0a-48f3-b3b0-7d06c88c21a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:31.615794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-826bff85-0b0a-48f3-b3b0-7d06c88c21a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:31.626781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-826bff85-0b0a-48f3-b3b0-7d06c88c21a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:31.627579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-826bff85-0b0a-48f3-b3b0-7d06c88c21a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:31.628308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-826bff85-0b0a-48f3-b3b0-7d06c88c21a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:31.629457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-826bff85-0b0a-48f3-b3b0-7d06c88c21a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:31.630189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-826bff85-0b0a-48f3-b3b0-7d06c88c21a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:31.630887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-826bff85-0b0a-48f3-b3b0-7d06c88c21a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:31.706780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-826bff85-0b0a-48f3-b3b0-7d06c88c21a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:31.717558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-826bff85-0b0a-48f3-b3b0-7d06c88c21a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.109277 Sep 13 20:21:31.718346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1104/2291] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:31 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:32.406304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-46e50a35-596a-4af8-b440-e12f2eb3177d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:32.407303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-46e50a35-596a-4af8-b440-e12f2eb3177d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:32.418268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46e50a35-596a-4af8-b440-e12f2eb3177d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:32.419163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46e50a35-596a-4af8-b440-e12f2eb3177d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:32.419891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46e50a35-596a-4af8-b440-e12f2eb3177d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:32.421022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46e50a35-596a-4af8-b440-e12f2eb3177d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:32.421864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46e50a35-596a-4af8-b440-e12f2eb3177d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:32.422285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46e50a35-596a-4af8-b440-e12f2eb3177d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:32.712157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-46e50a35-596a-4af8-b440-e12f2eb3177d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:32.721172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-46e50a35-596a-4af8-b440-e12f2eb3177d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:32.722633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-46e50a35-596a-4af8-b440-e12f2eb3177d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:32.723791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-46e50a35-596a-4af8-b440-e12f2eb3177d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.324082 Sep 13 20:21:32.724351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1188/2292] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:32 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:32.740986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-42a800c8-4162-4140-a01c-0e03fd12408c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:32.741571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-42a800c8-4162-4140-a01c-0e03fd12408c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:32.749988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42a800c8-4162-4140-a01c-0e03fd12408c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:32.749988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42a800c8-4162-4140-a01c-0e03fd12408c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:32.749988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42a800c8-4162-4140-a01c-0e03fd12408c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:32.750343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42a800c8-4162-4140-a01c-0e03fd12408c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:32.750783 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42a800c8-4162-4140-a01c-0e03fd12408c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:32.751215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-42a800c8-4162-4140-a01c-0e03fd12408c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:32.818398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-42a800c8-4162-4140-a01c-0e03fd12408c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:32.827118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-42a800c8-4162-4140-a01c-0e03fd12408c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090016 Sep 13 20:21:32.827683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1105/2293] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:32 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:33.753427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a361cb6f-8b07-4b44-a7b0-98d66616fd38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:33.754432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a361cb6f-8b07-4b44-a7b0-98d66616fd38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:33.765466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a361cb6f-8b07-4b44-a7b0-98d66616fd38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:33.765978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a361cb6f-8b07-4b44-a7b0-98d66616fd38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:33.766395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a361cb6f-8b07-4b44-a7b0-98d66616fd38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:33.767103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a361cb6f-8b07-4b44-a7b0-98d66616fd38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:33.767556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a361cb6f-8b07-4b44-a7b0-98d66616fd38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:33.767977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a361cb6f-8b07-4b44-a7b0-98d66616fd38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:33.850541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-85e7d4dc-7b45-4dea-973f-e05b84294556 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:33.851155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-85e7d4dc-7b45-4dea-973f-e05b84294556 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:33.857735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-85e7d4dc-7b45-4dea-973f-e05b84294556 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:33.858212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-85e7d4dc-7b45-4dea-973f-e05b84294556 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:33.858677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-85e7d4dc-7b45-4dea-973f-e05b84294556 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:33.859468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-85e7d4dc-7b45-4dea-973f-e05b84294556 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:33.859908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-85e7d4dc-7b45-4dea-973f-e05b84294556 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:33.860321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-85e7d4dc-7b45-4dea-973f-e05b84294556 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:33.862961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:21:33.902956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a361cb6f-8b07-4b44-a7b0-98d66616fd38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:33.911847 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a361cb6f-8b07-4b44-a7b0-98d66616fd38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:33.913274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a361cb6f-8b07-4b44-a7b0-98d66616fd38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:33.914461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a361cb6f-8b07-4b44-a7b0-98d66616fd38 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167681 Sep 13 20:21:33.914975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1189/2294] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:33 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:33.927341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-85e7d4dc-7b45-4dea-973f-e05b84294556 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:33.935825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-85e7d4dc-7b45-4dea-973f-e05b84294556 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.089197 Sep 13 20:21:33.936392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1106/2295] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:33 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:34.942164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dca843c3-ebe3-42a4-8510-639ead2b0828 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:34.942801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dca843c3-ebe3-42a4-8510-639ead2b0828 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:34.950230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dca843c3-ebe3-42a4-8510-639ead2b0828 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:34.950840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dca843c3-ebe3-42a4-8510-639ead2b0828 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:34.951316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dca843c3-ebe3-42a4-8510-639ead2b0828 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:34.952078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dca843c3-ebe3-42a4-8510-639ead2b0828 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:34.952572 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dca843c3-ebe3-42a4-8510-639ead2b0828 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:34.953381 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dca843c3-ebe3-42a4-8510-639ead2b0828 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:34.959078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a110dcc6-f041-4149-99d9-706b770f929d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:34.959754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a110dcc6-f041-4149-99d9-706b770f929d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:34.967426 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a110dcc6-f041-4149-99d9-706b770f929d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:34.967960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a110dcc6-f041-4149-99d9-706b770f929d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:34.968556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a110dcc6-f041-4149-99d9-706b770f929d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:34.969256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a110dcc6-f041-4149-99d9-706b770f929d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:34.969709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a110dcc6-f041-4149-99d9-706b770f929d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:34.970140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a110dcc6-f041-4149-99d9-706b770f929d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:35.032511 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a110dcc6-f041-4149-99d9-706b770f929d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:35.041022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a110dcc6-f041-4149-99d9-706b770f929d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.086256 Sep 13 20:21:35.041637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1107/2296] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:34 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:35.083922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dca843c3-ebe3-42a4-8510-639ead2b0828 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:35.092609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dca843c3-ebe3-42a4-8510-639ead2b0828 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:35.094199 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dca843c3-ebe3-42a4-8510-639ead2b0828 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:35.095396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dca843c3-ebe3-42a4-8510-639ead2b0828 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158011 Sep 13 20:21:35.095917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1190/2297] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:34 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:36.067607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-79450eb4-6780-4ae4-9921-4d79046a3479 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:36.068533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-79450eb4-6780-4ae4-9921-4d79046a3479 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:36.079246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79450eb4-6780-4ae4-9921-4d79046a3479 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:36.079721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79450eb4-6780-4ae4-9921-4d79046a3479 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:36.080239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79450eb4-6780-4ae4-9921-4d79046a3479 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:36.080935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79450eb4-6780-4ae4-9921-4d79046a3479 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:36.081354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79450eb4-6780-4ae4-9921-4d79046a3479 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:36.081765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-79450eb4-6780-4ae4-9921-4d79046a3479 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:36.127629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-be7cd1c0-1cf5-4fb8-8173-215fa2756948 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:36.128246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-be7cd1c0-1cf5-4fb8-8173-215fa2756948 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:36.134973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be7cd1c0-1cf5-4fb8-8173-215fa2756948 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:36.135454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be7cd1c0-1cf5-4fb8-8173-215fa2756948 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:36.135884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be7cd1c0-1cf5-4fb8-8173-215fa2756948 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:36.136564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be7cd1c0-1cf5-4fb8-8173-215fa2756948 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:36.137009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be7cd1c0-1cf5-4fb8-8173-215fa2756948 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:36.137466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be7cd1c0-1cf5-4fb8-8173-215fa2756948 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:36.143332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-79450eb4-6780-4ae4-9921-4d79046a3479 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:36.152110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-79450eb4-6780-4ae4-9921-4d79046a3479 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091116 Sep 13 20:21:36.152768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1108/2298] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:36 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:36.272798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-be7cd1c0-1cf5-4fb8-8173-215fa2756948 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:36.284309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-be7cd1c0-1cf5-4fb8-8173-215fa2756948 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:36.285796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-be7cd1c0-1cf5-4fb8-8173-215fa2756948 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:36.286985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-be7cd1c0-1cf5-4fb8-8173-215fa2756948 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.163330 Sep 13 20:21:36.287533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1191/2299] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:36 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:37.180127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-de2c5a62-6670-49c3-b3b7-800dc1bbf5b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:37.181146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-de2c5a62-6670-49c3-b3b7-800dc1bbf5b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:37.184803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:21:37.191602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de2c5a62-6670-49c3-b3b7-800dc1bbf5b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:37.192084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de2c5a62-6670-49c3-b3b7-800dc1bbf5b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:37.192515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de2c5a62-6670-49c3-b3b7-800dc1bbf5b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:37.193209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de2c5a62-6670-49c3-b3b7-800dc1bbf5b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:37.193648 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de2c5a62-6670-49c3-b3b7-800dc1bbf5b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:37.194229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-de2c5a62-6670-49c3-b3b7-800dc1bbf5b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:37.260883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-de2c5a62-6670-49c3-b3b7-800dc1bbf5b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:37.271028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-de2c5a62-6670-49c3-b3b7-800dc1bbf5b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.097444 Sep 13 20:21:37.271592 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1109/2300] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:37 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:37.312227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4618235e-8db2-47a3-a5fc-462b7d3c2687 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:37.312865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4618235e-8db2-47a3-a5fc-462b7d3c2687 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:37.319638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4618235e-8db2-47a3-a5fc-462b7d3c2687 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:37.320113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4618235e-8db2-47a3-a5fc-462b7d3c2687 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:37.320543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4618235e-8db2-47a3-a5fc-462b7d3c2687 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:37.321226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4618235e-8db2-47a3-a5fc-462b7d3c2687 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:37.321667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4618235e-8db2-47a3-a5fc-462b7d3c2687 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:37.322085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4618235e-8db2-47a3-a5fc-462b7d3c2687 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:37.452706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4618235e-8db2-47a3-a5fc-462b7d3c2687 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:37.462317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4618235e-8db2-47a3-a5fc-462b7d3c2687 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:37.463798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4618235e-8db2-47a3-a5fc-462b7d3c2687 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:37.464971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4618235e-8db2-47a3-a5fc-462b7d3c2687 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.156733 Sep 13 20:21:37.465526 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1192/2301] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:37 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:38.298557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3b7805f7-f08f-4f04-993a-617d67b70659 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:38.299519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3b7805f7-f08f-4f04-993a-617d67b70659 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:38.310415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b7805f7-f08f-4f04-993a-617d67b70659 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:38.311205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b7805f7-f08f-4f04-993a-617d67b70659 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:38.311922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b7805f7-f08f-4f04-993a-617d67b70659 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:38.313032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b7805f7-f08f-4f04-993a-617d67b70659 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:38.313768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b7805f7-f08f-4f04-993a-617d67b70659 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:38.314472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b7805f7-f08f-4f04-993a-617d67b70659 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:38.386207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3b7805f7-f08f-4f04-993a-617d67b70659 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:38.394779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3b7805f7-f08f-4f04-993a-617d67b70659 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.102803 Sep 13 20:21:38.395344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1110/2302] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:38 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:38.493790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ce450d30-9ac4-47d3-a938-1c8686b7a0cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:38.494788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ce450d30-9ac4-47d3-a938-1c8686b7a0cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:38.498454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:21:38.504181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ce450d30-9ac4-47d3-a938-1c8686b7a0cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:38.504656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ce450d30-9ac4-47d3-a938-1c8686b7a0cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:38.505080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ce450d30-9ac4-47d3-a938-1c8686b7a0cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:38.505758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ce450d30-9ac4-47d3-a938-1c8686b7a0cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:38.506198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ce450d30-9ac4-47d3-a938-1c8686b7a0cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:38.506637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ce450d30-9ac4-47d3-a938-1c8686b7a0cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:38.639971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ce450d30-9ac4-47d3-a938-1c8686b7a0cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:38.648877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ce450d30-9ac4-47d3-a938-1c8686b7a0cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:38.650280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ce450d30-9ac4-47d3-a938-1c8686b7a0cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:38.651479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ce450d30-9ac4-47d3-a938-1c8686b7a0cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.164300 Sep 13 20:21:38.652039 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1193/2303] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:38 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:39.417372 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-83ccd43f-6f5b-4817-9c6d-c3f149234b10 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:39.417978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-83ccd43f-6f5b-4817-9c6d-c3f149234b10 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:39.425364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-83ccd43f-6f5b-4817-9c6d-c3f149234b10 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:39.425944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-83ccd43f-6f5b-4817-9c6d-c3f149234b10 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:39.426395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-83ccd43f-6f5b-4817-9c6d-c3f149234b10 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:39.427215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-83ccd43f-6f5b-4817-9c6d-c3f149234b10 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:39.427666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-83ccd43f-6f5b-4817-9c6d-c3f149234b10 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:39.428084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-83ccd43f-6f5b-4817-9c6d-c3f149234b10 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:39.498349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-83ccd43f-6f5b-4817-9c6d-c3f149234b10 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:39.507293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-83ccd43f-6f5b-4817-9c6d-c3f149234b10 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093837 Sep 13 20:21:39.507849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1111/2304] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:39 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:39.677088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ae49dae5-6383-4a80-be82-81db40c552b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:39.677671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ae49dae5-6383-4a80-be82-81db40c552b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:39.684652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae49dae5-6383-4a80-be82-81db40c552b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:39.685144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae49dae5-6383-4a80-be82-81db40c552b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:39.685596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae49dae5-6383-4a80-be82-81db40c552b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:39.686496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae49dae5-6383-4a80-be82-81db40c552b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:39.686948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae49dae5-6383-4a80-be82-81db40c552b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:39.687372 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae49dae5-6383-4a80-be82-81db40c552b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:39.819270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ae49dae5-6383-4a80-be82-81db40c552b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:39.828344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ae49dae5-6383-4a80-be82-81db40c552b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:39.829865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ae49dae5-6383-4a80-be82-81db40c552b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:39.831027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ae49dae5-6383-4a80-be82-81db40c552b5 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158058 Sep 13 20:21:39.831600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1194/2305] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:39 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:40.534855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d249e485-e4bd-4d28-a6bd-6feceb35cb43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:40.535806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d249e485-e4bd-4d28-a6bd-6feceb35cb43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:40.546839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d249e485-e4bd-4d28-a6bd-6feceb35cb43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:40.547317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d249e485-e4bd-4d28-a6bd-6feceb35cb43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:40.547742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d249e485-e4bd-4d28-a6bd-6feceb35cb43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:40.548427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d249e485-e4bd-4d28-a6bd-6feceb35cb43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:40.548870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d249e485-e4bd-4d28-a6bd-6feceb35cb43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:40.549289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d249e485-e4bd-4d28-a6bd-6feceb35cb43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:40.613279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d249e485-e4bd-4d28-a6bd-6feceb35cb43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:40.621928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d249e485-e4bd-4d28-a6bd-6feceb35cb43 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093548 Sep 13 20:21:40.622504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1112/2306] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:40 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:40.856939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6004a01e-74fa-4c60-8184-86ea29af0953 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:40.857580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6004a01e-74fa-4c60-8184-86ea29af0953 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:40.865027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6004a01e-74fa-4c60-8184-86ea29af0953 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:40.865513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6004a01e-74fa-4c60-8184-86ea29af0953 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:40.865943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6004a01e-74fa-4c60-8184-86ea29af0953 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:40.866654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6004a01e-74fa-4c60-8184-86ea29af0953 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:40.867103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6004a01e-74fa-4c60-8184-86ea29af0953 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:40.867516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6004a01e-74fa-4c60-8184-86ea29af0953 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:41.000352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6004a01e-74fa-4c60-8184-86ea29af0953 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:41.009545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6004a01e-74fa-4c60-8184-86ea29af0953 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:41.011356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6004a01e-74fa-4c60-8184-86ea29af0953 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:41.012532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6004a01e-74fa-4c60-8184-86ea29af0953 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.159555 Sep 13 20:21:41.013104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1195/2307] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:40 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:41.649117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7dca8550-c3da-4a92-bb8c-25140f98481e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:41.650120 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7dca8550-c3da-4a92-bb8c-25140f98481e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:41.659285 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7dca8550-c3da-4a92-bb8c-25140f98481e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:41.659760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7dca8550-c3da-4a92-bb8c-25140f98481e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:41.660195 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7dca8550-c3da-4a92-bb8c-25140f98481e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:41.660882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7dca8550-c3da-4a92-bb8c-25140f98481e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:41.661330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7dca8550-c3da-4a92-bb8c-25140f98481e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:41.661751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7dca8550-c3da-4a92-bb8c-25140f98481e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:41.723269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7dca8550-c3da-4a92-bb8c-25140f98481e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:41.732050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7dca8550-c3da-4a92-bb8c-25140f98481e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.089670 Sep 13 20:21:41.732615 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1113/2308] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:41 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:42.038808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-645f9b62-2571-4f6c-aa14-aa4f608f1118 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:42.039436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-645f9b62-2571-4f6c-aa14-aa4f608f1118 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:42.046425 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-645f9b62-2571-4f6c-aa14-aa4f608f1118 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:42.046939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-645f9b62-2571-4f6c-aa14-aa4f608f1118 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:42.047412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-645f9b62-2571-4f6c-aa14-aa4f608f1118 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:42.048101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-645f9b62-2571-4f6c-aa14-aa4f608f1118 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:42.048552 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-645f9b62-2571-4f6c-aa14-aa4f608f1118 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:42.048976 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-645f9b62-2571-4f6c-aa14-aa4f608f1118 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:42.186707 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-645f9b62-2571-4f6c-aa14-aa4f608f1118 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:42.195938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-645f9b62-2571-4f6c-aa14-aa4f608f1118 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:42.197365 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-645f9b62-2571-4f6c-aa14-aa4f608f1118 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:42.198587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-645f9b62-2571-4f6c-aa14-aa4f608f1118 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.163812 Sep 13 20:21:42.199142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1196/2309] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:42 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:42.759715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3b4cfc42-e3bb-4c3b-9b74-e91889e498d2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:42.760744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3b4cfc42-e3bb-4c3b-9b74-e91889e498d2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:42.770400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b4cfc42-e3bb-4c3b-9b74-e91889e498d2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:42.770884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b4cfc42-e3bb-4c3b-9b74-e91889e498d2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:42.771325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b4cfc42-e3bb-4c3b-9b74-e91889e498d2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:42.772008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b4cfc42-e3bb-4c3b-9b74-e91889e498d2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:42.772457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b4cfc42-e3bb-4c3b-9b74-e91889e498d2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:42.772880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b4cfc42-e3bb-4c3b-9b74-e91889e498d2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:42.840542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3b4cfc42-e3bb-4c3b-9b74-e91889e498d2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:42.849109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3b4cfc42-e3bb-4c3b-9b74-e91889e498d2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096189 Sep 13 20:21:42.849682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1114/2310] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:42 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:43.228679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-320adb98-0f93-4414-8801-0d3184e344f9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:43.229635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-320adb98-0f93-4414-8801-0d3184e344f9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:43.240474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-320adb98-0f93-4414-8801-0d3184e344f9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:43.241262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-320adb98-0f93-4414-8801-0d3184e344f9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:43.241970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-320adb98-0f93-4414-8801-0d3184e344f9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:43.243154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-320adb98-0f93-4414-8801-0d3184e344f9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:43.243897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-320adb98-0f93-4414-8801-0d3184e344f9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:43.244591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-320adb98-0f93-4414-8801-0d3184e344f9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:43.377723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-320adb98-0f93-4414-8801-0d3184e344f9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:43.386755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-320adb98-0f93-4414-8801-0d3184e344f9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:43.388189 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-320adb98-0f93-4414-8801-0d3184e344f9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:43.389354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-320adb98-0f93-4414-8801-0d3184e344f9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167421 Sep 13 20:21:43.389913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1197/2311] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:43 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:43.876592 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0fc5721d-742f-4b6d-9274-dbecb1dc7313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:43.877398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0fc5721d-742f-4b6d-9274-dbecb1dc7313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:43.885611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0fc5721d-742f-4b6d-9274-dbecb1dc7313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:43.886160 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0fc5721d-742f-4b6d-9274-dbecb1dc7313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:43.886695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0fc5721d-742f-4b6d-9274-dbecb1dc7313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:43.887493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0fc5721d-742f-4b6d-9274-dbecb1dc7313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:43.888014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0fc5721d-742f-4b6d-9274-dbecb1dc7313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:43.888497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0fc5721d-742f-4b6d-9274-dbecb1dc7313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:43.953418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0fc5721d-742f-4b6d-9274-dbecb1dc7313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:43.962260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0fc5721d-742f-4b6d-9274-dbecb1dc7313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092355 Sep 13 20:21:43.962878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1115/2312] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:43 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:44.419215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0c4f18e4-666e-492c-8e19-8a6b928ef058 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:44.420241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0c4f18e4-666e-492c-8e19-8a6b928ef058 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:44.428364 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0c4f18e4-666e-492c-8e19-8a6b928ef058 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:44.428843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0c4f18e4-666e-492c-8e19-8a6b928ef058 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:44.429268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0c4f18e4-666e-492c-8e19-8a6b928ef058 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:44.429949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0c4f18e4-666e-492c-8e19-8a6b928ef058 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:44.430400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0c4f18e4-666e-492c-8e19-8a6b928ef058 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:44.430852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0c4f18e4-666e-492c-8e19-8a6b928ef058 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:44.577522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0c4f18e4-666e-492c-8e19-8a6b928ef058 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:44.591091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0c4f18e4-666e-492c-8e19-8a6b928ef058 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:44.593277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0c4f18e4-666e-492c-8e19-8a6b928ef058 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:44.595067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0c4f18e4-666e-492c-8e19-8a6b928ef058 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.182172 Sep 13 20:21:44.595647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1198/2313] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:44 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:44.985547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f83dd711-7fa8-46dc-b456-a3ebd5839c77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:44.986258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f83dd711-7fa8-46dc-b456-a3ebd5839c77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:44.992990 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f83dd711-7fa8-46dc-b456-a3ebd5839c77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:44.993502 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f83dd711-7fa8-46dc-b456-a3ebd5839c77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:44.993906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f83dd711-7fa8-46dc-b456-a3ebd5839c77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:44.994655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f83dd711-7fa8-46dc-b456-a3ebd5839c77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:44.995100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f83dd711-7fa8-46dc-b456-a3ebd5839c77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:44.995522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f83dd711-7fa8-46dc-b456-a3ebd5839c77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:45.063735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f83dd711-7fa8-46dc-b456-a3ebd5839c77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:45.072396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f83dd711-7fa8-46dc-b456-a3ebd5839c77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090902 Sep 13 20:21:45.072980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1116/2314] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:44 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:45.624617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c86f2f38-fbf0-4505-834f-1653c19fdfab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:45.625569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c86f2f38-fbf0-4505-834f-1653c19fdfab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:45.636396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c86f2f38-fbf0-4505-834f-1653c19fdfab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:45.637171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c86f2f38-fbf0-4505-834f-1653c19fdfab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:45.637868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c86f2f38-fbf0-4505-834f-1653c19fdfab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:45.639027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c86f2f38-fbf0-4505-834f-1653c19fdfab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:45.639763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c86f2f38-fbf0-4505-834f-1653c19fdfab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:45.640453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c86f2f38-fbf0-4505-834f-1653c19fdfab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:45.774272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c86f2f38-fbf0-4505-834f-1653c19fdfab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:45.788016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c86f2f38-fbf0-4505-834f-1653c19fdfab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:45.790228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c86f2f38-fbf0-4505-834f-1653c19fdfab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:45.791850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c86f2f38-fbf0-4505-834f-1653c19fdfab tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173660 Sep 13 20:21:45.792613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1199/2315] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:45 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:46.098889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e8c119f0-418e-43bc-bfb9-99b757754ed1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:46.099588 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e8c119f0-418e-43bc-bfb9-99b757754ed1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:46.107562 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8c119f0-418e-43bc-bfb9-99b757754ed1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:46.108124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8c119f0-418e-43bc-bfb9-99b757754ed1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:46.108627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8c119f0-418e-43bc-bfb9-99b757754ed1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:46.109423 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8c119f0-418e-43bc-bfb9-99b757754ed1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:46.109951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8c119f0-418e-43bc-bfb9-99b757754ed1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:46.110471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8c119f0-418e-43bc-bfb9-99b757754ed1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:46.174058 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e8c119f0-418e-43bc-bfb9-99b757754ed1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:46.182792 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e8c119f0-418e-43bc-bfb9-99b757754ed1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.089214 Sep 13 20:21:46.183357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1117/2316] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:46 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:46.821669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b154afff-4529-4ce1-b94d-967bbd02bca0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:46.822961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b154afff-4529-4ce1-b94d-967bbd02bca0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:46.834105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b154afff-4529-4ce1-b94d-967bbd02bca0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:46.834890 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b154afff-4529-4ce1-b94d-967bbd02bca0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:46.835579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b154afff-4529-4ce1-b94d-967bbd02bca0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:46.836692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b154afff-4529-4ce1-b94d-967bbd02bca0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:46.837377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b154afff-4529-4ce1-b94d-967bbd02bca0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:46.837970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b154afff-4529-4ce1-b94d-967bbd02bca0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:46.841989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:21:46.988033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b154afff-4529-4ce1-b94d-967bbd02bca0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:46.997042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b154afff-4529-4ce1-b94d-967bbd02bca0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:46.998499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b154afff-4529-4ce1-b94d-967bbd02bca0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:46.999668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b154afff-4529-4ce1-b94d-967bbd02bca0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.184518 Sep 13 20:21:47.000224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1200/2317] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:46 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:47.210317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0f35bd77-7092-4230-9044-984e15b22b12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:47.211363 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0f35bd77-7092-4230-9044-984e15b22b12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:47.222048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f35bd77-7092-4230-9044-984e15b22b12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:47.222962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f35bd77-7092-4230-9044-984e15b22b12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:47.223788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f35bd77-7092-4230-9044-984e15b22b12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:47.224863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f35bd77-7092-4230-9044-984e15b22b12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:47.225660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f35bd77-7092-4230-9044-984e15b22b12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:47.226361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f35bd77-7092-4230-9044-984e15b22b12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:47.297570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0f35bd77-7092-4230-9044-984e15b22b12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:47.309602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0f35bd77-7092-4230-9044-984e15b22b12 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.106244 Sep 13 20:21:47.310646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1118/2318] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:47 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:48.025440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-73743c83-7c66-43b9-b045-19cb1aea75c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:48.026081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-73743c83-7c66-43b9-b045-19cb1aea75c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:48.032812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73743c83-7c66-43b9-b045-19cb1aea75c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:48.033284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73743c83-7c66-43b9-b045-19cb1aea75c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:48.033706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73743c83-7c66-43b9-b045-19cb1aea75c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:48.034391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73743c83-7c66-43b9-b045-19cb1aea75c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:48.034848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73743c83-7c66-43b9-b045-19cb1aea75c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:48.035259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73743c83-7c66-43b9-b045-19cb1aea75c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:48.165876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-73743c83-7c66-43b9-b045-19cb1aea75c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:48.174709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-73743c83-7c66-43b9-b045-19cb1aea75c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:48.176129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-73743c83-7c66-43b9-b045-19cb1aea75c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:48.177304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-73743c83-7c66-43b9-b045-19cb1aea75c1 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.155878 Sep 13 20:21:48.177851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1201/2319] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:48 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:48.342286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2a0cd1bc-6006-4846-b038-40ae21df2a82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:48.342905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2a0cd1bc-6006-4846-b038-40ae21df2a82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:48.349880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a0cd1bc-6006-4846-b038-40ae21df2a82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:48.350214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a0cd1bc-6006-4846-b038-40ae21df2a82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:48.350917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a0cd1bc-6006-4846-b038-40ae21df2a82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:48.351734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a0cd1bc-6006-4846-b038-40ae21df2a82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:48.352236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a0cd1bc-6006-4846-b038-40ae21df2a82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:48.352784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2a0cd1bc-6006-4846-b038-40ae21df2a82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:48.415004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2a0cd1bc-6006-4846-b038-40ae21df2a82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:48.423791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2a0cd1bc-6006-4846-b038-40ae21df2a82 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085549 Sep 13 20:21:48.424360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1119/2320] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:48 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:49.207479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a6573419-7eee-491c-b190-011a45f6e1bb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:49.208350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a6573419-7eee-491c-b190-011a45f6e1bb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:49.219319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a6573419-7eee-491c-b190-011a45f6e1bb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:49.220253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a6573419-7eee-491c-b190-011a45f6e1bb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:49.220710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a6573419-7eee-491c-b190-011a45f6e1bb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:49.221401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a6573419-7eee-491c-b190-011a45f6e1bb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:49.221854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a6573419-7eee-491c-b190-011a45f6e1bb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:49.223000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a6573419-7eee-491c-b190-011a45f6e1bb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:49.368279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a6573419-7eee-491c-b190-011a45f6e1bb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:49.377053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a6573419-7eee-491c-b190-011a45f6e1bb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:49.378487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a6573419-7eee-491c-b190-011a45f6e1bb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:49.379624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a6573419-7eee-491c-b190-011a45f6e1bb tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.179326 Sep 13 20:21:49.380175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1202/2321] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:49 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:49.447077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4092668e-5e99-4061-847e-3d54be94967e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:49.447642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4092668e-5e99-4061-847e-3d54be94967e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:49.454952 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4092668e-5e99-4061-847e-3d54be94967e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:49.455421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4092668e-5e99-4061-847e-3d54be94967e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:49.455851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4092668e-5e99-4061-847e-3d54be94967e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:49.456523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4092668e-5e99-4061-847e-3d54be94967e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:49.456968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4092668e-5e99-4061-847e-3d54be94967e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:49.457381 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4092668e-5e99-4061-847e-3d54be94967e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:49.528593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4092668e-5e99-4061-847e-3d54be94967e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:49.537530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4092668e-5e99-4061-847e-3d54be94967e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094387 Sep 13 20:21:49.538104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1120/2322] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:49 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:50.409084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-23ba66e3-8358-46d0-96d8-8753c272ec2d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:50.409681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-23ba66e3-8358-46d0-96d8-8753c272ec2d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:50.416524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23ba66e3-8358-46d0-96d8-8753c272ec2d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:50.416997 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23ba66e3-8358-46d0-96d8-8753c272ec2d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:50.417423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23ba66e3-8358-46d0-96d8-8753c272ec2d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:50.418098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23ba66e3-8358-46d0-96d8-8753c272ec2d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:50.418581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23ba66e3-8358-46d0-96d8-8753c272ec2d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:50.418995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23ba66e3-8358-46d0-96d8-8753c272ec2d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:50.560533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-23ba66e3-8358-46d0-96d8-8753c272ec2d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:50.560939 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d2c74175-5f20-4c83-8947-0a6917fcc462 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:50.561548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d2c74175-5f20-4c83-8947-0a6917fcc462 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:50.568721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2c74175-5f20-4c83-8947-0a6917fcc462 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:50.569210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2c74175-5f20-4c83-8947-0a6917fcc462 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:50.569645 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2c74175-5f20-4c83-8947-0a6917fcc462 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:50.570024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-23ba66e3-8358-46d0-96d8-8753c272ec2d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:50.570308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2c74175-5f20-4c83-8947-0a6917fcc462 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:50.571065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2c74175-5f20-4c83-8947-0a6917fcc462 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:50.571480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2c74175-5f20-4c83-8947-0a6917fcc462 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:50.571623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-23ba66e3-8358-46d0-96d8-8753c272ec2d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:50.572876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-23ba66e3-8358-46d0-96d8-8753c272ec2d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.170072 Sep 13 20:21:50.573232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1203/2323] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:50 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:50.634060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d2c74175-5f20-4c83-8947-0a6917fcc462 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:50.642754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d2c74175-5f20-4c83-8947-0a6917fcc462 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085680 Sep 13 20:21:50.643328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1121/2324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:50 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:51.599903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-728506a5-57fa-4b1a-9ca3-4ff9b22d81be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:51.600488 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-728506a5-57fa-4b1a-9ca3-4ff9b22d81be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:51.607441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-728506a5-57fa-4b1a-9ca3-4ff9b22d81be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:51.607930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-728506a5-57fa-4b1a-9ca3-4ff9b22d81be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:51.608356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-728506a5-57fa-4b1a-9ca3-4ff9b22d81be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:51.609052 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-728506a5-57fa-4b1a-9ca3-4ff9b22d81be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:51.609499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-728506a5-57fa-4b1a-9ca3-4ff9b22d81be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:51.609917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-728506a5-57fa-4b1a-9ca3-4ff9b22d81be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:51.666856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-96ca8433-db80-4d4f-85d2-33b7eb92a50c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:51.667687 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-96ca8433-db80-4d4f-85d2-33b7eb92a50c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:51.675553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96ca8433-db80-4d4f-85d2-33b7eb92a50c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:51.676038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96ca8433-db80-4d4f-85d2-33b7eb92a50c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:51.676473 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96ca8433-db80-4d4f-85d2-33b7eb92a50c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:51.677169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96ca8433-db80-4d4f-85d2-33b7eb92a50c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:51.677654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96ca8433-db80-4d4f-85d2-33b7eb92a50c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:51.678076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-96ca8433-db80-4d4f-85d2-33b7eb92a50c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:51.742517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-728506a5-57fa-4b1a-9ca3-4ff9b22d81be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:51.744218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-96ca8433-db80-4d4f-85d2-33b7eb92a50c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:51.746488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:21:51.751656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-728506a5-57fa-4b1a-9ca3-4ff9b22d81be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:51.753101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-728506a5-57fa-4b1a-9ca3-4ff9b22d81be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:51.753801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-96ca8433-db80-4d4f-85d2-33b7eb92a50c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091049 Sep 13 20:21:51.754268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-728506a5-57fa-4b1a-9ca3-4ff9b22d81be tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.158495 Sep 13 20:21:51.754422 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1122/2325] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:51 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:51.757927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1204/2326] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:51 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:52.781339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1facb80c-315e-46b4-8e7a-b7f738faf785 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:52.782648 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1facb80c-315e-46b4-8e7a-b7f738faf785 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:52.785047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ba12f852-7631-4dcf-a4b1-df2fb967891e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:52.785665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ba12f852-7631-4dcf-a4b1-df2fb967891e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:52.790310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1facb80c-315e-46b4-8e7a-b7f738faf785 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:52.790823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1facb80c-315e-46b4-8e7a-b7f738faf785 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:52.791238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1facb80c-315e-46b4-8e7a-b7f738faf785 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:52.791947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1facb80c-315e-46b4-8e7a-b7f738faf785 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:52.792389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba12f852-7631-4dcf-a4b1-df2fb967891e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:52.792548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1facb80c-315e-46b4-8e7a-b7f738faf785 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:52.792837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1facb80c-315e-46b4-8e7a-b7f738faf785 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:52.792993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba12f852-7631-4dcf-a4b1-df2fb967891e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:52.793283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba12f852-7631-4dcf-a4b1-df2fb967891e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:52.793972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba12f852-7631-4dcf-a4b1-df2fb967891e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:52.794450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba12f852-7631-4dcf-a4b1-df2fb967891e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:52.794873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ba12f852-7631-4dcf-a4b1-df2fb967891e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:52.855003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1facb80c-315e-46b4-8e7a-b7f738faf785 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:52.863680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1facb80c-315e-46b4-8e7a-b7f738faf785 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.088899 Sep 13 20:21:52.864258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1123/2327] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:52 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:52.929461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ba12f852-7631-4dcf-a4b1-df2fb967891e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:52.941754 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ba12f852-7631-4dcf-a4b1-df2fb967891e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:52.943309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ba12f852-7631-4dcf-a4b1-df2fb967891e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:52.944483 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ba12f852-7631-4dcf-a4b1-df2fb967891e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165382 Sep 13 20:21:52.945005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1205/2328] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:52 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:53.891258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5454135e-1ee6-4d16-bf68-c69c17c5f296 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:53.892157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5454135e-1ee6-4d16-bf68-c69c17c5f296 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:53.901290 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5454135e-1ee6-4d16-bf68-c69c17c5f296 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:53.901947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5454135e-1ee6-4d16-bf68-c69c17c5f296 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:53.902645 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5454135e-1ee6-4d16-bf68-c69c17c5f296 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:53.903665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5454135e-1ee6-4d16-bf68-c69c17c5f296 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:53.904462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5454135e-1ee6-4d16-bf68-c69c17c5f296 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:53.904980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5454135e-1ee6-4d16-bf68-c69c17c5f296 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:53.969409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-de4b7e7f-11d8-4d72-856e-e82f9e23d51e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:53.970050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-de4b7e7f-11d8-4d72-856e-e82f9e23d51e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:53.975946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5454135e-1ee6-4d16-bf68-c69c17c5f296 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:53.977044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de4b7e7f-11d8-4d72-856e-e82f9e23d51e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:53.977528 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de4b7e7f-11d8-4d72-856e-e82f9e23d51e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:53.977954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de4b7e7f-11d8-4d72-856e-e82f9e23d51e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:53.978689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de4b7e7f-11d8-4d72-856e-e82f9e23d51e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:53.979129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de4b7e7f-11d8-4d72-856e-e82f9e23d51e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:53.979548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-de4b7e7f-11d8-4d72-856e-e82f9e23d51e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:53.984300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5454135e-1ee6-4d16-bf68-c69c17c5f296 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099649 Sep 13 20:21:53.984880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1124/2329] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:53 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:54.122857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-de4b7e7f-11d8-4d72-856e-e82f9e23d51e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:54.136242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-de4b7e7f-11d8-4d72-856e-e82f9e23d51e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:54.138613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-de4b7e7f-11d8-4d72-856e-e82f9e23d51e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:54.140479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-de4b7e7f-11d8-4d72-856e-e82f9e23d51e tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.174812 Sep 13 20:21:54.141356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1206/2330] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:53 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:55.011717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-01f53a15-d696-478e-9b38-864868b0c929 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:55.012655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-01f53a15-d696-478e-9b38-864868b0c929 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:55.023898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01f53a15-d696-478e-9b38-864868b0c929 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:55.024699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01f53a15-d696-478e-9b38-864868b0c929 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:55.025471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01f53a15-d696-478e-9b38-864868b0c929 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:55.026660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01f53a15-d696-478e-9b38-864868b0c929 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:55.027410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01f53a15-d696-478e-9b38-864868b0c929 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:55.028114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-01f53a15-d696-478e-9b38-864868b0c929 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:55.092486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-01f53a15-d696-478e-9b38-864868b0c929 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:55.101025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-01f53a15-d696-478e-9b38-864868b0c929 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095926 Sep 13 20:21:55.101587 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1125/2331] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:55 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:55.169836 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8ec8aba4-48b8-447d-9081-4d148e1137f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:55.170897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8ec8aba4-48b8-447d-9081-4d148e1137f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:55.182062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ec8aba4-48b8-447d-9081-4d148e1137f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:55.183011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ec8aba4-48b8-447d-9081-4d148e1137f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:55.183712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ec8aba4-48b8-447d-9081-4d148e1137f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:55.184825 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ec8aba4-48b8-447d-9081-4d148e1137f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:55.185557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ec8aba4-48b8-447d-9081-4d148e1137f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:55.186246 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ec8aba4-48b8-447d-9081-4d148e1137f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:55.324965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8ec8aba4-48b8-447d-9081-4d148e1137f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:55.334290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8ec8aba4-48b8-447d-9081-4d148e1137f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:55.335773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8ec8aba4-48b8-447d-9081-4d148e1137f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:55.336939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8ec8aba4-48b8-447d-9081-4d148e1137f0 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.173691 Sep 13 20:21:55.337509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1207/2332] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:55 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:56.128193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8541e01d-1d4c-4ed0-8897-75211e85d197 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:56.129220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8541e01d-1d4c-4ed0-8897-75211e85d197 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:56.140251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8541e01d-1d4c-4ed0-8897-75211e85d197 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:56.141015 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8541e01d-1d4c-4ed0-8897-75211e85d197 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:56.141748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8541e01d-1d4c-4ed0-8897-75211e85d197 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:56.143005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8541e01d-1d4c-4ed0-8897-75211e85d197 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:56.143497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8541e01d-1d4c-4ed0-8897-75211e85d197 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:56.143902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8541e01d-1d4c-4ed0-8897-75211e85d197 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:56.219406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8541e01d-1d4c-4ed0-8897-75211e85d197 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:56.231410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8541e01d-1d4c-4ed0-8897-75211e85d197 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.109493 Sep 13 20:21:56.232112 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1126/2333] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:56 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:56.366471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-31a40817-901b-416b-bbc9-a2a2737c796b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:56.367500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-31a40817-901b-416b-bbc9-a2a2737c796b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:56.378354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31a40817-901b-416b-bbc9-a2a2737c796b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:56.379097 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31a40817-901b-416b-bbc9-a2a2737c796b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:56.379813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31a40817-901b-416b-bbc9-a2a2737c796b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:56.380945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31a40817-901b-416b-bbc9-a2a2737c796b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:56.381691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31a40817-901b-416b-bbc9-a2a2737c796b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:56.382404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31a40817-901b-416b-bbc9-a2a2737c796b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:56.527732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-31a40817-901b-416b-bbc9-a2a2737c796b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:56.536657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-31a40817-901b-416b-bbc9-a2a2737c796b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:56.538128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-31a40817-901b-416b-bbc9-a2a2737c796b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:56.539316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-31a40817-901b-416b-bbc9-a2a2737c796b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.179430 Sep 13 20:21:56.539883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1208/2334] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:56 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:57.260582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c0adb8b2-4c6d-44a6-be10-2ed34aaca064 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:57.261513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c0adb8b2-4c6d-44a6-be10-2ed34aaca064 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:57.272335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c0adb8b2-4c6d-44a6-be10-2ed34aaca064 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:57.273166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c0adb8b2-4c6d-44a6-be10-2ed34aaca064 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:57.273879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c0adb8b2-4c6d-44a6-be10-2ed34aaca064 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:57.275110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c0adb8b2-4c6d-44a6-be10-2ed34aaca064 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:57.275855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c0adb8b2-4c6d-44a6-be10-2ed34aaca064 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:57.276559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c0adb8b2-4c6d-44a6-be10-2ed34aaca064 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:57.340493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c0adb8b2-4c6d-44a6-be10-2ed34aaca064 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:57.349517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c0adb8b2-4c6d-44a6-be10-2ed34aaca064 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095524 Sep 13 20:21:57.350113 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1127/2335] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:57 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:57.565959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-54ec8511-4ceb-46c3-a45f-f6deb8f61b2a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:57.566621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-54ec8511-4ceb-46c3-a45f-f6deb8f61b2a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:57.574685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54ec8511-4ceb-46c3-a45f-f6deb8f61b2a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:57.575251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54ec8511-4ceb-46c3-a45f-f6deb8f61b2a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:57.575755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54ec8511-4ceb-46c3-a45f-f6deb8f61b2a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:57.576563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54ec8511-4ceb-46c3-a45f-f6deb8f61b2a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:57.577088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54ec8511-4ceb-46c3-a45f-f6deb8f61b2a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:57.577955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-54ec8511-4ceb-46c3-a45f-f6deb8f61b2a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:57.711457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-54ec8511-4ceb-46c3-a45f-f6deb8f61b2a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:57.725239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-54ec8511-4ceb-46c3-a45f-f6deb8f61b2a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:57.727564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-54ec8511-4ceb-46c3-a45f-f6deb8f61b2a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:57.729354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-54ec8511-4ceb-46c3-a45f-f6deb8f61b2a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.167835 Sep 13 20:21:57.730185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1209/2336] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:57 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:58.372423 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b75fce47-2d71-42a7-991b-0cba46fcca67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:58.373026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b75fce47-2d71-42a7-991b-0cba46fcca67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:58.379534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b75fce47-2d71-42a7-991b-0cba46fcca67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:58.380009 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b75fce47-2d71-42a7-991b-0cba46fcca67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:58.380421 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b75fce47-2d71-42a7-991b-0cba46fcca67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:58.381085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b75fce47-2d71-42a7-991b-0cba46fcca67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:58.381523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b75fce47-2d71-42a7-991b-0cba46fcca67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:58.381936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b75fce47-2d71-42a7-991b-0cba46fcca67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:58.443596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b75fce47-2d71-42a7-991b-0cba46fcca67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:58.451959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b75fce47-2d71-42a7-991b-0cba46fcca67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.083465 Sep 13 20:21:58.452876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1128/2337] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:58 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:58.761736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b405067e-f3e8-4666-9eea-d6361b087a05 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:58.762730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b405067e-f3e8-4666-9eea-d6361b087a05 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:58.773725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b405067e-f3e8-4666-9eea-d6361b087a05 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:58.774574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b405067e-f3e8-4666-9eea-d6361b087a05 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:58.775298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b405067e-f3e8-4666-9eea-d6361b087a05 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:58.776434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b405067e-f3e8-4666-9eea-d6361b087a05 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:58.777219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b405067e-f3e8-4666-9eea-d6361b087a05 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:58.777881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b405067e-f3e8-4666-9eea-d6361b087a05 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:58.912715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b405067e-f3e8-4666-9eea-d6361b087a05 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:58.921415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b405067e-f3e8-4666-9eea-d6361b087a05 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:58.922867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b405067e-f3e8-4666-9eea-d6361b087a05 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:58.924038 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b405067e-f3e8-4666-9eea-d6361b087a05 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169079 Sep 13 20:21:58.924606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1210/2338] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:58 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:21:59.478772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c536df62-4fbe-4316-bcda-217e28887c4f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:59.479529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c536df62-4fbe-4316-bcda-217e28887c4f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:59.489820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c536df62-4fbe-4316-bcda-217e28887c4f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:59.490551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c536df62-4fbe-4316-bcda-217e28887c4f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:59.491178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c536df62-4fbe-4316-bcda-217e28887c4f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:59.492217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c536df62-4fbe-4316-bcda-217e28887c4f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:59.492906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c536df62-4fbe-4316-bcda-217e28887c4f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:59.493545 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c536df62-4fbe-4316-bcda-217e28887c4f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:59.558396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c536df62-4fbe-4316-bcda-217e28887c4f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:21:59.567008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c536df62-4fbe-4316-bcda-217e28887c4f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094350 Sep 13 20:21:59.567579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1129/2339] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:21:59 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:21:59.954216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-20ad8f22-c81b-4634-a9f8-f2562b288bcc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:21:59.955113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-20ad8f22-c81b-4634-a9f8-f2562b288bcc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:21:59.962156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20ad8f22-c81b-4634-a9f8-f2562b288bcc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:59.962672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20ad8f22-c81b-4634-a9f8-f2562b288bcc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:59.963104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20ad8f22-c81b-4634-a9f8-f2562b288bcc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:21:59.963792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20ad8f22-c81b-4634-a9f8-f2562b288bcc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:21:59.964241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20ad8f22-c81b-4634-a9f8-f2562b288bcc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:21:59.964663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20ad8f22-c81b-4634-a9f8-f2562b288bcc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:00.092445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-20ad8f22-c81b-4634-a9f8-f2562b288bcc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:00.101351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-20ad8f22-c81b-4634-a9f8-f2562b288bcc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:00.102813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-20ad8f22-c81b-4634-a9f8-f2562b288bcc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:00.103977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-20ad8f22-c81b-4634-a9f8-f2562b288bcc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.156931 Sep 13 20:22:00.104537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1211/2340] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:21:59 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:00.591062 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d2121512-4bc0-4173-ba09-8186c561e1b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:00.591715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d2121512-4bc0-4173-ba09-8186c561e1b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:00.598976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2121512-4bc0-4173-ba09-8186c561e1b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:00.599485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2121512-4bc0-4173-ba09-8186c561e1b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:00.599946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2121512-4bc0-4173-ba09-8186c561e1b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:00.600668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2121512-4bc0-4173-ba09-8186c561e1b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:00.601149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2121512-4bc0-4173-ba09-8186c561e1b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:00.601595 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d2121512-4bc0-4173-ba09-8186c561e1b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:00.669223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d2121512-4bc0-4173-ba09-8186c561e1b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:00.677806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d2121512-4bc0-4173-ba09-8186c561e1b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090886 Sep 13 20:22:00.678398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1130/2341] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:00 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:01.184733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-21419405-9432-47d6-aba1-4c470cd5da06 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:01.185326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-21419405-9432-47d6-aba1-4c470cd5da06 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:01.192281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-21419405-9432-47d6-aba1-4c470cd5da06 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:01.192762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-21419405-9432-47d6-aba1-4c470cd5da06 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:01.193201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-21419405-9432-47d6-aba1-4c470cd5da06 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:01.193889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-21419405-9432-47d6-aba1-4c470cd5da06 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:01.194343 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-21419405-9432-47d6-aba1-4c470cd5da06 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:01.194799 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-21419405-9432-47d6-aba1-4c470cd5da06 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:01.325729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-21419405-9432-47d6-aba1-4c470cd5da06 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:01.335457 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-21419405-9432-47d6-aba1-4c470cd5da06 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:01.336905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-21419405-9432-47d6-aba1-4c470cd5da06 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:01.338066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-21419405-9432-47d6-aba1-4c470cd5da06 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.157423 Sep 13 20:22:01.338681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1212/2342] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:01 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:01.700941 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9b958aa9-5cc1-4506-82c7-946635e219c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:01.701544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9b958aa9-5cc1-4506-82c7-946635e219c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:01.709438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b958aa9-5cc1-4506-82c7-946635e219c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:01.709966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b958aa9-5cc1-4506-82c7-946635e219c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:01.710489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b958aa9-5cc1-4506-82c7-946635e219c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:01.711236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b958aa9-5cc1-4506-82c7-946635e219c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:01.711730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b958aa9-5cc1-4506-82c7-946635e219c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:01.712199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b958aa9-5cc1-4506-82c7-946635e219c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:01.777286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9b958aa9-5cc1-4506-82c7-946635e219c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:01.785709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9b958aa9-5cc1-4506-82c7-946635e219c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.089231 Sep 13 20:22:01.786282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1131/2343] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:02.367862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1625d169-f341-4753-9d47-31c7842e6510 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:02.368794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1625d169-f341-4753-9d47-31c7842e6510 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:02.379702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1625d169-f341-4753-9d47-31c7842e6510 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:02.380485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1625d169-f341-4753-9d47-31c7842e6510 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:02.381196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1625d169-f341-4753-9d47-31c7842e6510 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:02.382316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1625d169-f341-4753-9d47-31c7842e6510 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:02.383112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1625d169-f341-4753-9d47-31c7842e6510 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:02.383808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1625d169-f341-4753-9d47-31c7842e6510 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:02.530047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1625d169-f341-4753-9d47-31c7842e6510 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:02.540394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1625d169-f341-4753-9d47-31c7842e6510 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:02.541846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1625d169-f341-4753-9d47-31c7842e6510 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:02.543056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1625d169-f341-4753-9d47-31c7842e6510 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.181898 Sep 13 20:22:02.543609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1213/2344] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:02 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:02.812070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0887a499-f343-465c-8b0d-e1431c8cca00 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:02.812717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0887a499-f343-465c-8b0d-e1431c8cca00 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:02.822572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0887a499-f343-465c-8b0d-e1431c8cca00 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:02.823257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0887a499-f343-465c-8b0d-e1431c8cca00 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:02.823901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0887a499-f343-465c-8b0d-e1431c8cca00 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:02.824955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0887a499-f343-465c-8b0d-e1431c8cca00 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:02.825625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0887a499-f343-465c-8b0d-e1431c8cca00 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:02.826137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0887a499-f343-465c-8b0d-e1431c8cca00 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:02.893049 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0887a499-f343-465c-8b0d-e1431c8cca00 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:02.901929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0887a499-f343-465c-8b0d-e1431c8cca00 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096425 Sep 13 20:22:02.902528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1132/2345] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:02 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:03.576290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-82bfb246-4738-4a71-9910-e786a826e330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:03.576886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-82bfb246-4738-4a71-9910-e786a826e330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:03.584269 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82bfb246-4738-4a71-9910-e786a826e330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:03.584736 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82bfb246-4738-4a71-9910-e786a826e330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:03.585156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82bfb246-4738-4a71-9910-e786a826e330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:03.585827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82bfb246-4738-4a71-9910-e786a826e330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:03.586260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82bfb246-4738-4a71-9910-e786a826e330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:03.586699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82bfb246-4738-4a71-9910-e786a826e330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:03.717341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-82bfb246-4738-4a71-9910-e786a826e330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:03.730291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-82bfb246-4738-4a71-9910-e786a826e330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:03.732472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-82bfb246-4738-4a71-9910-e786a826e330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:03.734141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-82bfb246-4738-4a71-9910-e786a826e330 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.161589 Sep 13 20:22:03.734851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1214/2346] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:03 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:03.929939 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0aa2dd8b-9ba5-406f-af42-444a25fc420e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:03.930884 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0aa2dd8b-9ba5-406f-af42-444a25fc420e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:03.941113 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0aa2dd8b-9ba5-406f-af42-444a25fc420e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:03.941601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0aa2dd8b-9ba5-406f-af42-444a25fc420e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:03.942034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0aa2dd8b-9ba5-406f-af42-444a25fc420e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:03.942760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0aa2dd8b-9ba5-406f-af42-444a25fc420e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:03.943209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0aa2dd8b-9ba5-406f-af42-444a25fc420e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:03.943670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0aa2dd8b-9ba5-406f-af42-444a25fc420e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:04.006132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0aa2dd8b-9ba5-406f-af42-444a25fc420e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:04.014711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0aa2dd8b-9ba5-406f-af42-444a25fc420e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091652 Sep 13 20:22:04.015322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1133/2347] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:03 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:04.764666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f38a5ead-6500-42b3-b633-2462fc373ef4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:04.765671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f38a5ead-6500-42b3-b633-2462fc373ef4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:04.776696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f38a5ead-6500-42b3-b633-2462fc373ef4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:04.777498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f38a5ead-6500-42b3-b633-2462fc373ef4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:04.778222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f38a5ead-6500-42b3-b633-2462fc373ef4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:04.779432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f38a5ead-6500-42b3-b633-2462fc373ef4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:04.780178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f38a5ead-6500-42b3-b633-2462fc373ef4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:04.780878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f38a5ead-6500-42b3-b633-2462fc373ef4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:04.920838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f38a5ead-6500-42b3-b633-2462fc373ef4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:04.929760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f38a5ead-6500-42b3-b633-2462fc373ef4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:04.931236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f38a5ead-6500-42b3-b633-2462fc373ef4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:04.932402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f38a5ead-6500-42b3-b633-2462fc373ef4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.174411 Sep 13 20:22:04.932964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1215/2348] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:04 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:05.041367 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6c6f5078-f820-4a24-b9ae-e5956ffcd6e5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:05.042103 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6c6f5078-f820-4a24-b9ae-e5956ffcd6e5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:05.051438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c6f5078-f820-4a24-b9ae-e5956ffcd6e5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:05.051924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c6f5078-f820-4a24-b9ae-e5956ffcd6e5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:05.052362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c6f5078-f820-4a24-b9ae-e5956ffcd6e5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:05.053051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c6f5078-f820-4a24-b9ae-e5956ffcd6e5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:05.053502 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c6f5078-f820-4a24-b9ae-e5956ffcd6e5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:05.053929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c6f5078-f820-4a24-b9ae-e5956ffcd6e5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:05.119026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6c6f5078-f820-4a24-b9ae-e5956ffcd6e5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:05.127536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6c6f5078-f820-4a24-b9ae-e5956ffcd6e5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092471 Sep 13 20:22:05.128104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1134/2349] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:05 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:05.962441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c9180fe3-fb20-4d2c-b486-0087295c033b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:05.963330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c9180fe3-fb20-4d2c-b486-0087295c033b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:05.974118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9180fe3-fb20-4d2c-b486-0087295c033b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:05.974956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9180fe3-fb20-4d2c-b486-0087295c033b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:05.975662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9180fe3-fb20-4d2c-b486-0087295c033b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:05.976773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9180fe3-fb20-4d2c-b486-0087295c033b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:05.977507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9180fe3-fb20-4d2c-b486-0087295c033b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:05.978203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c9180fe3-fb20-4d2c-b486-0087295c033b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:06.112556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c9180fe3-fb20-4d2c-b486-0087295c033b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:06.114788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:22:06.122738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c9180fe3-fb20-4d2c-b486-0087295c033b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:06.124458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c9180fe3-fb20-4d2c-b486-0087295c033b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:06.125671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c9180fe3-fb20-4d2c-b486-0087295c033b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.170144 Sep 13 20:22:06.126239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1216/2350] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:05 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:06.152692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5f4429f5-8c7d-4dbf-8979-5c185b36e081 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:06.153254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5f4429f5-8c7d-4dbf-8979-5c185b36e081 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:06.161385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f4429f5-8c7d-4dbf-8979-5c185b36e081 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:06.161847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f4429f5-8c7d-4dbf-8979-5c185b36e081 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:06.162268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f4429f5-8c7d-4dbf-8979-5c185b36e081 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:06.162969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f4429f5-8c7d-4dbf-8979-5c185b36e081 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:06.163407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f4429f5-8c7d-4dbf-8979-5c185b36e081 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:06.163815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f4429f5-8c7d-4dbf-8979-5c185b36e081 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:06.225558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5f4429f5-8c7d-4dbf-8979-5c185b36e081 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:06.233956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5f4429f5-8c7d-4dbf-8979-5c185b36e081 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087265 Sep 13 20:22:06.234549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1135/2351] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:07.156194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1f955671-a231-46a6-92f5-3cc1f900cf51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:07.157172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1f955671-a231-46a6-92f5-3cc1f900cf51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:07.164576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f955671-a231-46a6-92f5-3cc1f900cf51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:07.165057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f955671-a231-46a6-92f5-3cc1f900cf51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:07.165492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f955671-a231-46a6-92f5-3cc1f900cf51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:07.166176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f955671-a231-46a6-92f5-3cc1f900cf51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:07.166664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f955671-a231-46a6-92f5-3cc1f900cf51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:07.167088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1f955671-a231-46a6-92f5-3cc1f900cf51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:07.256557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-844ea392-bdee-4df8-aa56-6a8842585f8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:07.257774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-844ea392-bdee-4df8-aa56-6a8842585f8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:07.261332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=54 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:22:07.264935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-844ea392-bdee-4df8-aa56-6a8842585f8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:07.265392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-844ea392-bdee-4df8-aa56-6a8842585f8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:07.265806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-844ea392-bdee-4df8-aa56-6a8842585f8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:07.266790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-844ea392-bdee-4df8-aa56-6a8842585f8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:07.267449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-844ea392-bdee-4df8-aa56-6a8842585f8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:07.267914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-844ea392-bdee-4df8-aa56-6a8842585f8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:07.302637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1f955671-a231-46a6-92f5-3cc1f900cf51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:07.311802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1f955671-a231-46a6-92f5-3cc1f900cf51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:07.313255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1f955671-a231-46a6-92f5-3cc1f900cf51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:07.314495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1f955671-a231-46a6-92f5-3cc1f900cf51 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.165222 Sep 13 20:22:07.315059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1217/2352] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:07 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:07.333548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-844ea392-bdee-4df8-aa56-6a8842585f8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:07.346443 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-844ea392-bdee-4df8-aa56-6a8842585f8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093573 Sep 13 20:22:07.347265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1136/2353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:08.343929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-80adb806-dee0-4d00-82fe-9c465d8e3b89 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:08.344925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-80adb806-dee0-4d00-82fe-9c465d8e3b89 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:08.358277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80adb806-dee0-4d00-82fe-9c465d8e3b89 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:08.359288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80adb806-dee0-4d00-82fe-9c465d8e3b89 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:08.360061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80adb806-dee0-4d00-82fe-9c465d8e3b89 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:08.361745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80adb806-dee0-4d00-82fe-9c465d8e3b89 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:08.362202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80adb806-dee0-4d00-82fe-9c465d8e3b89 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:08.362957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80adb806-dee0-4d00-82fe-9c465d8e3b89 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:08.369564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-06178cf8-6bfc-4e63-989e-d36924fef3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:08.370301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-06178cf8-6bfc-4e63-989e-d36924fef3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:08.376768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06178cf8-6bfc-4e63-989e-d36924fef3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:08.377333 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06178cf8-6bfc-4e63-989e-d36924fef3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:08.377830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06178cf8-6bfc-4e63-989e-d36924fef3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:08.378616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06178cf8-6bfc-4e63-989e-d36924fef3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:08.379121 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06178cf8-6bfc-4e63-989e-d36924fef3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:08.379602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06178cf8-6bfc-4e63-989e-d36924fef3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:08.440243 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-06178cf8-6bfc-4e63-989e-d36924fef3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:08.449019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-06178cf8-6bfc-4e63-989e-d36924fef3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.083447 Sep 13 20:22:08.449623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1137/2354] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:08.495201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-80adb806-dee0-4d00-82fe-9c465d8e3b89 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:08.504347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-80adb806-dee0-4d00-82fe-9c465d8e3b89 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:08.505772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-80adb806-dee0-4d00-82fe-9c465d8e3b89 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:08.506980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-80adb806-dee0-4d00-82fe-9c465d8e3b89 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 200 len: 1802 microversion: 2.20 time: 0.169792 Sep 13 20:22:08.507502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1218/2355] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:08 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:08.532369 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0666465a-223b-44fe-bb84-64a551d1bd47 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '.version_select at 0x7f9846592ee0>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:08.557177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0666465a-223b-44fe-bb84-64a551d1bd47 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199737398" status: 204 len: 0 microversion: 2.20 time: 0.028662 Sep 13 20:22:08.557754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1138/2356] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 13 20:22:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199737398 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 20:22:09.476212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-752ad0dd-66f5-4807-85e6-2d81b0df4132 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:09.477471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-752ad0dd-66f5-4807-85e6-2d81b0df4132 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:09.485590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:22:09.488511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-752ad0dd-66f5-4807-85e6-2d81b0df4132 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:09.489379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-752ad0dd-66f5-4807-85e6-2d81b0df4132 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:09.490001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-752ad0dd-66f5-4807-85e6-2d81b0df4132 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:09.491007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-752ad0dd-66f5-4807-85e6-2d81b0df4132 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:09.491647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-752ad0dd-66f5-4807-85e6-2d81b0df4132 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:09.492215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-752ad0dd-66f5-4807-85e6-2d81b0df4132 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:09.551098 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-0927d1b0-0f87-4be3-90b3-29ea4cbe1edb req-c7180dba-a28d-4ff6-9cbd-e537bb4a1355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0decb4-2f46-4f2f-860f-e8ca277f7080", "tag": "2f770f4f-2f9f-4723-a236-5204e36adea7"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:22:09.562660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0927d1b0-0f87-4be3-90b3-29ea4cbe1edb req-c7180dba-a28d-4ff6-9cbd-e537bb4a1355 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:09.563302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0927d1b0-0f87-4be3-90b3-29ea4cbe1edb req-c7180dba-a28d-4ff6-9cbd-e537bb4a1355 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:09.564143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0927d1b0-0f87-4be3-90b3-29ea4cbe1edb req-c7180dba-a28d-4ff6-9cbd-e537bb4a1355 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:09.588403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-0927d1b0-0f87-4be3-90b3-29ea4cbe1edb req-c7180dba-a28d-4ff6-9cbd-e537bb4a1355 service nova] Creating event network-changed:2f770f4f-2f9f-4723-a236-5204e36adea7 for instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 on hv-cinder-85427 Sep 13 20:22:09.600636 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-752ad0dd-66f5-4807-85e6-2d81b0df4132 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:09.603709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-0927d1b0-0f87-4be3-90b3-29ea4cbe1edb req-c7180dba-a28d-4ff6-9cbd-e537bb4a1355 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129102 Sep 13 20:22:09.606295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1139/2357] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:22:09.611939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-752ad0dd-66f5-4807-85e6-2d81b0df4132 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.139719 Sep 13 20:22:09.612515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1219/2358] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:09.713999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3736bf25-8145-4bf4-9db0-730f9fcfbcec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Action: 'create', calling method: .version_select at 0x7f9849e058b0>, body: {"keypair": {"name": "tempest-keypair-1417471735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrZyBR3UfhKoSTPRkbFB22MxmXPz0wDkVK+nYDHoE4eZMhhK394NOvtfCWORneaUjfz87tORFd0Ad2F9OLoSZdyBoxuM428we48yY8ah1bGHgWUJ5K7VaGiBywn9HMMmg=="}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:22:09.731755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-3736bf25-8145-4bf4-9db0-730f9fcfbcec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Getting quotas for project fdc8b1b561f247ed84babfad941e55f6. Resources: {'key_pairs'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:22:09.736705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-3736bf25-8145-4bf4-9db0-730f9fcfbcec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Getting quotas for user b07b8b251aaa456c9916c41f9a0b77e3 and project fdc8b1b561f247ed84babfad941e55f6. Resources: {'key_pairs'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:22:09.765239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3736bf25-8145-4bf4-9db0-730f9fcfbcec tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.055501 Sep 13 20:22:09.766408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1140/2359] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Sep 13 20:22:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 20:22:10.645699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9275ab95-2c5d-4e3d-b53d-6d87f554758d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:10.646310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9275ab95-2c5d-4e3d-b53d-6d87f554758d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:10.652898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9275ab95-2c5d-4e3d-b53d-6d87f554758d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:10.653369 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9275ab95-2c5d-4e3d-b53d-6d87f554758d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:10.654213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9275ab95-2c5d-4e3d-b53d-6d87f554758d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:10.654987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9275ab95-2c5d-4e3d-b53d-6d87f554758d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:10.655549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9275ab95-2c5d-4e3d-b53d-6d87f554758d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:10.656046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9275ab95-2c5d-4e3d-b53d-6d87f554758d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:10.727369 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9275ab95-2c5d-4e3d-b53d-6d87f554758d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:10.736311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9275ab95-2c5d-4e3d-b53d-6d87f554758d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095294 Sep 13 20:22:10.736983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1220/2360] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:10 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:11.074166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-388072527", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7304e426-9c27-4fdc-adde-8a2c88147851"}], "security_groups": [{"name": "tempest-securitygroup--1980944034"}], "key_name": "tempest-keypair-1417471735", "user_data": "}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:22:11.181313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] validate_networks() for [('7304e426-9c27-4fdc-adde-8a2c88147851', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:22:11.621048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:22:11.621527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:22:11.622212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:22:11.622778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:22:11.623326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:22:11.634077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:11.634600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:11.635036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:11.635760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:11.636204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:11.636627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:11.653892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Getting quotas for project fdc8b1b561f247ed84babfad941e55f6. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:22:11.657845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Getting quotas for user b07b8b251aaa456c9916c41f9a0b77e3 and project fdc8b1b561f247ed84babfad941e55f6. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:22:11.669208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:22:11.671628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:22:11.722468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1928b46a-0632-47b1-9e6f-4d8a83bbcbc9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.656033 Sep 13 20:22:11.723343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1141/2361] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 13 20:22:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 20:22:11.734534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-89325898-c500-462a-9964-75a90143cdb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:11.735143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-89325898-c500-462a-9964-75a90143cdb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:11.759879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9df69efd-9be5-493e-b42b-2a4f2f129c02 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:11.760791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9df69efd-9be5-493e-b42b-2a4f2f129c02 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:11.768384 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9df69efd-9be5-493e-b42b-2a4f2f129c02 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:11.768867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9df69efd-9be5-493e-b42b-2a4f2f129c02 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:11.769301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9df69efd-9be5-493e-b42b-2a4f2f129c02 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:11.770024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9df69efd-9be5-493e-b42b-2a4f2f129c02 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:11.770498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9df69efd-9be5-493e-b42b-2a4f2f129c02 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:11.770924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9df69efd-9be5-493e-b42b-2a4f2f129c02 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:11.792561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-89325898-c500-462a-9964-75a90143cdb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:11.800495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-89325898-c500-462a-9964-75a90143cdb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:11.801941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-89325898-c500-462a-9964-75a90143cdb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:11.803258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-89325898-c500-462a-9964-75a90143cdb2 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 200 len: 1281 microversion: 2.20 time: 0.072623 Sep 13 20:22:11.803783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1221/2362] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:11 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:11.839969 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9df69efd-9be5-493e-b42b-2a4f2f129c02 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:11.842319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:22:11.849806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9df69efd-9be5-493e-b42b-2a4f2f129c02 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094051 Sep 13 20:22:11.850414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1142/2363] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:11 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:12.831126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4a5be0b5-420b-4b33-914e-91d2215d2e44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:12.831756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4a5be0b5-420b-4b33-914e-91d2215d2e44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:12.839658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a5be0b5-420b-4b33-914e-91d2215d2e44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:12.840180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a5be0b5-420b-4b33-914e-91d2215d2e44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:12.840636 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a5be0b5-420b-4b33-914e-91d2215d2e44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:12.841359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a5be0b5-420b-4b33-914e-91d2215d2e44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:12.841830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a5be0b5-420b-4b33-914e-91d2215d2e44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:12.842290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4a5be0b5-420b-4b33-914e-91d2215d2e44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:12.874169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-80e9a6e6-1a58-45bb-b049-6fbf7f47cc75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:12.875260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-80e9a6e6-1a58-45bb-b049-6fbf7f47cc75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:12.882882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80e9a6e6-1a58-45bb-b049-6fbf7f47cc75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:12.883463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80e9a6e6-1a58-45bb-b049-6fbf7f47cc75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:12.883963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80e9a6e6-1a58-45bb-b049-6fbf7f47cc75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:12.884769 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80e9a6e6-1a58-45bb-b049-6fbf7f47cc75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:12.885239 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80e9a6e6-1a58-45bb-b049-6fbf7f47cc75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:12.885745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80e9a6e6-1a58-45bb-b049-6fbf7f47cc75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:12.909873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4a5be0b5-420b-4b33-914e-91d2215d2e44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:12.918730 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4a5be0b5-420b-4b33-914e-91d2215d2e44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:12.920245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4a5be0b5-420b-4b33-914e-91d2215d2e44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:12.921354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4a5be0b5-420b-4b33-914e-91d2215d2e44 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 200 len: 1333 microversion: 2.20 time: 0.097039 Sep 13 20:22:12.931311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1222/2364] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:12 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 1333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:12.972375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-80e9a6e6-1a58-45bb-b049-6fbf7f47cc75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:12.980898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-80e9a6e6-1a58-45bb-b049-6fbf7f47cc75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.111600 Sep 13 20:22:12.981665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1143/2365] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:12 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:13.947864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2d1e03bd-db24-41f5-8080-e70efc8f4ea6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:13.948558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2d1e03bd-db24-41f5-8080-e70efc8f4ea6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:13.955675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d1e03bd-db24-41f5-8080-e70efc8f4ea6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:13.956234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d1e03bd-db24-41f5-8080-e70efc8f4ea6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:13.956712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d1e03bd-db24-41f5-8080-e70efc8f4ea6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:13.957467 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d1e03bd-db24-41f5-8080-e70efc8f4ea6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:13.957975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d1e03bd-db24-41f5-8080-e70efc8f4ea6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:13.958477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2d1e03bd-db24-41f5-8080-e70efc8f4ea6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:14.004740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e8b5cadb-8dd1-4fe7-a5e5-62772043e327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:14.005997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e8b5cadb-8dd1-4fe7-a5e5-62772043e327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:14.014342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8b5cadb-8dd1-4fe7-a5e5-62772043e327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:14.014874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8b5cadb-8dd1-4fe7-a5e5-62772043e327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:14.015306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8b5cadb-8dd1-4fe7-a5e5-62772043e327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:14.016005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8b5cadb-8dd1-4fe7-a5e5-62772043e327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:14.016613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8b5cadb-8dd1-4fe7-a5e5-62772043e327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:14.017032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8b5cadb-8dd1-4fe7-a5e5-62772043e327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:14.091651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e8b5cadb-8dd1-4fe7-a5e5-62772043e327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:14.101185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e8b5cadb-8dd1-4fe7-a5e5-62772043e327 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.100764 Sep 13 20:22:14.101768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1144/2366] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:22:14.106382 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2d1e03bd-db24-41f5-8080-e70efc8f4ea6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:14.116548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2d1e03bd-db24-41f5-8080-e70efc8f4ea6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:14.118575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2d1e03bd-db24-41f5-8080-e70efc8f4ea6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:14.119559 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2d1e03bd-db24-41f5-8080-e70efc8f4ea6 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 200 len: 1407 microversion: 2.20 time: 0.175804 Sep 13 20:22:14.120576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1223/2367] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:13 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:14.680060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-c97911ca-62a0-4046-bfcb-6daee98fa20a req-d071e987-86b4-42c5-88a8-17ff433c3fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86eb3378-3f47-453b-a57e-31bf51583061", "tag": "c0cafb63-b9f5-44ae-b8cb-42f30f6ca9c9"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:22:14.697441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-c97911ca-62a0-4046-bfcb-6daee98fa20a req-d071e987-86b4-42c5-88a8-17ff433c3fc2 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:14.697827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-c97911ca-62a0-4046-bfcb-6daee98fa20a req-d071e987-86b4-42c5-88a8-17ff433c3fc2 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:14.698689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-c97911ca-62a0-4046-bfcb-6daee98fa20a req-d071e987-86b4-42c5-88a8-17ff433c3fc2 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:14.715439 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-c97911ca-62a0-4046-bfcb-6daee98fa20a req-d071e987-86b4-42c5-88a8-17ff433c3fc2 service nova] Creating event network-changed:c0cafb63-b9f5-44ae-b8cb-42f30f6ca9c9 for instance 86eb3378-3f47-453b-a57e-31bf51583061 on hv-cinder-85427 Sep 13 20:22:14.720980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-c97911ca-62a0-4046-bfcb-6daee98fa20a req-d071e987-86b4-42c5-88a8-17ff433c3fc2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044460 Sep 13 20:22:14.721796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1145/2368] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:22:15.125852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c6a43d2a-07a1-4c5e-a399-16ae720b1d62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:15.126532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c6a43d2a-07a1-4c5e-a399-16ae720b1d62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:15.133251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c6a43d2a-07a1-4c5e-a399-16ae720b1d62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:15.133733 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c6a43d2a-07a1-4c5e-a399-16ae720b1d62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:15.134163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c6a43d2a-07a1-4c5e-a399-16ae720b1d62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:15.134876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c6a43d2a-07a1-4c5e-a399-16ae720b1d62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:15.135328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c6a43d2a-07a1-4c5e-a399-16ae720b1d62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:15.135740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c6a43d2a-07a1-4c5e-a399-16ae720b1d62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:15.145352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7a41ef8c-2dcb-4d87-b22a-fa5b664f83ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:15.146061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7a41ef8c-2dcb-4d87-b22a-fa5b664f83ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:15.153104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a41ef8c-2dcb-4d87-b22a-fa5b664f83ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:15.153590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a41ef8c-2dcb-4d87-b22a-fa5b664f83ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:15.154061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a41ef8c-2dcb-4d87-b22a-fa5b664f83ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:15.154794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a41ef8c-2dcb-4d87-b22a-fa5b664f83ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:15.155309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a41ef8c-2dcb-4d87-b22a-fa5b664f83ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:15.155719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7a41ef8c-2dcb-4d87-b22a-fa5b664f83ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:15.199231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c6a43d2a-07a1-4c5e-a399-16ae720b1d62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:15.208069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c6a43d2a-07a1-4c5e-a399-16ae720b1d62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.086516 Sep 13 20:22:15.208652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1224/2369] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:15.289414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7a41ef8c-2dcb-4d87-b22a-fa5b664f83ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:15.297703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7a41ef8c-2dcb-4d87-b22a-fa5b664f83ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:15.299266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7a41ef8c-2dcb-4d87-b22a-fa5b664f83ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:15.300374 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7a41ef8c-2dcb-4d87-b22a-fa5b664f83ca tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 200 len: 1407 microversion: 2.20 time: 0.159497 Sep 13 20:22:15.300943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1146/2370] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:15 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:22:16.230570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-14793a54-6c28-45bb-a190-a8c77417ca8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:16.231184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-14793a54-6c28-45bb-a190-a8c77417ca8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:16.238104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14793a54-6c28-45bb-a190-a8c77417ca8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:16.238656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14793a54-6c28-45bb-a190-a8c77417ca8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:16.239192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14793a54-6c28-45bb-a190-a8c77417ca8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:16.239882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14793a54-6c28-45bb-a190-a8c77417ca8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:16.240324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14793a54-6c28-45bb-a190-a8c77417ca8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:16.240742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-14793a54-6c28-45bb-a190-a8c77417ca8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:16.305487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-14793a54-6c28-45bb-a190-a8c77417ca8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:16.314157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-14793a54-6c28-45bb-a190-a8c77417ca8f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087600 Sep 13 20:22:16.314741 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1225/2371] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:16 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:16.324949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a16cc5a3-d5f3-4fa8-a68e-943c521c139a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:16.325555 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a16cc5a3-d5f3-4fa8-a68e-943c521c139a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:16.332382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a16cc5a3-d5f3-4fa8-a68e-943c521c139a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:16.332853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a16cc5a3-d5f3-4fa8-a68e-943c521c139a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:16.333284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a16cc5a3-d5f3-4fa8-a68e-943c521c139a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:16.333964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a16cc5a3-d5f3-4fa8-a68e-943c521c139a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:16.334435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a16cc5a3-d5f3-4fa8-a68e-943c521c139a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:16.334843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a16cc5a3-d5f3-4fa8-a68e-943c521c139a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:16.493872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a16cc5a3-d5f3-4fa8-a68e-943c521c139a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:16.502597 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a16cc5a3-d5f3-4fa8-a68e-943c521c139a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:16.504052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a16cc5a3-d5f3-4fa8-a68e-943c521c139a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:16.505158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a16cc5a3-d5f3-4fa8-a68e-943c521c139a tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 200 len: 1407 microversion: 2.20 time: 0.184054 Sep 13 20:22:16.505726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1147/2372] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:16 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:17.342350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-69665a11-fdb8-4ec8-a903-cf2d1ac7cedb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:17.343517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-69665a11-fdb8-4ec8-a903-cf2d1ac7cedb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:17.354282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69665a11-fdb8-4ec8-a903-cf2d1ac7cedb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:17.355134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69665a11-fdb8-4ec8-a903-cf2d1ac7cedb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:17.355833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69665a11-fdb8-4ec8-a903-cf2d1ac7cedb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:17.356944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69665a11-fdb8-4ec8-a903-cf2d1ac7cedb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:17.357686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69665a11-fdb8-4ec8-a903-cf2d1ac7cedb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:17.358406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-69665a11-fdb8-4ec8-a903-cf2d1ac7cedb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:17.423247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-69665a11-fdb8-4ec8-a903-cf2d1ac7cedb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:17.435304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-69665a11-fdb8-4ec8-a903-cf2d1ac7cedb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099034 Sep 13 20:22:17.436036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1226/2373] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:17 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:17.534575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a9618716-2723-4782-b0a0-9ebdee46c145 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:17.535548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a9618716-2723-4782-b0a0-9ebdee46c145 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:17.546716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9618716-2723-4782-b0a0-9ebdee46c145 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:17.547510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9618716-2723-4782-b0a0-9ebdee46c145 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:17.548227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9618716-2723-4782-b0a0-9ebdee46c145 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:17.549372 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9618716-2723-4782-b0a0-9ebdee46c145 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:17.550127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9618716-2723-4782-b0a0-9ebdee46c145 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:17.550874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9618716-2723-4782-b0a0-9ebdee46c145 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:17.689306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a9618716-2723-4782-b0a0-9ebdee46c145 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:17.697824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a9618716-2723-4782-b0a0-9ebdee46c145 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:17.699283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a9618716-2723-4782-b0a0-9ebdee46c145 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:17.700364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a9618716-2723-4782-b0a0-9ebdee46c145 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 200 len: 1407 microversion: 2.20 time: 0.172519 Sep 13 20:22:17.700937 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1148/2374] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:17 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:18.464372 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-23e0e7e4-faa0-4c46-af51-705a5a278ea1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:18.467810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-23e0e7e4-faa0-4c46-af51-705a5a278ea1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:18.474269 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23e0e7e4-faa0-4c46-af51-705a5a278ea1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:18.474816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23e0e7e4-faa0-4c46-af51-705a5a278ea1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:18.475245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23e0e7e4-faa0-4c46-af51-705a5a278ea1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:18.475941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23e0e7e4-faa0-4c46-af51-705a5a278ea1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:18.476389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23e0e7e4-faa0-4c46-af51-705a5a278ea1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:18.476808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23e0e7e4-faa0-4c46-af51-705a5a278ea1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:18.542805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-23e0e7e4-faa0-4c46-af51-705a5a278ea1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:18.551374 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-23e0e7e4-faa0-4c46-af51-705a5a278ea1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093691 Sep 13 20:22:18.551941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1227/2375] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:18.725297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-097f49f4-8184-4acf-8c0c-2d42d83d6b79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:18.725898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-097f49f4-8184-4acf-8c0c-2d42d83d6b79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:18.733935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-097f49f4-8184-4acf-8c0c-2d42d83d6b79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:18.734461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-097f49f4-8184-4acf-8c0c-2d42d83d6b79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:18.734894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-097f49f4-8184-4acf-8c0c-2d42d83d6b79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:18.735602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-097f49f4-8184-4acf-8c0c-2d42d83d6b79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:18.736081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-097f49f4-8184-4acf-8c0c-2d42d83d6b79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:18.736508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-097f49f4-8184-4acf-8c0c-2d42d83d6b79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:18.876547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-097f49f4-8184-4acf-8c0c-2d42d83d6b79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:18.885659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-2f1e9d6d-53a2-42a9-8381-ae3bf1def1bb req-4295be0b-bd5b-4bf5-abce-f1e0c90dd8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86eb3378-3f47-453b-a57e-31bf51583061", "name": "network-vif-plugged", "status": "completed", "tag": "c0cafb63-b9f5-44ae-b8cb-42f30f6ca9c9"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:22:18.885878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-097f49f4-8184-4acf-8c0c-2d42d83d6b79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:18.887316 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-097f49f4-8184-4acf-8c0c-2d42d83d6b79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:18.888517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-097f49f4-8184-4acf-8c0c-2d42d83d6b79 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 200 len: 1407 microversion: 2.20 time: 0.167219 Sep 13 20:22:18.889146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1149/2376] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:18 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:18.895579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-2f1e9d6d-53a2-42a9-8381-ae3bf1def1bb req-4295be0b-bd5b-4bf5-abce-f1e0c90dd8d0 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:18.896263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-2f1e9d6d-53a2-42a9-8381-ae3bf1def1bb req-4295be0b-bd5b-4bf5-abce-f1e0c90dd8d0 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:18.896871 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-2f1e9d6d-53a2-42a9-8381-ae3bf1def1bb req-4295be0b-bd5b-4bf5-abce-f1e0c90dd8d0 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:18.908098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-2f1e9d6d-53a2-42a9-8381-ae3bf1def1bb req-4295be0b-bd5b-4bf5-abce-f1e0c90dd8d0 service nova] Creating event network-vif-plugged:c0cafb63-b9f5-44ae-b8cb-42f30f6ca9c9 for instance 86eb3378-3f47-453b-a57e-31bf51583061 on hv-cinder-85427 Sep 13 20:22:18.913690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-2f1e9d6d-53a2-42a9-8381-ae3bf1def1bb req-4295be0b-bd5b-4bf5-abce-f1e0c90dd8d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090615 Sep 13 20:22:18.914265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1228/2377] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:22:19.576083 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e8ae7936-848b-4a48-97af-dc88d1da0ce2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:19.577253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e8ae7936-848b-4a48-97af-dc88d1da0ce2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:19.584314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8ae7936-848b-4a48-97af-dc88d1da0ce2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:19.584790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8ae7936-848b-4a48-97af-dc88d1da0ce2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:19.585215 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8ae7936-848b-4a48-97af-dc88d1da0ce2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:19.585897 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8ae7936-848b-4a48-97af-dc88d1da0ce2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:19.586338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8ae7936-848b-4a48-97af-dc88d1da0ce2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:19.586796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8ae7936-848b-4a48-97af-dc88d1da0ce2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:19.649071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e8ae7936-848b-4a48-97af-dc88d1da0ce2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:19.657651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e8ae7936-848b-4a48-97af-dc88d1da0ce2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.086452 Sep 13 20:22:19.658304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1150/2378] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:19.920021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cc1bf368-8f06-40f2-a606-424bbe67f4cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:19.921030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cc1bf368-8f06-40f2-a606-424bbe67f4cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:19.931617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc1bf368-8f06-40f2-a606-424bbe67f4cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:19.932409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc1bf368-8f06-40f2-a606-424bbe67f4cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:19.933107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc1bf368-8f06-40f2-a606-424bbe67f4cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:19.934239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc1bf368-8f06-40f2-a606-424bbe67f4cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:19.935025 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc1bf368-8f06-40f2-a606-424bbe67f4cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:19.935709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cc1bf368-8f06-40f2-a606-424bbe67f4cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:20.067330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cc1bf368-8f06-40f2-a606-424bbe67f4cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:20.076035 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cc1bf368-8f06-40f2-a606-424bbe67f4cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:20.077821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cc1bf368-8f06-40f2-a606-424bbe67f4cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:20.078969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cc1bf368-8f06-40f2-a606-424bbe67f4cc tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 200 len: 1407 microversion: 2.20 time: 0.167134 Sep 13 20:22:20.079529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1229/2379] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:19 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:20.685027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ef4ef9f2-c758-4c9b-a72f-b4a3a78b543e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:20.686048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ef4ef9f2-c758-4c9b-a72f-b4a3a78b543e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:20.694637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef4ef9f2-c758-4c9b-a72f-b4a3a78b543e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:20.695115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef4ef9f2-c758-4c9b-a72f-b4a3a78b543e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:20.695546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef4ef9f2-c758-4c9b-a72f-b4a3a78b543e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:20.696232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef4ef9f2-c758-4c9b-a72f-b4a3a78b543e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:20.696678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef4ef9f2-c758-4c9b-a72f-b4a3a78b543e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:20.697098 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ef4ef9f2-c758-4c9b-a72f-b4a3a78b543e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:20.759839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ef4ef9f2-c758-4c9b-a72f-b4a3a78b543e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:20.768514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ef4ef9f2-c758-4c9b-a72f-b4a3a78b543e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090523 Sep 13 20:22:20.769083 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1151/2380] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:21.108664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-45acc0d5-4a68-430e-a699-365b896893bd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:21.109685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-45acc0d5-4a68-430e-a699-365b896893bd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:21.117090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45acc0d5-4a68-430e-a699-365b896893bd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:21.117559 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45acc0d5-4a68-430e-a699-365b896893bd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:21.117978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45acc0d5-4a68-430e-a699-365b896893bd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:21.118686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45acc0d5-4a68-430e-a699-365b896893bd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:21.119127 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45acc0d5-4a68-430e-a699-365b896893bd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:21.119534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-45acc0d5-4a68-430e-a699-365b896893bd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:21.266855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-45acc0d5-4a68-430e-a699-365b896893bd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:21.275089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-45acc0d5-4a68-430e-a699-365b896893bd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:21.276530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-45acc0d5-4a68-430e-a699-365b896893bd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:21.277681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-45acc0d5-4a68-430e-a699-365b896893bd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 200 len: 1598 microversion: 2.20 time: 0.176031 Sep 13 20:22:21.278274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1230/2381] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:22:21 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 1598 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:22:21.301929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-59589730-9b42-49fc-a938-7a4cc9fa38f3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:21.302401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-59589730-9b42-49fc-a938-7a4cc9fa38f3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:21.308801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59589730-9b42-49fc-a938-7a4cc9fa38f3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:21.309277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59589730-9b42-49fc-a938-7a4cc9fa38f3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:21.309702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59589730-9b42-49fc-a938-7a4cc9fa38f3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:21.310694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59589730-9b42-49fc-a938-7a4cc9fa38f3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:21.311139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59589730-9b42-49fc-a938-7a4cc9fa38f3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:21.311553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-59589730-9b42-49fc-a938-7a4cc9fa38f3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:21.403153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-59589730-9b42-49fc-a938-7a4cc9fa38f3 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.104770 Sep 13 20:22:21.403871 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1152/2382] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Sep 13 20:22:21 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:22:21.791441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c0a1e002-631a-4382-b546-8ccad3775a64 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:21.792041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c0a1e002-631a-4382-b546-8ccad3775a64 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:21.797055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:22:21.799245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0a1e002-631a-4382-b546-8ccad3775a64 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:21.799745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0a1e002-631a-4382-b546-8ccad3775a64 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:21.800219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0a1e002-631a-4382-b546-8ccad3775a64 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:21.801049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0a1e002-631a-4382-b546-8ccad3775a64 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:21.801513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0a1e002-631a-4382-b546-8ccad3775a64 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:21.801957 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c0a1e002-631a-4382-b546-8ccad3775a64 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:21.863963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c0a1e002-631a-4382-b546-8ccad3775a64 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:21.872263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c0a1e002-631a-4382-b546-8ccad3775a64 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.084821 Sep 13 20:22:21.872821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1231/2383] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:21 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:22.322492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:22:22.323293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=10 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:22:22.328176 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-80f42f1a-9510-4939-8082-7a2ba8e3ce5a req-13da8eac-db03-45f7-9e51-04aaea4581ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86eb3378-3f47-453b-a57e-31bf51583061", "tag": "c0cafb63-b9f5-44ae-b8cb-42f30f6ca9c9"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:22:22.338652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-80f42f1a-9510-4939-8082-7a2ba8e3ce5a req-13da8eac-db03-45f7-9e51-04aaea4581ad service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:22.339130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-80f42f1a-9510-4939-8082-7a2ba8e3ce5a req-13da8eac-db03-45f7-9e51-04aaea4581ad service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:22.339557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-80f42f1a-9510-4939-8082-7a2ba8e3ce5a req-13da8eac-db03-45f7-9e51-04aaea4581ad service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:22.350731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-80f42f1a-9510-4939-8082-7a2ba8e3ce5a req-13da8eac-db03-45f7-9e51-04aaea4581ad service nova] Creating event network-changed:c0cafb63-b9f5-44ae-b8cb-42f30f6ca9c9 for instance 86eb3378-3f47-453b-a57e-31bf51583061 on hv-cinder-85427 Sep 13 20:22:22.356108 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-80f42f1a-9510-4939-8082-7a2ba8e3ce5a req-13da8eac-db03-45f7-9e51-04aaea4581ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034286 Sep 13 20:22:22.356880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1153/2384] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:22:22.896230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9e4be1f3-bd1f-45ea-9cd1-46990647f409 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:22.896884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9e4be1f3-bd1f-45ea-9cd1-46990647f409 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:22.904803 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9e4be1f3-bd1f-45ea-9cd1-46990647f409 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:22.905571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9e4be1f3-bd1f-45ea-9cd1-46990647f409 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:22.905996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9e4be1f3-bd1f-45ea-9cd1-46990647f409 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:22.906726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9e4be1f3-bd1f-45ea-9cd1-46990647f409 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:22.907311 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9e4be1f3-bd1f-45ea-9cd1-46990647f409 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:22.907743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9e4be1f3-bd1f-45ea-9cd1-46990647f409 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:22.968748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9e4be1f3-bd1f-45ea-9cd1-46990647f409 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:22.977525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9e4be1f3-bd1f-45ea-9cd1-46990647f409 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085456 Sep 13 20:22:22.978321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1232/2385] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:24.006091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-abf96f7d-e862-4934-9c52-5633e7a7996e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:24.007345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-abf96f7d-e862-4934-9c52-5633e7a7996e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:24.017824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-abf96f7d-e862-4934-9c52-5633e7a7996e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:24.018304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-abf96f7d-e862-4934-9c52-5633e7a7996e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:24.018772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-abf96f7d-e862-4934-9c52-5633e7a7996e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:24.019450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-abf96f7d-e862-4934-9c52-5633e7a7996e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:24.019900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-abf96f7d-e862-4934-9c52-5633e7a7996e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:24.020318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-abf96f7d-e862-4934-9c52-5633e7a7996e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:24.096235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-abf96f7d-e862-4934-9c52-5633e7a7996e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:24.104828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-abf96f7d-e862-4934-9c52-5633e7a7996e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.106832 Sep 13 20:22:24.105389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1154/2386] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:25.131853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e537f2b9-d6df-4acf-ba93-7d6c5c113bb0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:25.132760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e537f2b9-d6df-4acf-ba93-7d6c5c113bb0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:25.143356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e537f2b9-d6df-4acf-ba93-7d6c5c113bb0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:25.144139 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e537f2b9-d6df-4acf-ba93-7d6c5c113bb0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:25.144841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e537f2b9-d6df-4acf-ba93-7d6c5c113bb0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:25.145961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e537f2b9-d6df-4acf-ba93-7d6c5c113bb0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:25.146754 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e537f2b9-d6df-4acf-ba93-7d6c5c113bb0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:25.147444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e537f2b9-d6df-4acf-ba93-7d6c5c113bb0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:25.218148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e537f2b9-d6df-4acf-ba93-7d6c5c113bb0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:25.226919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e537f2b9-d6df-4acf-ba93-7d6c5c113bb0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.101814 Sep 13 20:22:25.227655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1233/2387] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:26.254542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f12e588c-cd31-49c5-b388-495473008563 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:26.255605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f12e588c-cd31-49c5-b388-495473008563 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:26.266603 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f12e588c-cd31-49c5-b388-495473008563 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:26.267434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f12e588c-cd31-49c5-b388-495473008563 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:26.267877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f12e588c-cd31-49c5-b388-495473008563 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:26.268570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f12e588c-cd31-49c5-b388-495473008563 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:26.269027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f12e588c-cd31-49c5-b388-495473008563 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:26.269450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f12e588c-cd31-49c5-b388-495473008563 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:26.334405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f12e588c-cd31-49c5-b388-495473008563 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:26.342757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f12e588c-cd31-49c5-b388-495473008563 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094862 Sep 13 20:22:26.343330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1155/2388] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:27.369286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d26b28af-ab8a-488b-99c8-b04b1aa9b4e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:27.370361 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d26b28af-ab8a-488b-99c8-b04b1aa9b4e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:27.379509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d26b28af-ab8a-488b-99c8-b04b1aa9b4e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:27.379977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d26b28af-ab8a-488b-99c8-b04b1aa9b4e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:27.380398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d26b28af-ab8a-488b-99c8-b04b1aa9b4e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:27.381070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d26b28af-ab8a-488b-99c8-b04b1aa9b4e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:27.381509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d26b28af-ab8a-488b-99c8-b04b1aa9b4e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:27.381918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d26b28af-ab8a-488b-99c8-b04b1aa9b4e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:27.645801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d26b28af-ab8a-488b-99c8-b04b1aa9b4e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:27.658956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d26b28af-ab8a-488b-99c8-b04b1aa9b4e8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.295796 Sep 13 20:22:27.659856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1234/2389] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:27 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:28.692183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-861d3631-facf-4ae0-9a77-3544901412a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:28.693196 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-861d3631-facf-4ae0-9a77-3544901412a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:28.704564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-861d3631-facf-4ae0-9a77-3544901412a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:28.705372 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-861d3631-facf-4ae0-9a77-3544901412a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:28.706107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-861d3631-facf-4ae0-9a77-3544901412a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:28.707286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-861d3631-facf-4ae0-9a77-3544901412a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:28.708039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-861d3631-facf-4ae0-9a77-3544901412a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:28.708740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-861d3631-facf-4ae0-9a77-3544901412a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:28.775814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-861d3631-facf-4ae0-9a77-3544901412a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:28.786839 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-861d3631-facf-4ae0-9a77-3544901412a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.101317 Sep 13 20:22:28.787405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1156/2390] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:29.809226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e9350c5c-8163-42f8-896e-6543d63a073d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:29.809836 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e9350c5c-8163-42f8-896e-6543d63a073d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:29.816922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9350c5c-8163-42f8-896e-6543d63a073d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:29.817404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9350c5c-8163-42f8-896e-6543d63a073d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:29.817833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9350c5c-8163-42f8-896e-6543d63a073d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:29.818691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9350c5c-8163-42f8-896e-6543d63a073d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:29.819344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9350c5c-8163-42f8-896e-6543d63a073d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:29.819956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9350c5c-8163-42f8-896e-6543d63a073d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:29.822619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=100 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:22:29.882202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e9350c5c-8163-42f8-896e-6543d63a073d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:29.890644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e9350c5c-8163-42f8-896e-6543d63a073d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085207 Sep 13 20:22:29.891196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1235/2391] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:30.917945 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e2d4932c-3f76-4854-a48f-aff0ea9f1fd5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:30.918913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e2d4932c-3f76-4854-a48f-aff0ea9f1fd5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:30.929403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2d4932c-3f76-4854-a48f-aff0ea9f1fd5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:30.930204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2d4932c-3f76-4854-a48f-aff0ea9f1fd5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:30.931003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2d4932c-3f76-4854-a48f-aff0ea9f1fd5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:30.932139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2d4932c-3f76-4854-a48f-aff0ea9f1fd5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:30.932894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2d4932c-3f76-4854-a48f-aff0ea9f1fd5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:30.933620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e2d4932c-3f76-4854-a48f-aff0ea9f1fd5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:31.009591 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e2d4932c-3f76-4854-a48f-aff0ea9f1fd5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:31.022499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e2d4932c-3f76-4854-a48f-aff0ea9f1fd5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.110759 Sep 13 20:22:31.023263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1157/2392] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:30 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:32.053573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8ded0b7e-e813-43cd-a815-9f1a9988817e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:32.054548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8ded0b7e-e813-43cd-a815-9f1a9988817e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:32.065599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ded0b7e-e813-43cd-a815-9f1a9988817e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:32.066412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ded0b7e-e813-43cd-a815-9f1a9988817e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:32.067167 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ded0b7e-e813-43cd-a815-9f1a9988817e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:32.068288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ded0b7e-e813-43cd-a815-9f1a9988817e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:32.069034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ded0b7e-e813-43cd-a815-9f1a9988817e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:32.069737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8ded0b7e-e813-43cd-a815-9f1a9988817e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:32.135030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8ded0b7e-e813-43cd-a815-9f1a9988817e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:32.143751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8ded0b7e-e813-43cd-a815-9f1a9988817e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096956 Sep 13 20:22:32.144312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1236/2393] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:32 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:33.168767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a215b04d-e8ac-4088-8627-8c077c7eef98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:33.169473 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a215b04d-e8ac-4088-8627-8c077c7eef98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:33.177714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a215b04d-e8ac-4088-8627-8c077c7eef98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:33.178274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a215b04d-e8ac-4088-8627-8c077c7eef98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:33.178828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a215b04d-e8ac-4088-8627-8c077c7eef98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:33.179614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a215b04d-e8ac-4088-8627-8c077c7eef98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:33.180133 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a215b04d-e8ac-4088-8627-8c077c7eef98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:33.180625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a215b04d-e8ac-4088-8627-8c077c7eef98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:33.249061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a215b04d-e8ac-4088-8627-8c077c7eef98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:33.258092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a215b04d-e8ac-4088-8627-8c077c7eef98 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093948 Sep 13 20:22:33.258718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1158/2394] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:33 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:34.285544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c60688d3-fbf4-4e4d-ab2b-4549efb5f4aa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:34.286586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c60688d3-fbf4-4e4d-ab2b-4549efb5f4aa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:34.290678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:22:34.290972 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:22:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e (ip 10.222.0.52) !!! Sep 13 20:22:34.301153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c60688d3-fbf4-4e4d-ab2b-4549efb5f4aa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:34.301619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c60688d3-fbf4-4e4d-ab2b-4549efb5f4aa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:34.302041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c60688d3-fbf4-4e4d-ab2b-4549efb5f4aa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:34.302788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c60688d3-fbf4-4e4d-ab2b-4549efb5f4aa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:34.303201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c60688d3-fbf4-4e4d-ab2b-4549efb5f4aa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:34.303611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c60688d3-fbf4-4e4d-ab2b-4549efb5f4aa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:34.366195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c60688d3-fbf4-4e4d-ab2b-4549efb5f4aa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:34.374877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c60688d3-fbf4-4e4d-ab2b-4549efb5f4aa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095916 Sep 13 20:22:34.375446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1237/2395] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:34 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:35.397322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-460df945-ae4b-4263-ba18-aebfe1c5ac60 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:35.397929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-460df945-ae4b-4263-ba18-aebfe1c5ac60 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:35.405242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-460df945-ae4b-4263-ba18-aebfe1c5ac60 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:35.405724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-460df945-ae4b-4263-ba18-aebfe1c5ac60 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:35.406156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-460df945-ae4b-4263-ba18-aebfe1c5ac60 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:35.406879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-460df945-ae4b-4263-ba18-aebfe1c5ac60 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:35.407320 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-460df945-ae4b-4263-ba18-aebfe1c5ac60 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:35.407742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-460df945-ae4b-4263-ba18-aebfe1c5ac60 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:35.471275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-460df945-ae4b-4263-ba18-aebfe1c5ac60 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:35.479755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-460df945-ae4b-4263-ba18-aebfe1c5ac60 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.086387 Sep 13 20:22:35.480327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1159/2396] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:35 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:36.506683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-28fd74d9-bb05-4a59-aca4-852fcf50653e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:36.507708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-28fd74d9-bb05-4a59-aca4-852fcf50653e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:36.518518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-28fd74d9-bb05-4a59-aca4-852fcf50653e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:36.518998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-28fd74d9-bb05-4a59-aca4-852fcf50653e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:36.519433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-28fd74d9-bb05-4a59-aca4-852fcf50653e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:36.520120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-28fd74d9-bb05-4a59-aca4-852fcf50653e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:36.520571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-28fd74d9-bb05-4a59-aca4-852fcf50653e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:36.520993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-28fd74d9-bb05-4a59-aca4-852fcf50653e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:36.585978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-28fd74d9-bb05-4a59-aca4-852fcf50653e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:36.598745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-28fd74d9-bb05-4a59-aca4-852fcf50653e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098342 Sep 13 20:22:36.599633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1238/2397] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:36 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:37.626148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5d1472fc-a2dc-4b1f-87f0-395a8517ab6f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:37.626793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5d1472fc-a2dc-4b1f-87f0-395a8517ab6f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:37.629250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:22:37.635354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d1472fc-a2dc-4b1f-87f0-395a8517ab6f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:37.635868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d1472fc-a2dc-4b1f-87f0-395a8517ab6f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:37.636336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d1472fc-a2dc-4b1f-87f0-395a8517ab6f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:37.637017 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d1472fc-a2dc-4b1f-87f0-395a8517ab6f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:37.637468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d1472fc-a2dc-4b1f-87f0-395a8517ab6f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:37.637890 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5d1472fc-a2dc-4b1f-87f0-395a8517ab6f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:37.700725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5d1472fc-a2dc-4b1f-87f0-395a8517ab6f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:37.709589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5d1472fc-a2dc-4b1f-87f0-395a8517ab6f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087439 Sep 13 20:22:37.710151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1160/2398] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:37 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:38.736761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-92af3c8d-6022-4758-a45e-62c8415d8c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:38.737760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-92af3c8d-6022-4758-a45e-62c8415d8c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:38.745734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92af3c8d-6022-4758-a45e-62c8415d8c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:38.746218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92af3c8d-6022-4758-a45e-62c8415d8c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:38.746664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92af3c8d-6022-4758-a45e-62c8415d8c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:38.747344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92af3c8d-6022-4758-a45e-62c8415d8c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:38.747790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92af3c8d-6022-4758-a45e-62c8415d8c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:38.748202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-92af3c8d-6022-4758-a45e-62c8415d8c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:38.817839 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-92af3c8d-6022-4758-a45e-62c8415d8c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:38.827517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-92af3c8d-6022-4758-a45e-62c8415d8c81 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.097293 Sep 13 20:22:38.828015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1239/2399] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:38 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:39.850804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-05d98c3b-5d1a-43b5-944d-f2f44767c764 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:39.851450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-05d98c3b-5d1a-43b5-944d-f2f44767c764 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:39.858477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05d98c3b-5d1a-43b5-944d-f2f44767c764 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:39.859070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05d98c3b-5d1a-43b5-944d-f2f44767c764 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:39.859562 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05d98c3b-5d1a-43b5-944d-f2f44767c764 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:39.860240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05d98c3b-5d1a-43b5-944d-f2f44767c764 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:39.860678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05d98c3b-5d1a-43b5-944d-f2f44767c764 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:39.861091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05d98c3b-5d1a-43b5-944d-f2f44767c764 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:39.863710 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:22:39.928804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-05d98c3b-5d1a-43b5-944d-f2f44767c764 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:39.937507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-05d98c3b-5d1a-43b5-944d-f2f44767c764 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090823 Sep 13 20:22:39.938046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1161/2400] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:39 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:40.962198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2b547d0a-f138-4c00-86c1-d5cb4bd41c6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:40.962969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2b547d0a-f138-4c00-86c1-d5cb4bd41c6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:40.965316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=44 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:22:40.972044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2b547d0a-f138-4c00-86c1-d5cb4bd41c6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:40.972525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2b547d0a-f138-4c00-86c1-d5cb4bd41c6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:40.972953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2b547d0a-f138-4c00-86c1-d5cb4bd41c6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:40.973638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2b547d0a-f138-4c00-86c1-d5cb4bd41c6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:40.974153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2b547d0a-f138-4c00-86c1-d5cb4bd41c6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:40.974670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2b547d0a-f138-4c00-86c1-d5cb4bd41c6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:41.037767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2b547d0a-f138-4c00-86c1-d5cb4bd41c6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:41.046211 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2b547d0a-f138-4c00-86c1-d5cb4bd41c6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.088806 Sep 13 20:22:41.046823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1240/2401] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:40 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:42.072900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-22d1c3e2-cab3-41e8-b0c4-03c521289dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:42.073851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-22d1c3e2-cab3-41e8-b0c4-03c521289dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:42.085179 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22d1c3e2-cab3-41e8-b0c4-03c521289dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:42.086010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22d1c3e2-cab3-41e8-b0c4-03c521289dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:42.086818 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22d1c3e2-cab3-41e8-b0c4-03c521289dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:42.087984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22d1c3e2-cab3-41e8-b0c4-03c521289dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:42.088716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22d1c3e2-cab3-41e8-b0c4-03c521289dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:42.089391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-22d1c3e2-cab3-41e8-b0c4-03c521289dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:42.159548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-22d1c3e2-cab3-41e8-b0c4-03c521289dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:42.168367 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-22d1c3e2-cab3-41e8-b0c4-03c521289dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.102089 Sep 13 20:22:42.168917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1162/2402] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:42 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:43.193492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8eab0386-5ef6-4bab-956d-1da99deef603 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:43.194087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8eab0386-5ef6-4bab-956d-1da99deef603 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:43.204633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8eab0386-5ef6-4bab-956d-1da99deef603 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:43.205192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8eab0386-5ef6-4bab-956d-1da99deef603 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:43.205742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8eab0386-5ef6-4bab-956d-1da99deef603 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:43.206829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8eab0386-5ef6-4bab-956d-1da99deef603 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:43.207413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8eab0386-5ef6-4bab-956d-1da99deef603 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:43.207963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8eab0386-5ef6-4bab-956d-1da99deef603 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:43.282892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8eab0386-5ef6-4bab-956d-1da99deef603 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:43.295313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8eab0386-5ef6-4bab-956d-1da99deef603 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.107432 Sep 13 20:22:43.295961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1241/2403] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:43 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:44.326153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-925b25b4-3108-4ae3-971f-95309718eaa4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:44.327426 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-925b25b4-3108-4ae3-971f-95309718eaa4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:44.339026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-925b25b4-3108-4ae3-971f-95309718eaa4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:44.339828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-925b25b4-3108-4ae3-971f-95309718eaa4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:44.340546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-925b25b4-3108-4ae3-971f-95309718eaa4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:44.341684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-925b25b4-3108-4ae3-971f-95309718eaa4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:44.342463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-925b25b4-3108-4ae3-971f-95309718eaa4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:44.343261 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-925b25b4-3108-4ae3-971f-95309718eaa4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:44.408188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-925b25b4-3108-4ae3-971f-95309718eaa4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:44.416661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-925b25b4-3108-4ae3-971f-95309718eaa4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.097987 Sep 13 20:22:44.417393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1163/2404] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:44 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:45.444877 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-863d75f2-64ad-4a8d-983d-ac7631d7d68f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:45.445844 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-863d75f2-64ad-4a8d-983d-ac7631d7d68f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:45.457901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-863d75f2-64ad-4a8d-983d-ac7631d7d68f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:45.458752 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-863d75f2-64ad-4a8d-983d-ac7631d7d68f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:45.459515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-863d75f2-64ad-4a8d-983d-ac7631d7d68f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:45.460219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-863d75f2-64ad-4a8d-983d-ac7631d7d68f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:45.460685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-863d75f2-64ad-4a8d-983d-ac7631d7d68f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:45.461095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-863d75f2-64ad-4a8d-983d-ac7631d7d68f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:45.534284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-863d75f2-64ad-4a8d-983d-ac7631d7d68f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:45.542787 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-863d75f2-64ad-4a8d-983d-ac7631d7d68f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.105385 Sep 13 20:22:45.543384 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1242/2405] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:45 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:46.569657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-310ce54d-4979-4033-8cbc-06f33cf4c74a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:46.570274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-310ce54d-4979-4033-8cbc-06f33cf4c74a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:46.577569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-310ce54d-4979-4033-8cbc-06f33cf4c74a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:46.578052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-310ce54d-4979-4033-8cbc-06f33cf4c74a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:46.578531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-310ce54d-4979-4033-8cbc-06f33cf4c74a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:46.579225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-310ce54d-4979-4033-8cbc-06f33cf4c74a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:46.579675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-310ce54d-4979-4033-8cbc-06f33cf4c74a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:46.580100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-310ce54d-4979-4033-8cbc-06f33cf4c74a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:46.641178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-310ce54d-4979-4033-8cbc-06f33cf4c74a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:46.650052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-310ce54d-4979-4033-8cbc-06f33cf4c74a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.086604 Sep 13 20:22:46.650656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1164/2406] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:46 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:47.686878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9cc27095-f5bd-420d-bb73-4211cf548982 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:47.687882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9cc27095-f5bd-420d-bb73-4211cf548982 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:47.698713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9cc27095-f5bd-420d-bb73-4211cf548982 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:47.699478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9cc27095-f5bd-420d-bb73-4211cf548982 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:47.700228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9cc27095-f5bd-420d-bb73-4211cf548982 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:47.701747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9cc27095-f5bd-420d-bb73-4211cf548982 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:47.702563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9cc27095-f5bd-420d-bb73-4211cf548982 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:47.703286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9cc27095-f5bd-420d-bb73-4211cf548982 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:47.768811 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9cc27095-f5bd-420d-bb73-4211cf548982 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:47.777305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9cc27095-f5bd-420d-bb73-4211cf548982 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096936 Sep 13 20:22:47.777862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1243/2407] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:47 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:48.802452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1db1abe6-f9e9-4ef8-843e-0b00a1c74376 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:48.803178 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1db1abe6-f9e9-4ef8-843e-0b00a1c74376 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:48.810201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1db1abe6-f9e9-4ef8-843e-0b00a1c74376 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:48.810714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1db1abe6-f9e9-4ef8-843e-0b00a1c74376 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:48.811148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1db1abe6-f9e9-4ef8-843e-0b00a1c74376 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:48.811841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1db1abe6-f9e9-4ef8-843e-0b00a1c74376 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:48.812281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1db1abe6-f9e9-4ef8-843e-0b00a1c74376 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:48.812698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1db1abe6-f9e9-4ef8-843e-0b00a1c74376 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:48.875869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1db1abe6-f9e9-4ef8-843e-0b00a1c74376 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:48.884741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1db1abe6-f9e9-4ef8-843e-0b00a1c74376 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.086297 Sep 13 20:22:48.885313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1165/2408] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:48 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:49.911951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-37e60d3e-1d0e-467c-bc05-3313fc4f163c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:49.912895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-37e60d3e-1d0e-467c-bc05-3313fc4f163c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:49.924009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37e60d3e-1d0e-467c-bc05-3313fc4f163c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:49.924806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37e60d3e-1d0e-467c-bc05-3313fc4f163c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:49.925515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37e60d3e-1d0e-467c-bc05-3313fc4f163c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:49.926696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37e60d3e-1d0e-467c-bc05-3313fc4f163c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:49.927443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37e60d3e-1d0e-467c-bc05-3313fc4f163c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:49.928147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-37e60d3e-1d0e-467c-bc05-3313fc4f163c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:49.990764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-37e60d3e-1d0e-467c-bc05-3313fc4f163c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:49.999232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-37e60d3e-1d0e-467c-bc05-3313fc4f163c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093875 Sep 13 20:22:49.999802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1244/2409] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:49 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:51.023139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-37f26a14-3fcb-4b59-ae3f-125517ac525b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:51.023782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-37f26a14-3fcb-4b59-ae3f-125517ac525b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:51.030509 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37f26a14-3fcb-4b59-ae3f-125517ac525b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:51.030987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37f26a14-3fcb-4b59-ae3f-125517ac525b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:51.031418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37f26a14-3fcb-4b59-ae3f-125517ac525b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:51.032099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37f26a14-3fcb-4b59-ae3f-125517ac525b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:51.032541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37f26a14-3fcb-4b59-ae3f-125517ac525b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:51.032958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37f26a14-3fcb-4b59-ae3f-125517ac525b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:51.097504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-37f26a14-3fcb-4b59-ae3f-125517ac525b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:51.106302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-37f26a14-3fcb-4b59-ae3f-125517ac525b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087122 Sep 13 20:22:51.106891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1166/2410] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:51 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:52.132799 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-24ced6c3-c8a3-43c1-9a35-0b263dffae70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:52.133540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-24ced6c3-c8a3-43c1-9a35-0b263dffae70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:52.141580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-24ced6c3-c8a3-43c1-9a35-0b263dffae70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:52.142144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-24ced6c3-c8a3-43c1-9a35-0b263dffae70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:52.142697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-24ced6c3-c8a3-43c1-9a35-0b263dffae70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:52.143530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-24ced6c3-c8a3-43c1-9a35-0b263dffae70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:52.144030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-24ced6c3-c8a3-43c1-9a35-0b263dffae70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:52.144524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-24ced6c3-c8a3-43c1-9a35-0b263dffae70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:52.207738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-24ced6c3-c8a3-43c1-9a35-0b263dffae70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:52.216320 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-24ced6c3-c8a3-43c1-9a35-0b263dffae70 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.089684 Sep 13 20:22:52.216879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1245/2411] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:52 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:53.243358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9b556f71-91e1-4190-b0a7-8f86f2ac096d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:53.244375 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9b556f71-91e1-4190-b0a7-8f86f2ac096d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:53.255181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b556f71-91e1-4190-b0a7-8f86f2ac096d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:53.256052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b556f71-91e1-4190-b0a7-8f86f2ac096d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:53.256486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b556f71-91e1-4190-b0a7-8f86f2ac096d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:53.257165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b556f71-91e1-4190-b0a7-8f86f2ac096d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:53.257608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b556f71-91e1-4190-b0a7-8f86f2ac096d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:53.258023 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b556f71-91e1-4190-b0a7-8f86f2ac096d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:53.331237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9b556f71-91e1-4190-b0a7-8f86f2ac096d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:53.339690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9b556f71-91e1-4190-b0a7-8f86f2ac096d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.102921 Sep 13 20:22:53.340248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1167/2412] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:53 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:54.366765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7df4e30e-0402-400f-af34-e6a96323bccb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:54.367722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7df4e30e-0402-400f-af34-e6a96323bccb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:54.378735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7df4e30e-0402-400f-af34-e6a96323bccb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:54.379533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7df4e30e-0402-400f-af34-e6a96323bccb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:54.380251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7df4e30e-0402-400f-af34-e6a96323bccb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:54.381332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7df4e30e-0402-400f-af34-e6a96323bccb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:54.381785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7df4e30e-0402-400f-af34-e6a96323bccb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:54.382207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7df4e30e-0402-400f-af34-e6a96323bccb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:54.446571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7df4e30e-0402-400f-af34-e6a96323bccb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:54.455764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7df4e30e-0402-400f-af34-e6a96323bccb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095690 Sep 13 20:22:54.456340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1246/2413] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:54 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:55.481952 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8be66d28-74d4-4b5d-be3b-fac5a75fd514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:55.482965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8be66d28-74d4-4b5d-be3b-fac5a75fd514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:55.492780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8be66d28-74d4-4b5d-be3b-fac5a75fd514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:55.493266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8be66d28-74d4-4b5d-be3b-fac5a75fd514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:55.493703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8be66d28-74d4-4b5d-be3b-fac5a75fd514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:55.494396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8be66d28-74d4-4b5d-be3b-fac5a75fd514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:55.494875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8be66d28-74d4-4b5d-be3b-fac5a75fd514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:55.495293 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8be66d28-74d4-4b5d-be3b-fac5a75fd514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:55.559765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8be66d28-74d4-4b5d-be3b-fac5a75fd514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:55.568712 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8be66d28-74d4-4b5d-be3b-fac5a75fd514 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093203 Sep 13 20:22:55.569286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1168/2414] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:55 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:56.592036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-81a38980-e149-4b5e-a86d-2fea7c18ca13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:56.592646 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-81a38980-e149-4b5e-a86d-2fea7c18ca13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:56.599486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-81a38980-e149-4b5e-a86d-2fea7c18ca13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:56.599964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-81a38980-e149-4b5e-a86d-2fea7c18ca13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:56.600386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-81a38980-e149-4b5e-a86d-2fea7c18ca13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:56.601067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-81a38980-e149-4b5e-a86d-2fea7c18ca13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:56.601514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-81a38980-e149-4b5e-a86d-2fea7c18ca13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:56.601927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-81a38980-e149-4b5e-a86d-2fea7c18ca13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:56.664288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-81a38980-e149-4b5e-a86d-2fea7c18ca13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:56.674771 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-81a38980-e149-4b5e-a86d-2fea7c18ca13 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.086609 Sep 13 20:22:56.675348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1247/2415] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:56 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:57.701785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-742f21ad-594c-462c-a45c-82ab2880fad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:57.702729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-742f21ad-594c-462c-a45c-82ab2880fad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:57.712014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-742f21ad-594c-462c-a45c-82ab2880fad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:57.712500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-742f21ad-594c-462c-a45c-82ab2880fad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:57.712935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-742f21ad-594c-462c-a45c-82ab2880fad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:57.713694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-742f21ad-594c-462c-a45c-82ab2880fad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:57.714149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-742f21ad-594c-462c-a45c-82ab2880fad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:57.714608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-742f21ad-594c-462c-a45c-82ab2880fad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:57.778874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-742f21ad-594c-462c-a45c-82ab2880fad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:57.787814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-742f21ad-594c-462c-a45c-82ab2880fad2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093069 Sep 13 20:22:57.788377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1169/2416] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:57 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:58.158309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8d755cad-c8d4-44a4-92b5-d9815d8fcf64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:58.159340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8d755cad-c8d4-44a4-92b5-d9815d8fcf64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:58.170191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d755cad-c8d4-44a4-92b5-d9815d8fcf64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:58.171053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d755cad-c8d4-44a4-92b5-d9815d8fcf64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:58.171769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d755cad-c8d4-44a4-92b5-d9815d8fcf64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:58.172898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d755cad-c8d4-44a4-92b5-d9815d8fcf64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:58.173650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d755cad-c8d4-44a4-92b5-d9815d8fcf64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:58.174357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d755cad-c8d4-44a4-92b5-d9815d8fcf64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:58.201259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8d755cad-c8d4-44a4-92b5-d9815d8fcf64 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061/ips" status: 200 len: 150 microversion: 2.20 time: 0.049519 Sep 13 20:22:58.201804 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1248/2417] 10.222.0.52 () {60 vars in 1289 bytes} [Tue Sep 13 20:22:58 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:22:58.823368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4b361371-bfca-4943-b8d1-acf89e630df8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:58.824266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4b361371-bfca-4943-b8d1-acf89e630df8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:58.835579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b361371-bfca-4943-b8d1-acf89e630df8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:58.836360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b361371-bfca-4943-b8d1-acf89e630df8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:58.837080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b361371-bfca-4943-b8d1-acf89e630df8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:58.838198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b361371-bfca-4943-b8d1-acf89e630df8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:58.838992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b361371-bfca-4943-b8d1-acf89e630df8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:58.839693 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4b361371-bfca-4943-b8d1-acf89e630df8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:58.908005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4b361371-bfca-4943-b8d1-acf89e630df8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:22:58.916745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4b361371-bfca-4943-b8d1-acf89e630df8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.100107 Sep 13 20:22:58.917311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1170/2418] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:58 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:22:59.944565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-43f9d3f0-655e-4294-837d-48cc4b1932df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:22:59.945412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-43f9d3f0-655e-4294-837d-48cc4b1932df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:22:59.956377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43f9d3f0-655e-4294-837d-48cc4b1932df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:59.957153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43f9d3f0-655e-4294-837d-48cc4b1932df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:59.957851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43f9d3f0-655e-4294-837d-48cc4b1932df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:59.959029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43f9d3f0-655e-4294-837d-48cc4b1932df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:22:59.959469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43f9d3f0-655e-4294-837d-48cc4b1932df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:22:59.959882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43f9d3f0-655e-4294-837d-48cc4b1932df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:22:59.962401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=82 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:23:00.021709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-43f9d3f0-655e-4294-837d-48cc4b1932df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:00.030126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-43f9d3f0-655e-4294-837d-48cc4b1932df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092420 Sep 13 20:23:00.030720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1249/2419] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:22:59 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:01.053100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-19819c8a-a944-47df-92b8-746c9ddf08d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:01.053773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-19819c8a-a944-47df-92b8-746c9ddf08d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:01.060989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-19819c8a-a944-47df-92b8-746c9ddf08d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:01.061524 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-19819c8a-a944-47df-92b8-746c9ddf08d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:01.062007 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-19819c8a-a944-47df-92b8-746c9ddf08d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:01.062814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-19819c8a-a944-47df-92b8-746c9ddf08d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:01.063320 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-19819c8a-a944-47df-92b8-746c9ddf08d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:01.063790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-19819c8a-a944-47df-92b8-746c9ddf08d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:01.124909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-19819c8a-a944-47df-92b8-746c9ddf08d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:01.133511 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-19819c8a-a944-47df-92b8-746c9ddf08d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.084789 Sep 13 20:23:01.134101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1171/2420] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:02.160678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a43dfcee-afa6-4264-aab6-9cc75588cf95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:02.161639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a43dfcee-afa6-4264-aab6-9cc75588cf95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:02.172873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a43dfcee-afa6-4264-aab6-9cc75588cf95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:02.173681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a43dfcee-afa6-4264-aab6-9cc75588cf95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:02.174429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a43dfcee-afa6-4264-aab6-9cc75588cf95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:02.175581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a43dfcee-afa6-4264-aab6-9cc75588cf95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:02.176335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a43dfcee-afa6-4264-aab6-9cc75588cf95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:02.177041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a43dfcee-afa6-4264-aab6-9cc75588cf95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:02.238459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a43dfcee-afa6-4264-aab6-9cc75588cf95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:02.246924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a43dfcee-afa6-4264-aab6-9cc75588cf95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092892 Sep 13 20:23:02.247500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1250/2421] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:02 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:03.277019 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0fb51245-2dd0-449c-809c-91801fd60700 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:03.277970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0fb51245-2dd0-449c-809c-91801fd60700 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:03.288397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0fb51245-2dd0-449c-809c-91801fd60700 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:03.288883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0fb51245-2dd0-449c-809c-91801fd60700 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:03.289317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0fb51245-2dd0-449c-809c-91801fd60700 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:03.290002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0fb51245-2dd0-449c-809c-91801fd60700 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:03.290481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0fb51245-2dd0-449c-809c-91801fd60700 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:03.290905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0fb51245-2dd0-449c-809c-91801fd60700 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:03.364043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0fb51245-2dd0-449c-809c-91801fd60700 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:03.373082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0fb51245-2dd0-449c-809c-91801fd60700 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.102614 Sep 13 20:23:03.373655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1172/2422] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:03 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:04.400051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2b3c7002-d852-43d7-bf7a-7ce448d5691d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:04.400796 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2b3c7002-d852-43d7-bf7a-7ce448d5691d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:04.409344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2b3c7002-d852-43d7-bf7a-7ce448d5691d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:04.409942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2b3c7002-d852-43d7-bf7a-7ce448d5691d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:04.410525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2b3c7002-d852-43d7-bf7a-7ce448d5691d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:04.411377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2b3c7002-d852-43d7-bf7a-7ce448d5691d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:04.411939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2b3c7002-d852-43d7-bf7a-7ce448d5691d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:04.412461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2b3c7002-d852-43d7-bf7a-7ce448d5691d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:04.482525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2b3c7002-d852-43d7-bf7a-7ce448d5691d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:04.495657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2b3c7002-d852-43d7-bf7a-7ce448d5691d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.101650 Sep 13 20:23:04.496284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1251/2423] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:04 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:05.526937 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ca410629-1d75-4ab7-a879-3d9234478351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:05.527994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ca410629-1d75-4ab7-a879-3d9234478351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:05.539233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca410629-1d75-4ab7-a879-3d9234478351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.539736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca410629-1d75-4ab7-a879-3d9234478351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.540174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca410629-1d75-4ab7-a879-3d9234478351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.540863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca410629-1d75-4ab7-a879-3d9234478351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.541314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca410629-1d75-4ab7-a879-3d9234478351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.541738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ca410629-1d75-4ab7-a879-3d9234478351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.604218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ca410629-1d75-4ab7-a879-3d9234478351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:05.613104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ca410629-1d75-4ab7-a879-3d9234478351 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092771 Sep 13 20:23:05.613628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1173/2424] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:05 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:06.638174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-697b7339-ea37-4a4f-a43b-0ec2ce177260 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:06.639004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-697b7339-ea37-4a4f-a43b-0ec2ce177260 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:06.647787 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-697b7339-ea37-4a4f-a43b-0ec2ce177260 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:06.648376 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-697b7339-ea37-4a4f-a43b-0ec2ce177260 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:06.648935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-697b7339-ea37-4a4f-a43b-0ec2ce177260 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:06.649801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-697b7339-ea37-4a4f-a43b-0ec2ce177260 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:06.650238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-697b7339-ea37-4a4f-a43b-0ec2ce177260 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:06.650674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-697b7339-ea37-4a4f-a43b-0ec2ce177260 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:06.717892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-697b7339-ea37-4a4f-a43b-0ec2ce177260 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:06.729319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-697b7339-ea37-4a4f-a43b-0ec2ce177260 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096336 Sep 13 20:23:06.729878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1252/2425] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:07.753110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c2dfdb1c-0f68-439d-8f03-29a7be77629c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:07.753779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c2dfdb1c-0f68-439d-8f03-29a7be77629c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:07.756452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=28 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:23:07.762522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2dfdb1c-0f68-439d-8f03-29a7be77629c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:07.763004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2dfdb1c-0f68-439d-8f03-29a7be77629c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:07.763430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2dfdb1c-0f68-439d-8f03-29a7be77629c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:07.764126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2dfdb1c-0f68-439d-8f03-29a7be77629c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:07.764573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2dfdb1c-0f68-439d-8f03-29a7be77629c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:07.764990 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c2dfdb1c-0f68-439d-8f03-29a7be77629c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:07.830683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c2dfdb1c-0f68-439d-8f03-29a7be77629c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:07.841918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c2dfdb1c-0f68-439d-8f03-29a7be77629c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093108 Sep 13 20:23:07.842525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1174/2426] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:08.868996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4d1d7908-f4de-45a7-b3d9-a84023eaf3e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:08.869896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4d1d7908-f4de-45a7-b3d9-a84023eaf3e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:08.877323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d1d7908-f4de-45a7-b3d9-a84023eaf3e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:08.877831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d1d7908-f4de-45a7-b3d9-a84023eaf3e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:08.878283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d1d7908-f4de-45a7-b3d9-a84023eaf3e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:08.879035 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d1d7908-f4de-45a7-b3d9-a84023eaf3e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:08.879516 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d1d7908-f4de-45a7-b3d9-a84023eaf3e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:08.879953 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d1d7908-f4de-45a7-b3d9-a84023eaf3e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:08.941548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4d1d7908-f4de-45a7-b3d9-a84023eaf3e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:08.950821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4d1d7908-f4de-45a7-b3d9-a84023eaf3e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.088509 Sep 13 20:23:08.951389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1253/2427] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:09.977537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-805e0881-d976-4fa7-a35e-8813d7c2fd95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:09.978531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-805e0881-d976-4fa7-a35e-8813d7c2fd95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:09.985651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-805e0881-d976-4fa7-a35e-8813d7c2fd95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:09.986126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-805e0881-d976-4fa7-a35e-8813d7c2fd95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:09.986593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-805e0881-d976-4fa7-a35e-8813d7c2fd95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:09.987267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-805e0881-d976-4fa7-a35e-8813d7c2fd95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:09.987709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-805e0881-d976-4fa7-a35e-8813d7c2fd95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:09.988124 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-805e0881-d976-4fa7-a35e-8813d7c2fd95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:09.990658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=84 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:23:10.314390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-805e0881-d976-4fa7-a35e-8813d7c2fd95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:10.326571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-805e0881-d976-4fa7-a35e-8813d7c2fd95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.355801 Sep 13 20:23:10.327136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1175/2428] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:11.349043 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c616de6f-6a21-474e-916f-17e83b9d110a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:11.349642 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c616de6f-6a21-474e-916f-17e83b9d110a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:11.352050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=28 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:23:11.357599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c616de6f-6a21-474e-916f-17e83b9d110a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:11.358101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c616de6f-6a21-474e-916f-17e83b9d110a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:11.358548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c616de6f-6a21-474e-916f-17e83b9d110a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:11.359241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c616de6f-6a21-474e-916f-17e83b9d110a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:11.359688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c616de6f-6a21-474e-916f-17e83b9d110a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:11.360125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c616de6f-6a21-474e-916f-17e83b9d110a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:11.423510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c616de6f-6a21-474e-916f-17e83b9d110a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:11.433661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c616de6f-6a21-474e-916f-17e83b9d110a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.088424 Sep 13 20:23:11.434620 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1254/2429] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:11 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:12.461040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ec1d1bb5-df18-44da-a74c-6ab83bf8ecf2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:12.461993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ec1d1bb5-df18-44da-a74c-6ab83bf8ecf2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:12.469919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec1d1bb5-df18-44da-a74c-6ab83bf8ecf2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:12.470417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec1d1bb5-df18-44da-a74c-6ab83bf8ecf2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:12.470869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec1d1bb5-df18-44da-a74c-6ab83bf8ecf2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:12.471559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec1d1bb5-df18-44da-a74c-6ab83bf8ecf2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:12.472012 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec1d1bb5-df18-44da-a74c-6ab83bf8ecf2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:12.472437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ec1d1bb5-df18-44da-a74c-6ab83bf8ecf2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:12.533765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ec1d1bb5-df18-44da-a74c-6ab83bf8ecf2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:12.542476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ec1d1bb5-df18-44da-a74c-6ab83bf8ecf2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087939 Sep 13 20:23:12.543085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1176/2430] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:12 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:13.571033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-23ad0ea5-0241-40e3-a0ba-af9f1e742b07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:13.572297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-23ad0ea5-0241-40e3-a0ba-af9f1e742b07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:13.579683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23ad0ea5-0241-40e3-a0ba-af9f1e742b07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:13.580166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23ad0ea5-0241-40e3-a0ba-af9f1e742b07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:13.580585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23ad0ea5-0241-40e3-a0ba-af9f1e742b07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:13.581297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23ad0ea5-0241-40e3-a0ba-af9f1e742b07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:13.581708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23ad0ea5-0241-40e3-a0ba-af9f1e742b07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:13.582142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-23ad0ea5-0241-40e3-a0ba-af9f1e742b07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:13.646262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-23ad0ea5-0241-40e3-a0ba-af9f1e742b07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:13.654602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-23ad0ea5-0241-40e3-a0ba-af9f1e742b07 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087428 Sep 13 20:23:13.655141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1255/2431] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:14.681892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4999b1b6-089d-41d0-ba6a-c040c45aa863 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:14.682903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4999b1b6-089d-41d0-ba6a-c040c45aa863 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:14.690038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4999b1b6-089d-41d0-ba6a-c040c45aa863 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:14.690556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4999b1b6-089d-41d0-ba6a-c040c45aa863 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:14.690998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4999b1b6-089d-41d0-ba6a-c040c45aa863 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:14.691683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4999b1b6-089d-41d0-ba6a-c040c45aa863 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:14.692130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4999b1b6-089d-41d0-ba6a-c040c45aa863 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:14.692549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4999b1b6-089d-41d0-ba6a-c040c45aa863 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:14.753677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4999b1b6-089d-41d0-ba6a-c040c45aa863 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:14.762555 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4999b1b6-089d-41d0-ba6a-c040c45aa863 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087219 Sep 13 20:23:14.763122 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1177/2432] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:14 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:15.789963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b0b259b1-1f4a-48c9-be9f-3633e81a52dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:15.790999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b0b259b1-1f4a-48c9-be9f-3633e81a52dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:15.798646 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b0b259b1-1f4a-48c9-be9f-3633e81a52dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:15.799122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b0b259b1-1f4a-48c9-be9f-3633e81a52dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:15.799552 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b0b259b1-1f4a-48c9-be9f-3633e81a52dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:15.800234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b0b259b1-1f4a-48c9-be9f-3633e81a52dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:15.800680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b0b259b1-1f4a-48c9-be9f-3633e81a52dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:15.801094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b0b259b1-1f4a-48c9-be9f-3633e81a52dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:15.862069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b0b259b1-1f4a-48c9-be9f-3633e81a52dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:15.870523 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b0b259b1-1f4a-48c9-be9f-3633e81a52dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087039 Sep 13 20:23:15.871078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1256/2433] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:16.903134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ab7933f2-fa2b-452c-a524-338c3e2492ba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:16.903770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ab7933f2-fa2b-452c-a524-338c3e2492ba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:16.911391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab7933f2-fa2b-452c-a524-338c3e2492ba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:16.911922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab7933f2-fa2b-452c-a524-338c3e2492ba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:16.912403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab7933f2-fa2b-452c-a524-338c3e2492ba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:16.913162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab7933f2-fa2b-452c-a524-338c3e2492ba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:16.913657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab7933f2-fa2b-452c-a524-338c3e2492ba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:16.914126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab7933f2-fa2b-452c-a524-338c3e2492ba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:16.982902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ab7933f2-fa2b-452c-a524-338c3e2492ba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:16.991302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ab7933f2-fa2b-452c-a524-338c3e2492ba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094591 Sep 13 20:23:16.991872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1178/2434] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:16 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:18.018349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a0c9b0e5-c3cd-470e-bea3-29f28334e951 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:18.019368 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a0c9b0e5-c3cd-470e-bea3-29f28334e951 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:18.032699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0c9b0e5-c3cd-470e-bea3-29f28334e951 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:18.032699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0c9b0e5-c3cd-470e-bea3-29f28334e951 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:18.032699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0c9b0e5-c3cd-470e-bea3-29f28334e951 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:18.033347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0c9b0e5-c3cd-470e-bea3-29f28334e951 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:18.033879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0c9b0e5-c3cd-470e-bea3-29f28334e951 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:18.035580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a0c9b0e5-c3cd-470e-bea3-29f28334e951 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:18.102750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a0c9b0e5-c3cd-470e-bea3-29f28334e951 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:18.111530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a0c9b0e5-c3cd-470e-bea3-29f28334e951 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099803 Sep 13 20:23:18.112085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1257/2435] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:19.135983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d4621521-37e8-4460-8524-233c898cb0cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:19.136868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d4621521-37e8-4460-8524-233c898cb0cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:19.145833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4621521-37e8-4460-8524-233c898cb0cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:19.146655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4621521-37e8-4460-8524-233c898cb0cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:19.147298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4621521-37e8-4460-8524-233c898cb0cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:19.148229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4621521-37e8-4460-8524-233c898cb0cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:19.148851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4621521-37e8-4460-8524-233c898cb0cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:19.149489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d4621521-37e8-4460-8524-233c898cb0cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:19.213381 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d4621521-37e8-4460-8524-233c898cb0cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:19.221838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d4621521-37e8-4460-8524-233c898cb0cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091208 Sep 13 20:23:19.222405 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1179/2436] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:20.248439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7da71d91-fc8a-46bd-877e-3e69862e397b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:20.249485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7da71d91-fc8a-46bd-877e-3e69862e397b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:20.260297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7da71d91-fc8a-46bd-877e-3e69862e397b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:20.261097 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7da71d91-fc8a-46bd-877e-3e69862e397b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:20.261803 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7da71d91-fc8a-46bd-877e-3e69862e397b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:20.262537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7da71d91-fc8a-46bd-877e-3e69862e397b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:20.263009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7da71d91-fc8a-46bd-877e-3e69862e397b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:20.263447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7da71d91-fc8a-46bd-877e-3e69862e397b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:20.335822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7da71d91-fc8a-46bd-877e-3e69862e397b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:20.348171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7da71d91-fc8a-46bd-877e-3e69862e397b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.106233 Sep 13 20:23:20.348855 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1258/2437] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:21.375104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-26268bf2-b43c-44a2-bd30-783b2ee607af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:21.376061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-26268bf2-b43c-44a2-bd30-783b2ee607af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:21.387259 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26268bf2-b43c-44a2-bd30-783b2ee607af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:21.388057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26268bf2-b43c-44a2-bd30-783b2ee607af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:21.388777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26268bf2-b43c-44a2-bd30-783b2ee607af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:21.389907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26268bf2-b43c-44a2-bd30-783b2ee607af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:21.390819 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26268bf2-b43c-44a2-bd30-783b2ee607af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:21.391526 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-26268bf2-b43c-44a2-bd30-783b2ee607af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:21.457608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-26268bf2-b43c-44a2-bd30-783b2ee607af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:21.466220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-26268bf2-b43c-44a2-bd30-783b2ee607af tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.097862 Sep 13 20:23:21.466821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1180/2438] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:21 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:22.494806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f8b7b625-2d8b-4a0b-bec9-60a94aa05143 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:22.495788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f8b7b625-2d8b-4a0b-bec9-60a94aa05143 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:22.506803 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8b7b625-2d8b-4a0b-bec9-60a94aa05143 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:22.507594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8b7b625-2d8b-4a0b-bec9-60a94aa05143 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:22.508303 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8b7b625-2d8b-4a0b-bec9-60a94aa05143 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:22.509422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8b7b625-2d8b-4a0b-bec9-60a94aa05143 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:22.510163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8b7b625-2d8b-4a0b-bec9-60a94aa05143 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:22.510903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8b7b625-2d8b-4a0b-bec9-60a94aa05143 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:22.575940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f8b7b625-2d8b-4a0b-bec9-60a94aa05143 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:22.584718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f8b7b625-2d8b-4a0b-bec9-60a94aa05143 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096542 Sep 13 20:23:22.585278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1259/2439] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:23.608051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bc75c611-c96b-4992-b0c1-2d1aa8efe844 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:23.608655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bc75c611-c96b-4992-b0c1-2d1aa8efe844 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:23.615643 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc75c611-c96b-4992-b0c1-2d1aa8efe844 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:23.616130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc75c611-c96b-4992-b0c1-2d1aa8efe844 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:23.616555 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc75c611-c96b-4992-b0c1-2d1aa8efe844 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:23.617265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc75c611-c96b-4992-b0c1-2d1aa8efe844 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:23.617718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc75c611-c96b-4992-b0c1-2d1aa8efe844 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:23.618173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc75c611-c96b-4992-b0c1-2d1aa8efe844 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:23.690893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bc75c611-c96b-4992-b0c1-2d1aa8efe844 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:23.699789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bc75c611-c96b-4992-b0c1-2d1aa8efe844 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095492 Sep 13 20:23:23.700359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1181/2440] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:24.727307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a8f6309c-24a4-4ba6-88a1-7721b688056d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:24.728362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a8f6309c-24a4-4ba6-88a1-7721b688056d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:24.736234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a8f6309c-24a4-4ba6-88a1-7721b688056d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:24.736699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a8f6309c-24a4-4ba6-88a1-7721b688056d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:24.737131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a8f6309c-24a4-4ba6-88a1-7721b688056d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:24.737816 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a8f6309c-24a4-4ba6-88a1-7721b688056d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:24.738263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a8f6309c-24a4-4ba6-88a1-7721b688056d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:24.738723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a8f6309c-24a4-4ba6-88a1-7721b688056d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:24.807065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a8f6309c-24a4-4ba6-88a1-7721b688056d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:24.815844 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a8f6309c-24a4-4ba6-88a1-7721b688056d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095188 Sep 13 20:23:24.816539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1260/2441] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:24 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:25.843707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5bd6e1b8-b33f-447a-9195-0036faed5fd4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:25.844568 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5bd6e1b8-b33f-447a-9195-0036faed5fd4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:25.855573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5bd6e1b8-b33f-447a-9195-0036faed5fd4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:25.856358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5bd6e1b8-b33f-447a-9195-0036faed5fd4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:25.857062 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5bd6e1b8-b33f-447a-9195-0036faed5fd4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:25.858172 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5bd6e1b8-b33f-447a-9195-0036faed5fd4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:25.858959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5bd6e1b8-b33f-447a-9195-0036faed5fd4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:25.859634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5bd6e1b8-b33f-447a-9195-0036faed5fd4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:25.927094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5bd6e1b8-b33f-447a-9195-0036faed5fd4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:25.937774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5bd6e1b8-b33f-447a-9195-0036faed5fd4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.100832 Sep 13 20:23:25.938316 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1182/2442] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:26.967143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e72e66a6-2ce6-452e-8b9a-95b3999f4607 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:26.968208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e72e66a6-2ce6-452e-8b9a-95b3999f4607 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:26.979121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e72e66a6-2ce6-452e-8b9a-95b3999f4607 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:26.979919 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e72e66a6-2ce6-452e-8b9a-95b3999f4607 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:26.980812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e72e66a6-2ce6-452e-8b9a-95b3999f4607 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:26.981504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e72e66a6-2ce6-452e-8b9a-95b3999f4607 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:26.981956 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e72e66a6-2ce6-452e-8b9a-95b3999f4607 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:26.982346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e72e66a6-2ce6-452e-8b9a-95b3999f4607 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:27.054963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e72e66a6-2ce6-452e-8b9a-95b3999f4607 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:27.063638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e72e66a6-2ce6-452e-8b9a-95b3999f4607 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.103020 Sep 13 20:23:27.064208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1261/2443] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:28.091382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b932306f-9e20-4af3-9e6a-09adf8fc3164 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:28.092251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b932306f-9e20-4af3-9e6a-09adf8fc3164 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:28.099639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b932306f-9e20-4af3-9e6a-09adf8fc3164 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:28.100149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b932306f-9e20-4af3-9e6a-09adf8fc3164 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:28.100608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b932306f-9e20-4af3-9e6a-09adf8fc3164 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:28.101331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b932306f-9e20-4af3-9e6a-09adf8fc3164 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:28.101804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b932306f-9e20-4af3-9e6a-09adf8fc3164 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:28.102248 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b932306f-9e20-4af3-9e6a-09adf8fc3164 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:28.167751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b932306f-9e20-4af3-9e6a-09adf8fc3164 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:28.176618 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b932306f-9e20-4af3-9e6a-09adf8fc3164 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091798 Sep 13 20:23:28.177198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1183/2444] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:29.204386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-46dfc07b-b9ff-4b96-a0cd-caed1baf6091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:29.205392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-46dfc07b-b9ff-4b96-a0cd-caed1baf6091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:29.216141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46dfc07b-b9ff-4b96-a0cd-caed1baf6091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:29.216935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46dfc07b-b9ff-4b96-a0cd-caed1baf6091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:29.217647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46dfc07b-b9ff-4b96-a0cd-caed1baf6091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:29.218834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46dfc07b-b9ff-4b96-a0cd-caed1baf6091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:29.219591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46dfc07b-b9ff-4b96-a0cd-caed1baf6091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:29.220293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-46dfc07b-b9ff-4b96-a0cd-caed1baf6091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:29.288599 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-46dfc07b-b9ff-4b96-a0cd-caed1baf6091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:29.297259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-46dfc07b-b9ff-4b96-a0cd-caed1baf6091 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099895 Sep 13 20:23:29.297832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1262/2445] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:30.323814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-46a1cda8-9cea-4010-ab37-594bc31f0313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:30.325125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-46a1cda8-9cea-4010-ab37-594bc31f0313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:30.335648 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-46a1cda8-9cea-4010-ab37-594bc31f0313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:30.336445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-46a1cda8-9cea-4010-ab37-594bc31f0313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:30.337183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-46a1cda8-9cea-4010-ab37-594bc31f0313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:30.338361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-46a1cda8-9cea-4010-ab37-594bc31f0313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:30.339134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-46a1cda8-9cea-4010-ab37-594bc31f0313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:30.339883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-46a1cda8-9cea-4010-ab37-594bc31f0313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:30.402941 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-46a1cda8-9cea-4010-ab37-594bc31f0313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:30.411360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-46a1cda8-9cea-4010-ab37-594bc31f0313 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094132 Sep 13 20:23:30.411929 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1184/2446] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:30 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:31.434781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-41728556-569b-42a1-9a82-27c4bdcd1b06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:31.435506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-41728556-569b-42a1-9a82-27c4bdcd1b06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:31.442498 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41728556-569b-42a1-9a82-27c4bdcd1b06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:31.443004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41728556-569b-42a1-9a82-27c4bdcd1b06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:31.443402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41728556-569b-42a1-9a82-27c4bdcd1b06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:31.444091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41728556-569b-42a1-9a82-27c4bdcd1b06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:31.444549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41728556-569b-42a1-9a82-27c4bdcd1b06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:31.444962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41728556-569b-42a1-9a82-27c4bdcd1b06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:31.447611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=84 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:23:31.511193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-41728556-569b-42a1-9a82-27c4bdcd1b06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:31.520187 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-41728556-569b-42a1-9a82-27c4bdcd1b06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.089248 Sep 13 20:23:31.520951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1263/2447] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:31 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:32.547942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-67486bc5-2161-4a35-afa0-2a3f25427a2e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:32.548883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-67486bc5-2161-4a35-afa0-2a3f25427a2e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:32.559903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67486bc5-2161-4a35-afa0-2a3f25427a2e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:32.560685 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67486bc5-2161-4a35-afa0-2a3f25427a2e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:32.561391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67486bc5-2161-4a35-afa0-2a3f25427a2e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:32.562274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67486bc5-2161-4a35-afa0-2a3f25427a2e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:32.562754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67486bc5-2161-4a35-afa0-2a3f25427a2e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:32.563164 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67486bc5-2161-4a35-afa0-2a3f25427a2e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:32.624977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-67486bc5-2161-4a35-afa0-2a3f25427a2e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:32.633807 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-67486bc5-2161-4a35-afa0-2a3f25427a2e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092346 Sep 13 20:23:32.634378 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1185/2448] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:32 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:33.660302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a33b3902-ba56-4561-b674-8258e8c2f88b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:33.661315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a33b3902-ba56-4561-b674-8258e8c2f88b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:33.672391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a33b3902-ba56-4561-b674-8258e8c2f88b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:33.673139 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a33b3902-ba56-4561-b674-8258e8c2f88b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:33.673598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a33b3902-ba56-4561-b674-8258e8c2f88b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:33.674296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a33b3902-ba56-4561-b674-8258e8c2f88b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:33.674807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a33b3902-ba56-4561-b674-8258e8c2f88b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:33.675229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a33b3902-ba56-4561-b674-8258e8c2f88b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:33.744366 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a33b3902-ba56-4561-b674-8258e8c2f88b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:33.752792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a33b3902-ba56-4561-b674-8258e8c2f88b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099095 Sep 13 20:23:33.753357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1264/2449] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:33 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:34.780238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-12848576-7bd8-4c40-a208-4dd5f903f572 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:34.781383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-12848576-7bd8-4c40-a208-4dd5f903f572 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:34.788889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12848576-7bd8-4c40-a208-4dd5f903f572 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:34.789390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12848576-7bd8-4c40-a208-4dd5f903f572 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:34.789837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12848576-7bd8-4c40-a208-4dd5f903f572 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:34.790586 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12848576-7bd8-4c40-a208-4dd5f903f572 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:34.791053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12848576-7bd8-4c40-a208-4dd5f903f572 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:34.791495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12848576-7bd8-4c40-a208-4dd5f903f572 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:34.853656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-12848576-7bd8-4c40-a208-4dd5f903f572 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:34.862286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-12848576-7bd8-4c40-a208-4dd5f903f572 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.088570 Sep 13 20:23:34.863044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1186/2450] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:34 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:35.890356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4d4ca48c-f3db-4daa-980d-bfb388ce34ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:35.890962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4d4ca48c-f3db-4daa-980d-bfb388ce34ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:35.893554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:23:35.893724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:23:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e (ip 10.222.0.52) !!! Sep 13 20:23:35.905112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d4ca48c-f3db-4daa-980d-bfb388ce34ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:35.905577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d4ca48c-f3db-4daa-980d-bfb388ce34ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:35.905997 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d4ca48c-f3db-4daa-980d-bfb388ce34ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:35.906698 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d4ca48c-f3db-4daa-980d-bfb388ce34ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:35.907145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d4ca48c-f3db-4daa-980d-bfb388ce34ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:35.907577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4d4ca48c-f3db-4daa-980d-bfb388ce34ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:36.021931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4d4ca48c-f3db-4daa-980d-bfb388ce34ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:36.030499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4d4ca48c-f3db-4daa-980d-bfb388ce34ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.144134 Sep 13 20:23:36.031055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1265/2451] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:35 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:37.119699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f2e2eb50-8c4f-46cf-b561-35f4358cf90f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:37.120714 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f2e2eb50-8c4f-46cf-b561-35f4358cf90f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:37.130494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f2e2eb50-8c4f-46cf-b561-35f4358cf90f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:37.130978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f2e2eb50-8c4f-46cf-b561-35f4358cf90f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:37.131414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f2e2eb50-8c4f-46cf-b561-35f4358cf90f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:37.132101 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f2e2eb50-8c4f-46cf-b561-35f4358cf90f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:37.132553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f2e2eb50-8c4f-46cf-b561-35f4358cf90f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:37.132972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f2e2eb50-8c4f-46cf-b561-35f4358cf90f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:37.197229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f2e2eb50-8c4f-46cf-b561-35f4358cf90f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:37.206216 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f2e2eb50-8c4f-46cf-b561-35f4358cf90f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092981 Sep 13 20:23:37.206822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1187/2452] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:37 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:38.233271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c33de5bd-f716-4c06-b099-1a9ee1efe9e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:38.234216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c33de5bd-f716-4c06-b099-1a9ee1efe9e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:38.242401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c33de5bd-f716-4c06-b099-1a9ee1efe9e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:38.242933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c33de5bd-f716-4c06-b099-1a9ee1efe9e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:38.243378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c33de5bd-f716-4c06-b099-1a9ee1efe9e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:38.244086 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c33de5bd-f716-4c06-b099-1a9ee1efe9e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:38.244554 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c33de5bd-f716-4c06-b099-1a9ee1efe9e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:38.244989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c33de5bd-f716-4c06-b099-1a9ee1efe9e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:38.308644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c33de5bd-f716-4c06-b099-1a9ee1efe9e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:38.317359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c33de5bd-f716-4c06-b099-1a9ee1efe9e7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090703 Sep 13 20:23:38.317913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1266/2453] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:38 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:39.343383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fb788694-1bd5-48bd-868c-c90f0ed179fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:39.344007 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fb788694-1bd5-48bd-868c-c90f0ed179fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:39.347292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=28 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:23:39.353036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb788694-1bd5-48bd-868c-c90f0ed179fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:39.353517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb788694-1bd5-48bd-868c-c90f0ed179fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:39.353956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb788694-1bd5-48bd-868c-c90f0ed179fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:39.354677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb788694-1bd5-48bd-868c-c90f0ed179fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:39.355126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb788694-1bd5-48bd-868c-c90f0ed179fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:39.355548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb788694-1bd5-48bd-868c-c90f0ed179fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:39.419717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fb788694-1bd5-48bd-868c-c90f0ed179fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:39.430755 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fb788694-1bd5-48bd-868c-c90f0ed179fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093721 Sep 13 20:23:39.431330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1188/2454] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:39 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:40.454218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8aebfdae-fa90-4737-b302-d1b95cdcabc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:40.454968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8aebfdae-fa90-4737-b302-d1b95cdcabc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:40.462097 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8aebfdae-fa90-4737-b302-d1b95cdcabc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:40.462639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8aebfdae-fa90-4737-b302-d1b95cdcabc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:40.463043 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8aebfdae-fa90-4737-b302-d1b95cdcabc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:40.463755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8aebfdae-fa90-4737-b302-d1b95cdcabc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:40.464202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8aebfdae-fa90-4737-b302-d1b95cdcabc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:40.464612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8aebfdae-fa90-4737-b302-d1b95cdcabc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:40.531200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8aebfdae-fa90-4737-b302-d1b95cdcabc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:40.539693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8aebfdae-fa90-4737-b302-d1b95cdcabc8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.089912 Sep 13 20:23:40.540484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1267/2455] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:40 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:41.566311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-92b7db6a-5d53-4412-8ed2-68eddc43a915 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:41.566927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-92b7db6a-5d53-4412-8ed2-68eddc43a915 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:41.574189 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-92b7db6a-5d53-4412-8ed2-68eddc43a915 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:41.574711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-92b7db6a-5d53-4412-8ed2-68eddc43a915 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:41.575146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-92b7db6a-5d53-4412-8ed2-68eddc43a915 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:41.575840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-92b7db6a-5d53-4412-8ed2-68eddc43a915 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:41.576291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-92b7db6a-5d53-4412-8ed2-68eddc43a915 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:41.576713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-92b7db6a-5d53-4412-8ed2-68eddc43a915 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:41.579385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=84 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:23:41.645364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-92b7db6a-5d53-4412-8ed2-68eddc43a915 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:41.656573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-92b7db6a-5d53-4412-8ed2-68eddc43a915 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096084 Sep 13 20:23:41.657348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1189/2456] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:41 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:42.683553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-695773a3-06bc-4091-a126-cdd784d74e2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:42.684601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-695773a3-06bc-4091-a126-cdd784d74e2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:42.688235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=28 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:23:42.696977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-695773a3-06bc-4091-a126-cdd784d74e2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:42.697776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-695773a3-06bc-4091-a126-cdd784d74e2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:42.698901 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-695773a3-06bc-4091-a126-cdd784d74e2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:42.700025 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-695773a3-06bc-4091-a126-cdd784d74e2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:42.700764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-695773a3-06bc-4091-a126-cdd784d74e2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:42.701449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-695773a3-06bc-4091-a126-cdd784d74e2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:42.764887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-695773a3-06bc-4091-a126-cdd784d74e2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:42.774665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-695773a3-06bc-4091-a126-cdd784d74e2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.097728 Sep 13 20:23:42.775264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1268/2457] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:42 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:43.801347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0de0297e-aee8-451c-bdb4-e03b08b37ecd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:43.802353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0de0297e-aee8-451c-bdb4-e03b08b37ecd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:43.813734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0de0297e-aee8-451c-bdb4-e03b08b37ecd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:43.814600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0de0297e-aee8-451c-bdb4-e03b08b37ecd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:43.815313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0de0297e-aee8-451c-bdb4-e03b08b37ecd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:43.815980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0de0297e-aee8-451c-bdb4-e03b08b37ecd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:43.816431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0de0297e-aee8-451c-bdb4-e03b08b37ecd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:43.816844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0de0297e-aee8-451c-bdb4-e03b08b37ecd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:43.889798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0de0297e-aee8-451c-bdb4-e03b08b37ecd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:43.902258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0de0297e-aee8-451c-bdb4-e03b08b37ecd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.107277 Sep 13 20:23:43.903045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1190/2458] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:43 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:44.927990 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1fc37a88-302e-4234-ab29-211f3d764c0b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:44.928612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1fc37a88-302e-4234-ab29-211f3d764c0b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:44.934988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fc37a88-302e-4234-ab29-211f3d764c0b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:44.935464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fc37a88-302e-4234-ab29-211f3d764c0b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:44.935881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fc37a88-302e-4234-ab29-211f3d764c0b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:44.936565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fc37a88-302e-4234-ab29-211f3d764c0b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:44.937003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fc37a88-302e-4234-ab29-211f3d764c0b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:44.937411 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fc37a88-302e-4234-ab29-211f3d764c0b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:44.999352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1fc37a88-302e-4234-ab29-211f3d764c0b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:45.007921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1fc37a88-302e-4234-ab29-211f3d764c0b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.084172 Sep 13 20:23:45.008651 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1269/2459] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:44 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:46.034868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-29b1a317-b7ab-483c-b296-c0c91904a0a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:46.035494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-29b1a317-b7ab-483c-b296-c0c91904a0a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:46.042335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29b1a317-b7ab-483c-b296-c0c91904a0a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:46.042860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29b1a317-b7ab-483c-b296-c0c91904a0a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:46.043288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29b1a317-b7ab-483c-b296-c0c91904a0a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:46.043977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29b1a317-b7ab-483c-b296-c0c91904a0a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:46.044424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29b1a317-b7ab-483c-b296-c0c91904a0a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:46.044851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-29b1a317-b7ab-483c-b296-c0c91904a0a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:46.107499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-29b1a317-b7ab-483c-b296-c0c91904a0a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:46.116468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-29b1a317-b7ab-483c-b296-c0c91904a0a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087717 Sep 13 20:23:46.117005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1191/2460] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:46 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:47.139875 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5a4b94b9-8db8-493e-b916-e9946a26cc0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:47.140460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5a4b94b9-8db8-493e-b916-e9946a26cc0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:47.147580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a4b94b9-8db8-493e-b916-e9946a26cc0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:47.148078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a4b94b9-8db8-493e-b916-e9946a26cc0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:47.148502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a4b94b9-8db8-493e-b916-e9946a26cc0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:47.149227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a4b94b9-8db8-493e-b916-e9946a26cc0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:47.149676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a4b94b9-8db8-493e-b916-e9946a26cc0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:47.150090 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5a4b94b9-8db8-493e-b916-e9946a26cc0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:47.212134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5a4b94b9-8db8-493e-b916-e9946a26cc0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:47.220557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5a4b94b9-8db8-493e-b916-e9946a26cc0a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.084715 Sep 13 20:23:47.221125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1270/2461] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:47 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:48.246738 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c22bae6c-984e-4a7b-b1e3-94187da001cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:48.247388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c22bae6c-984e-4a7b-b1e3-94187da001cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:48.255546 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c22bae6c-984e-4a7b-b1e3-94187da001cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:48.256035 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c22bae6c-984e-4a7b-b1e3-94187da001cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:48.256452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c22bae6c-984e-4a7b-b1e3-94187da001cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:48.257129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c22bae6c-984e-4a7b-b1e3-94187da001cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:48.257574 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c22bae6c-984e-4a7b-b1e3-94187da001cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:48.257989 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c22bae6c-984e-4a7b-b1e3-94187da001cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:48.328002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c22bae6c-984e-4a7b-b1e3-94187da001cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:48.336373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c22bae6c-984e-4a7b-b1e3-94187da001cb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095318 Sep 13 20:23:48.336933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1192/2462] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:48 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:49.362963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-02a725c3-babe-4232-8fc4-34c94ef1ace7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:49.363624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-02a725c3-babe-4232-8fc4-34c94ef1ace7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:49.371148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-02a725c3-babe-4232-8fc4-34c94ef1ace7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:49.371679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-02a725c3-babe-4232-8fc4-34c94ef1ace7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:49.372152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-02a725c3-babe-4232-8fc4-34c94ef1ace7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:49.372897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-02a725c3-babe-4232-8fc4-34c94ef1ace7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:49.373387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-02a725c3-babe-4232-8fc4-34c94ef1ace7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:49.373846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-02a725c3-babe-4232-8fc4-34c94ef1ace7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:49.439945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-02a725c3-babe-4232-8fc4-34c94ef1ace7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:49.448847 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-02a725c3-babe-4232-8fc4-34c94ef1ace7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091699 Sep 13 20:23:49.449408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1271/2463] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:49 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:50.476102 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-47762929-5162-4bbb-8f00-e1daf5c88a40 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:50.477233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-47762929-5162-4bbb-8f00-e1daf5c88a40 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:50.488177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47762929-5162-4bbb-8f00-e1daf5c88a40 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:50.488976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47762929-5162-4bbb-8f00-e1daf5c88a40 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:50.489704 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47762929-5162-4bbb-8f00-e1daf5c88a40 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:50.490891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47762929-5162-4bbb-8f00-e1daf5c88a40 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:50.491643 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47762929-5162-4bbb-8f00-e1daf5c88a40 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:50.492354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-47762929-5162-4bbb-8f00-e1daf5c88a40 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:50.560321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-47762929-5162-4bbb-8f00-e1daf5c88a40 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:50.569169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-47762929-5162-4bbb-8f00-e1daf5c88a40 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099630 Sep 13 20:23:50.569748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1193/2464] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:50 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:51.600891 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ae34b7a9-ebf5-49fd-9d90-69ff2617e958 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:51.601531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ae34b7a9-ebf5-49fd-9d90-69ff2617e958 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:51.609528 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae34b7a9-ebf5-49fd-9d90-69ff2617e958 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:51.610053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae34b7a9-ebf5-49fd-9d90-69ff2617e958 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:51.610629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae34b7a9-ebf5-49fd-9d90-69ff2617e958 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:51.611424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae34b7a9-ebf5-49fd-9d90-69ff2617e958 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:51.611933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae34b7a9-ebf5-49fd-9d90-69ff2617e958 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:51.612438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ae34b7a9-ebf5-49fd-9d90-69ff2617e958 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:51.675713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ae34b7a9-ebf5-49fd-9d90-69ff2617e958 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:51.687726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ae34b7a9-ebf5-49fd-9d90-69ff2617e958 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091710 Sep 13 20:23:51.688361 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1272/2465] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:51 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:52.720321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7f59647a-4440-4ff3-85a4-2ef89b4793a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:52.721333 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7f59647a-4440-4ff3-85a4-2ef89b4793a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:52.728910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f59647a-4440-4ff3-85a4-2ef89b4793a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:52.729439 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f59647a-4440-4ff3-85a4-2ef89b4793a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:52.729923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f59647a-4440-4ff3-85a4-2ef89b4793a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:52.730724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f59647a-4440-4ff3-85a4-2ef89b4793a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:52.731217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f59647a-4440-4ff3-85a4-2ef89b4793a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:52.731680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7f59647a-4440-4ff3-85a4-2ef89b4793a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:52.802594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7f59647a-4440-4ff3-85a4-2ef89b4793a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:52.810947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7f59647a-4440-4ff3-85a4-2ef89b4793a4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.097184 Sep 13 20:23:52.811515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1194/2466] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:52 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:53.834109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ad859634-fe7c-4992-94ac-0fe6c118ffcb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:53.834756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ad859634-fe7c-4992-94ac-0fe6c118ffcb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:53.841523 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad859634-fe7c-4992-94ac-0fe6c118ffcb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:53.842013 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad859634-fe7c-4992-94ac-0fe6c118ffcb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:53.842444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad859634-fe7c-4992-94ac-0fe6c118ffcb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:53.843163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad859634-fe7c-4992-94ac-0fe6c118ffcb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:53.843615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad859634-fe7c-4992-94ac-0fe6c118ffcb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:53.844035 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad859634-fe7c-4992-94ac-0fe6c118ffcb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:53.908775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ad859634-fe7c-4992-94ac-0fe6c118ffcb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:53.917398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ad859634-fe7c-4992-94ac-0fe6c118ffcb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087460 Sep 13 20:23:53.917975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1273/2467] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:53 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:54.947145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-87f4476d-0c57-4744-b6df-43064ba7ac29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:54.948446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-87f4476d-0c57-4744-b6df-43064ba7ac29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:54.959234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87f4476d-0c57-4744-b6df-43064ba7ac29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:54.960022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87f4476d-0c57-4744-b6df-43064ba7ac29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:54.960728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87f4476d-0c57-4744-b6df-43064ba7ac29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:54.961843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87f4476d-0c57-4744-b6df-43064ba7ac29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:54.962620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87f4476d-0c57-4744-b6df-43064ba7ac29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:54.963561 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-87f4476d-0c57-4744-b6df-43064ba7ac29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:55.030474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-87f4476d-0c57-4744-b6df-43064ba7ac29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:55.039066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-87f4476d-0c57-4744-b6df-43064ba7ac29 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098547 Sep 13 20:23:55.039621 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1195/2468] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:54 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:56.066723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-180e27e6-4a21-4485-8427-1f2fd95e3df6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:56.067690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-180e27e6-4a21-4485-8427-1f2fd95e3df6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:56.078965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-180e27e6-4a21-4485-8427-1f2fd95e3df6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:56.079746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-180e27e6-4a21-4485-8427-1f2fd95e3df6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:56.080465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-180e27e6-4a21-4485-8427-1f2fd95e3df6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:56.081589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-180e27e6-4a21-4485-8427-1f2fd95e3df6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:56.082055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-180e27e6-4a21-4485-8427-1f2fd95e3df6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:56.082493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-180e27e6-4a21-4485-8427-1f2fd95e3df6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:56.146973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-180e27e6-4a21-4485-8427-1f2fd95e3df6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:56.155412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-180e27e6-4a21-4485-8427-1f2fd95e3df6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095171 Sep 13 20:23:56.155962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1274/2469] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:56 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:57.181336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9c0bb5fc-2fac-4178-84e1-ebb1c1c35fd2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:57.182341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9c0bb5fc-2fac-4178-84e1-ebb1c1c35fd2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:57.192392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9c0bb5fc-2fac-4178-84e1-ebb1c1c35fd2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:57.192874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9c0bb5fc-2fac-4178-84e1-ebb1c1c35fd2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:57.193307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9c0bb5fc-2fac-4178-84e1-ebb1c1c35fd2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:57.194005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9c0bb5fc-2fac-4178-84e1-ebb1c1c35fd2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:57.194479 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9c0bb5fc-2fac-4178-84e1-ebb1c1c35fd2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:57.194903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9c0bb5fc-2fac-4178-84e1-ebb1c1c35fd2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:57.259022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9c0bb5fc-2fac-4178-84e1-ebb1c1c35fd2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:57.267837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9c0bb5fc-2fac-4178-84e1-ebb1c1c35fd2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093013 Sep 13 20:23:57.268816 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1196/2470] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:57 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:58.295472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7e4570fe-29d3-4ef6-b924-feb61df0d9f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:58.296462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7e4570fe-29d3-4ef6-b924-feb61df0d9f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:58.304717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7e4570fe-29d3-4ef6-b924-feb61df0d9f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:58.305200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7e4570fe-29d3-4ef6-b924-feb61df0d9f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:58.305621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7e4570fe-29d3-4ef6-b924-feb61df0d9f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:58.306289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7e4570fe-29d3-4ef6-b924-feb61df0d9f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:58.306762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7e4570fe-29d3-4ef6-b924-feb61df0d9f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:58.307168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7e4570fe-29d3-4ef6-b924-feb61df0d9f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:58.373099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7e4570fe-29d3-4ef6-b924-feb61df0d9f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:58.381895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7e4570fe-29d3-4ef6-b924-feb61df0d9f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092959 Sep 13 20:23:58.382484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1275/2471] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:58 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:23:59.409530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0105c811-ac6d-44e2-98f8-48d3916d3a77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:59.410126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0105c811-ac6d-44e2-98f8-48d3916d3a77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:59.416978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0105c811-ac6d-44e2-98f8-48d3916d3a77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:59.417465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0105c811-ac6d-44e2-98f8-48d3916d3a77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:59.417903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0105c811-ac6d-44e2-98f8-48d3916d3a77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:59.418629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0105c811-ac6d-44e2-98f8-48d3916d3a77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:59.419105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0105c811-ac6d-44e2-98f8-48d3916d3a77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:59.419510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0105c811-ac6d-44e2-98f8-48d3916d3a77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:59.485236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0105c811-ac6d-44e2-98f8-48d3916d3a77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:59.493660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0105c811-ac6d-44e2-98f8-48d3916d3a77 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090706 Sep 13 20:23:59.494231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1197/2472] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:59 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:00.521110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a1f95db6-f604-4a46-aa02-6baa5384cb08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:00.522070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a1f95db6-f604-4a46-aa02-6baa5384cb08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:00.533099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1f95db6-f604-4a46-aa02-6baa5384cb08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:00.533887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1f95db6-f604-4a46-aa02-6baa5384cb08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:00.534673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1f95db6-f604-4a46-aa02-6baa5384cb08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:00.535829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1f95db6-f604-4a46-aa02-6baa5384cb08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:00.536576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1f95db6-f604-4a46-aa02-6baa5384cb08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:00.537304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a1f95db6-f604-4a46-aa02-6baa5384cb08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:00.604988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a1f95db6-f604-4a46-aa02-6baa5384cb08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:00.613631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a1f95db6-f604-4a46-aa02-6baa5384cb08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099101 Sep 13 20:24:00.614232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1276/2473] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:00 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:01.641055 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-eff85863-3b15-4006-8df5-6aa7a1e01939 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:01.642061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-eff85863-3b15-4006-8df5-6aa7a1e01939 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:01.652500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eff85863-3b15-4006-8df5-6aa7a1e01939 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:01.653301 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eff85863-3b15-4006-8df5-6aa7a1e01939 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:01.654066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eff85863-3b15-4006-8df5-6aa7a1e01939 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:01.655231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eff85863-3b15-4006-8df5-6aa7a1e01939 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:01.655980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eff85863-3b15-4006-8df5-6aa7a1e01939 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:01.656740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eff85863-3b15-4006-8df5-6aa7a1e01939 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:01.719256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eff85863-3b15-4006-8df5-6aa7a1e01939 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:01.727710 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-eff85863-3b15-4006-8df5-6aa7a1e01939 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093230 Sep 13 20:24:01.728272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1198/2474] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:02.754032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bb036c90-d3d4-478b-a52b-813cc8a3e656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:02.755049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bb036c90-d3d4-478b-a52b-813cc8a3e656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:02.766122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bb036c90-d3d4-478b-a52b-813cc8a3e656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:02.766960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bb036c90-d3d4-478b-a52b-813cc8a3e656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:02.767714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bb036c90-d3d4-478b-a52b-813cc8a3e656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:02.768843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bb036c90-d3d4-478b-a52b-813cc8a3e656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:02.769696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bb036c90-d3d4-478b-a52b-813cc8a3e656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:02.770136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bb036c90-d3d4-478b-a52b-813cc8a3e656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:02.772734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=84 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:24:02.843107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bb036c90-d3d4-478b-a52b-813cc8a3e656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:02.855283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bb036c90-d3d4-478b-a52b-813cc8a3e656 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.107649 Sep 13 20:24:02.855989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1277/2475] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:02 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:03.885251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3ffef8d0-0d57-4930-9c4b-ad44bb2f61c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:03.886110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3ffef8d0-0d57-4930-9c4b-ad44bb2f61c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:03.897206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ffef8d0-0d57-4930-9c4b-ad44bb2f61c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:03.897998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ffef8d0-0d57-4930-9c4b-ad44bb2f61c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:03.898787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ffef8d0-0d57-4930-9c4b-ad44bb2f61c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:03.899973 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ffef8d0-0d57-4930-9c4b-ad44bb2f61c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:03.900709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ffef8d0-0d57-4930-9c4b-ad44bb2f61c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:03.901408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ffef8d0-0d57-4930-9c4b-ad44bb2f61c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:03.969127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3ffef8d0-0d57-4930-9c4b-ad44bb2f61c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:03.978237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3ffef8d0-0d57-4930-9c4b-ad44bb2f61c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099911 Sep 13 20:24:03.978843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1199/2476] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:03 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:05.005438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7cf37441-ba38-4022-bd5e-476c96d14231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:05.006407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7cf37441-ba38-4022-bd5e-476c96d14231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:05.017556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7cf37441-ba38-4022-bd5e-476c96d14231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:05.018353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7cf37441-ba38-4022-bd5e-476c96d14231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:05.019176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7cf37441-ba38-4022-bd5e-476c96d14231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:05.020224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7cf37441-ba38-4022-bd5e-476c96d14231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:05.020718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7cf37441-ba38-4022-bd5e-476c96d14231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:05.021145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7cf37441-ba38-4022-bd5e-476c96d14231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:05.082887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7cf37441-ba38-4022-bd5e-476c96d14231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:05.091544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7cf37441-ba38-4022-bd5e-476c96d14231 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092829 Sep 13 20:24:05.092108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1278/2477] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:04 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:06.118104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8c55c483-9a4a-45da-83ee-a2b4fbea8544 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:06.119050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8c55c483-9a4a-45da-83ee-a2b4fbea8544 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:06.129700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c55c483-9a4a-45da-83ee-a2b4fbea8544 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:06.130182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c55c483-9a4a-45da-83ee-a2b4fbea8544 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:06.130653 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c55c483-9a4a-45da-83ee-a2b4fbea8544 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:06.131338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c55c483-9a4a-45da-83ee-a2b4fbea8544 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:06.131793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c55c483-9a4a-45da-83ee-a2b4fbea8544 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:06.132217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c55c483-9a4a-45da-83ee-a2b4fbea8544 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:06.203949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8c55c483-9a4a-45da-83ee-a2b4fbea8544 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:06.212367 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8c55c483-9a4a-45da-83ee-a2b4fbea8544 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.100971 Sep 13 20:24:06.212905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1200/2478] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:07.239920 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-94d86711-0c24-40c0-b6b2-a070a414def9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:07.240897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-94d86711-0c24-40c0-b6b2-a070a414def9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:07.251947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-94d86711-0c24-40c0-b6b2-a070a414def9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:07.252729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-94d86711-0c24-40c0-b6b2-a070a414def9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:07.253439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-94d86711-0c24-40c0-b6b2-a070a414def9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:07.254617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-94d86711-0c24-40c0-b6b2-a070a414def9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:07.255358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-94d86711-0c24-40c0-b6b2-a070a414def9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:07.256049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-94d86711-0c24-40c0-b6b2-a070a414def9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:07.328914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-94d86711-0c24-40c0-b6b2-a070a414def9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:07.337798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-94d86711-0c24-40c0-b6b2-a070a414def9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.104729 Sep 13 20:24:07.338392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1279/2479] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:08.374269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fc2003a7-b1e7-4486-a2e5-600af2c4620d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:08.375278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fc2003a7-b1e7-4486-a2e5-600af2c4620d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:08.384052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc2003a7-b1e7-4486-a2e5-600af2c4620d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:08.384689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc2003a7-b1e7-4486-a2e5-600af2c4620d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:08.385190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc2003a7-b1e7-4486-a2e5-600af2c4620d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:08.385987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc2003a7-b1e7-4486-a2e5-600af2c4620d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:08.386487 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc2003a7-b1e7-4486-a2e5-600af2c4620d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:08.386921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fc2003a7-b1e7-4486-a2e5-600af2c4620d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:08.453720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fc2003a7-b1e7-4486-a2e5-600af2c4620d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:08.462089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fc2003a7-b1e7-4486-a2e5-600af2c4620d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095541 Sep 13 20:24:08.462696 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1201/2480] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:09.485480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c8bd8da8-0352-4ac6-9811-39e30b1052ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:09.486040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c8bd8da8-0352-4ac6-9811-39e30b1052ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:09.493432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8bd8da8-0352-4ac6-9811-39e30b1052ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:09.493850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8bd8da8-0352-4ac6-9811-39e30b1052ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:09.494276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8bd8da8-0352-4ac6-9811-39e30b1052ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:09.495001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8bd8da8-0352-4ac6-9811-39e30b1052ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:09.495446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8bd8da8-0352-4ac6-9811-39e30b1052ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:09.495865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c8bd8da8-0352-4ac6-9811-39e30b1052ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:09.556487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c8bd8da8-0352-4ac6-9811-39e30b1052ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:09.565134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c8bd8da8-0352-4ac6-9811-39e30b1052ce tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.083629 Sep 13 20:24:09.565693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1280/2481] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:10.589392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9632611e-25d8-4080-aad1-2fef84f76dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:10.590069 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9632611e-25d8-4080-aad1-2fef84f76dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:10.592689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=28 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:24:10.599007 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9632611e-25d8-4080-aad1-2fef84f76dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:10.599729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9632611e-25d8-4080-aad1-2fef84f76dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:10.600166 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9632611e-25d8-4080-aad1-2fef84f76dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:10.600852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9632611e-25d8-4080-aad1-2fef84f76dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:10.601302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9632611e-25d8-4080-aad1-2fef84f76dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:10.601728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9632611e-25d8-4080-aad1-2fef84f76dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:10.673812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9632611e-25d8-4080-aad1-2fef84f76dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:10.682285 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9632611e-25d8-4080-aad1-2fef84f76dbd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.097269 Sep 13 20:24:10.682891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1202/2482] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:10 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:11.709525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b9c7c34d-4ae6-4e1a-8a8f-c0df6e61566c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:11.710102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b9c7c34d-4ae6-4e1a-8a8f-c0df6e61566c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:11.717760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9c7c34d-4ae6-4e1a-8a8f-c0df6e61566c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:11.718295 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9c7c34d-4ae6-4e1a-8a8f-c0df6e61566c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:11.718814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9c7c34d-4ae6-4e1a-8a8f-c0df6e61566c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:11.719578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9c7c34d-4ae6-4e1a-8a8f-c0df6e61566c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:11.720075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9c7c34d-4ae6-4e1a-8a8f-c0df6e61566c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:11.720542 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b9c7c34d-4ae6-4e1a-8a8f-c0df6e61566c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:11.785566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b9c7c34d-4ae6-4e1a-8a8f-c0df6e61566c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:11.794508 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b9c7c34d-4ae6-4e1a-8a8f-c0df6e61566c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091058 Sep 13 20:24:11.795088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1281/2483] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:11 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:12.822099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e8abe71b-7278-481c-a5c3-f91ed3ff07cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:12.823516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e8abe71b-7278-481c-a5c3-f91ed3ff07cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:12.835095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8abe71b-7278-481c-a5c3-f91ed3ff07cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:12.835875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8abe71b-7278-481c-a5c3-f91ed3ff07cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:12.836597 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8abe71b-7278-481c-a5c3-f91ed3ff07cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:12.837711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8abe71b-7278-481c-a5c3-f91ed3ff07cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:12.838459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8abe71b-7278-481c-a5c3-f91ed3ff07cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:12.839234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8abe71b-7278-481c-a5c3-f91ed3ff07cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:12.843410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=84 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:24:12.908758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e8abe71b-7278-481c-a5c3-f91ed3ff07cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:12.917200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e8abe71b-7278-481c-a5c3-f91ed3ff07cc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.101851 Sep 13 20:24:12.917758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1203/2484] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:12 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:13.944404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-05910031-180e-4f65-a3d8-9b20c63544e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:13.945306 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-05910031-180e-4f65-a3d8-9b20c63544e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:13.948835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=28 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:24:13.958075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-05910031-180e-4f65-a3d8-9b20c63544e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:13.958594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-05910031-180e-4f65-a3d8-9b20c63544e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:13.959173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-05910031-180e-4f65-a3d8-9b20c63544e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:13.959860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-05910031-180e-4f65-a3d8-9b20c63544e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:13.960308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-05910031-180e-4f65-a3d8-9b20c63544e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:13.960724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-05910031-180e-4f65-a3d8-9b20c63544e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:14.032446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-05910031-180e-4f65-a3d8-9b20c63544e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:14.041371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-05910031-180e-4f65-a3d8-9b20c63544e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.103714 Sep 13 20:24:14.041935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1282/2485] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:15.065060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-15d05f5f-6908-4b69-a5bd-20a40bf6a4db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:15.065711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-15d05f5f-6908-4b69-a5bd-20a40bf6a4db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:15.073157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15d05f5f-6908-4b69-a5bd-20a40bf6a4db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:15.073628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15d05f5f-6908-4b69-a5bd-20a40bf6a4db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:15.074058 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15d05f5f-6908-4b69-a5bd-20a40bf6a4db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:15.074768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15d05f5f-6908-4b69-a5bd-20a40bf6a4db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:15.075217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15d05f5f-6908-4b69-a5bd-20a40bf6a4db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:15.075630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-15d05f5f-6908-4b69-a5bd-20a40bf6a4db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:15.138322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-15d05f5f-6908-4b69-a5bd-20a40bf6a4db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:15.146827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-15d05f5f-6908-4b69-a5bd-20a40bf6a4db tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.086090 Sep 13 20:24:15.147381 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1204/2486] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:16.173588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8d2ad1bb-8d1e-43ec-ba06-94aad0c0a718 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:16.174600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8d2ad1bb-8d1e-43ec-ba06-94aad0c0a718 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:16.183176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d2ad1bb-8d1e-43ec-ba06-94aad0c0a718 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:16.183679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d2ad1bb-8d1e-43ec-ba06-94aad0c0a718 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:16.184131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d2ad1bb-8d1e-43ec-ba06-94aad0c0a718 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:16.184856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d2ad1bb-8d1e-43ec-ba06-94aad0c0a718 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:16.185331 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d2ad1bb-8d1e-43ec-ba06-94aad0c0a718 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:16.185771 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d2ad1bb-8d1e-43ec-ba06-94aad0c0a718 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:16.251989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8d2ad1bb-8d1e-43ec-ba06-94aad0c0a718 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:16.260504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8d2ad1bb-8d1e-43ec-ba06-94aad0c0a718 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093389 Sep 13 20:24:16.261075 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1283/2487] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:16 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:17.287272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fdcb5262-27a9-4b91-b91c-98958a50b4cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:17.288278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fdcb5262-27a9-4b91-b91c-98958a50b4cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:17.291361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:24:17.291656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:24:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e (ip 10.222.0.52) !!! Sep 13 20:24:17.302866 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fdcb5262-27a9-4b91-b91c-98958a50b4cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:17.303646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fdcb5262-27a9-4b91-b91c-98958a50b4cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:17.304358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fdcb5262-27a9-4b91-b91c-98958a50b4cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:17.305464 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fdcb5262-27a9-4b91-b91c-98958a50b4cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:17.306195 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fdcb5262-27a9-4b91-b91c-98958a50b4cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:17.306944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fdcb5262-27a9-4b91-b91c-98958a50b4cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:17.375924 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fdcb5262-27a9-4b91-b91c-98958a50b4cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:17.384356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fdcb5262-27a9-4b91-b91c-98958a50b4cd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.103770 Sep 13 20:24:17.384914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1205/2488] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:17 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:18.407279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f8749fc8-03b7-4ffa-9f10-f907fb1a697c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:18.407917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f8749fc8-03b7-4ffa-9f10-f907fb1a697c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:18.415010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8749fc8-03b7-4ffa-9f10-f907fb1a697c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:18.415486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8749fc8-03b7-4ffa-9f10-f907fb1a697c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:18.415911 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8749fc8-03b7-4ffa-9f10-f907fb1a697c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:18.416589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8749fc8-03b7-4ffa-9f10-f907fb1a697c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:18.417029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8749fc8-03b7-4ffa-9f10-f907fb1a697c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:18.417442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f8749fc8-03b7-4ffa-9f10-f907fb1a697c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:18.480105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f8749fc8-03b7-4ffa-9f10-f907fb1a697c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:18.488812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f8749fc8-03b7-4ffa-9f10-f907fb1a697c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085465 Sep 13 20:24:18.489338 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1284/2489] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:19.516150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-493d8e57-e361-4b41-b4e4-5d0469997b9b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:19.517009 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-493d8e57-e361-4b41-b4e4-5d0469997b9b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:19.528010 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-493d8e57-e361-4b41-b4e4-5d0469997b9b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:19.528814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-493d8e57-e361-4b41-b4e4-5d0469997b9b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:19.529539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-493d8e57-e361-4b41-b4e4-5d0469997b9b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:19.530743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-493d8e57-e361-4b41-b4e4-5d0469997b9b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:19.531497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-493d8e57-e361-4b41-b4e4-5d0469997b9b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:19.532207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-493d8e57-e361-4b41-b4e4-5d0469997b9b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:19.597098 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-493d8e57-e361-4b41-b4e4-5d0469997b9b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:19.606005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-493d8e57-e361-4b41-b4e4-5d0469997b9b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096565 Sep 13 20:24:19.606605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1206/2490] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:20.633287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bcff89fb-c3be-44bf-aecc-97749f7096ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:20.634300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bcff89fb-c3be-44bf-aecc-97749f7096ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:20.645302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcff89fb-c3be-44bf-aecc-97749f7096ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:20.645784 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcff89fb-c3be-44bf-aecc-97749f7096ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:20.646215 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcff89fb-c3be-44bf-aecc-97749f7096ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:20.646946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcff89fb-c3be-44bf-aecc-97749f7096ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:20.647395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcff89fb-c3be-44bf-aecc-97749f7096ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:20.647815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcff89fb-c3be-44bf-aecc-97749f7096ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:20.718714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bcff89fb-c3be-44bf-aecc-97749f7096ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:20.727099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bcff89fb-c3be-44bf-aecc-97749f7096ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.100518 Sep 13 20:24:20.727637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1285/2491] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:21.753446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-20550dbf-6870-4f9a-a223-5eceb969d645 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:21.754510 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-20550dbf-6870-4f9a-a223-5eceb969d645 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:21.761430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20550dbf-6870-4f9a-a223-5eceb969d645 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:21.761932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20550dbf-6870-4f9a-a223-5eceb969d645 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:21.762395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20550dbf-6870-4f9a-a223-5eceb969d645 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:21.763076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20550dbf-6870-4f9a-a223-5eceb969d645 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:21.763522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20550dbf-6870-4f9a-a223-5eceb969d645 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:21.763939 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-20550dbf-6870-4f9a-a223-5eceb969d645 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:21.827849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-20550dbf-6870-4f9a-a223-5eceb969d645 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:21.836231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-20550dbf-6870-4f9a-a223-5eceb969d645 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.089303 Sep 13 20:24:21.836800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1207/2492] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:21 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:22.863835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-803a0f3c-9d39-41b5-8a48-5a19c7cb4cfb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:22.864556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-803a0f3c-9d39-41b5-8a48-5a19c7cb4cfb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:22.873643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-803a0f3c-9d39-41b5-8a48-5a19c7cb4cfb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:22.874290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-803a0f3c-9d39-41b5-8a48-5a19c7cb4cfb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:22.874913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-803a0f3c-9d39-41b5-8a48-5a19c7cb4cfb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:22.875886 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-803a0f3c-9d39-41b5-8a48-5a19c7cb4cfb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:22.876515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-803a0f3c-9d39-41b5-8a48-5a19c7cb4cfb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:22.877080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-803a0f3c-9d39-41b5-8a48-5a19c7cb4cfb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:22.943965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-803a0f3c-9d39-41b5-8a48-5a19c7cb4cfb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:22.952755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-803a0f3c-9d39-41b5-8a48-5a19c7cb4cfb tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095713 Sep 13 20:24:22.953329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1286/2493] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:23.980086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3a8b485e-83bd-4aa2-91a3-9022d4d19c85 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:23.981051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3a8b485e-83bd-4aa2-91a3-9022d4d19c85 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:23.992128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a8b485e-83bd-4aa2-91a3-9022d4d19c85 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:23.992926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a8b485e-83bd-4aa2-91a3-9022d4d19c85 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:23.993648 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a8b485e-83bd-4aa2-91a3-9022d4d19c85 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:23.994832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a8b485e-83bd-4aa2-91a3-9022d4d19c85 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:23.995589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a8b485e-83bd-4aa2-91a3-9022d4d19c85 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:23.996297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a8b485e-83bd-4aa2-91a3-9022d4d19c85 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:24.063881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3a8b485e-83bd-4aa2-91a3-9022d4d19c85 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:24.072797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3a8b485e-83bd-4aa2-91a3-9022d4d19c85 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099229 Sep 13 20:24:24.073361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1208/2494] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:25.099714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-75abc077-b407-4b4b-888a-41f517868dd1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:25.100319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-75abc077-b407-4b4b-888a-41f517868dd1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:25.110361 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75abc077-b407-4b4b-888a-41f517868dd1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:25.110944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75abc077-b407-4b4b-888a-41f517868dd1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:25.111489 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75abc077-b407-4b4b-888a-41f517868dd1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:25.112512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75abc077-b407-4b4b-888a-41f517868dd1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:25.113110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75abc077-b407-4b4b-888a-41f517868dd1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:25.113788 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-75abc077-b407-4b4b-888a-41f517868dd1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:25.188100 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-75abc077-b407-4b4b-888a-41f517868dd1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:25.201154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-75abc077-b407-4b4b-888a-41f517868dd1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.107521 Sep 13 20:24:25.201938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1287/2495] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:26.228024 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-91b9bfde-438b-4056-9fd1-e5b0738edc18 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:26.228761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-91b9bfde-438b-4056-9fd1-e5b0738edc18 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:26.237886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-91b9bfde-438b-4056-9fd1-e5b0738edc18 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:26.238527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-91b9bfde-438b-4056-9fd1-e5b0738edc18 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:26.239077 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-91b9bfde-438b-4056-9fd1-e5b0738edc18 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:26.239930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-91b9bfde-438b-4056-9fd1-e5b0738edc18 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:26.240495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-91b9bfde-438b-4056-9fd1-e5b0738edc18 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:26.241025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-91b9bfde-438b-4056-9fd1-e5b0738edc18 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:26.309365 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-91b9bfde-438b-4056-9fd1-e5b0738edc18 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:26.317957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-91b9bfde-438b-4056-9fd1-e5b0738edc18 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095219 Sep 13 20:24:26.318552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1209/2496] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:27.345332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8c68d42e-0426-4d57-8a39-b6cc47e34c2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:27.346302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8c68d42e-0426-4d57-8a39-b6cc47e34c2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:27.357149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c68d42e-0426-4d57-8a39-b6cc47e34c2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:27.357931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c68d42e-0426-4d57-8a39-b6cc47e34c2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:27.358696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c68d42e-0426-4d57-8a39-b6cc47e34c2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:27.359805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c68d42e-0426-4d57-8a39-b6cc47e34c2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:27.360545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c68d42e-0426-4d57-8a39-b6cc47e34c2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:27.361225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8c68d42e-0426-4d57-8a39-b6cc47e34c2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:27.425434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8c68d42e-0426-4d57-8a39-b6cc47e34c2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:27.433898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8c68d42e-0426-4d57-8a39-b6cc47e34c2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095136 Sep 13 20:24:27.434491 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1288/2497] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:27 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:28.457564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-db92643e-f089-4739-84ba-acc60ebef7a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:28.458186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-db92643e-f089-4739-84ba-acc60ebef7a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:28.465336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-db92643e-f089-4739-84ba-acc60ebef7a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:28.465820 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-db92643e-f089-4739-84ba-acc60ebef7a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:28.466258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-db92643e-f089-4739-84ba-acc60ebef7a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:28.466973 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-db92643e-f089-4739-84ba-acc60ebef7a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:28.467442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-db92643e-f089-4739-84ba-acc60ebef7a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:28.467867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-db92643e-f089-4739-84ba-acc60ebef7a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:28.530878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-db92643e-f089-4739-84ba-acc60ebef7a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:28.539707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-db92643e-f089-4739-84ba-acc60ebef7a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.086200 Sep 13 20:24:28.540289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1210/2498] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:29.567565 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3de25fef-3955-47d8-83e5-0c91ab4d9867 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:29.568128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3de25fef-3955-47d8-83e5-0c91ab4d9867 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:29.574955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3de25fef-3955-47d8-83e5-0c91ab4d9867 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:29.575451 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3de25fef-3955-47d8-83e5-0c91ab4d9867 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:29.575874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3de25fef-3955-47d8-83e5-0c91ab4d9867 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:29.576557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3de25fef-3955-47d8-83e5-0c91ab4d9867 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:29.577003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3de25fef-3955-47d8-83e5-0c91ab4d9867 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:29.577417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3de25fef-3955-47d8-83e5-0c91ab4d9867 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:29.641283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3de25fef-3955-47d8-83e5-0c91ab4d9867 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:29.650130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3de25fef-3955-47d8-83e5-0c91ab4d9867 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.089765 Sep 13 20:24:29.650743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1289/2499] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:30.676800 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5624b32a-2ede-40f7-ad8a-00b120e948ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:30.677384 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5624b32a-2ede-40f7-ad8a-00b120e948ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:30.683954 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5624b32a-2ede-40f7-ad8a-00b120e948ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:30.684428 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5624b32a-2ede-40f7-ad8a-00b120e948ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:30.684856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5624b32a-2ede-40f7-ad8a-00b120e948ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:30.685532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5624b32a-2ede-40f7-ad8a-00b120e948ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:30.685978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5624b32a-2ede-40f7-ad8a-00b120e948ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:30.686404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5624b32a-2ede-40f7-ad8a-00b120e948ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:30.749942 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5624b32a-2ede-40f7-ad8a-00b120e948ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:30.758903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5624b32a-2ede-40f7-ad8a-00b120e948ca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.088551 Sep 13 20:24:30.759474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1211/2500] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:30 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:31.785238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e1493f52-7ae4-43a3-ac7c-2c5e71d81f2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:31.786085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e1493f52-7ae4-43a3-ac7c-2c5e71d81f2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:31.792969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1493f52-7ae4-43a3-ac7c-2c5e71d81f2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:31.793437 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1493f52-7ae4-43a3-ac7c-2c5e71d81f2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:31.793857 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1493f52-7ae4-43a3-ac7c-2c5e71d81f2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:31.794576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1493f52-7ae4-43a3-ac7c-2c5e71d81f2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:31.795018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1493f52-7ae4-43a3-ac7c-2c5e71d81f2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:31.795427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e1493f52-7ae4-43a3-ac7c-2c5e71d81f2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:31.859113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e1493f52-7ae4-43a3-ac7c-2c5e71d81f2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:31.869430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e1493f52-7ae4-43a3-ac7c-2c5e71d81f2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090730 Sep 13 20:24:31.870028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1290/2501] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:31 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:32.896660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8388d099-55d6-4589-a8f8-550b4d30a280 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:32.897533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8388d099-55d6-4589-a8f8-550b4d30a280 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:32.908249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8388d099-55d6-4589-a8f8-550b4d30a280 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:32.909032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8388d099-55d6-4589-a8f8-550b4d30a280 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:32.909742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8388d099-55d6-4589-a8f8-550b4d30a280 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:32.910891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8388d099-55d6-4589-a8f8-550b4d30a280 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:32.911630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8388d099-55d6-4589-a8f8-550b4d30a280 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:32.912322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8388d099-55d6-4589-a8f8-550b4d30a280 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:32.980581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8388d099-55d6-4589-a8f8-550b4d30a280 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:32.992992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8388d099-55d6-4589-a8f8-550b4d30a280 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.102739 Sep 13 20:24:32.993798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1212/2502] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:32 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:34.023466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ebe2266e-2ba4-4240-8640-1d49290482d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:34.024396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ebe2266e-2ba4-4240-8640-1d49290482d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:34.035635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ebe2266e-2ba4-4240-8640-1d49290482d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:34.036114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ebe2266e-2ba4-4240-8640-1d49290482d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:34.036543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ebe2266e-2ba4-4240-8640-1d49290482d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:34.037237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ebe2266e-2ba4-4240-8640-1d49290482d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:34.037685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ebe2266e-2ba4-4240-8640-1d49290482d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:34.038105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ebe2266e-2ba4-4240-8640-1d49290482d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:34.040694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=84 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:24:34.109319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ebe2266e-2ba4-4240-8640-1d49290482d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:34.119780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ebe2266e-2ba4-4240-8640-1d49290482d5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.102820 Sep 13 20:24:34.120349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1291/2503] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:34 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:35.146498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b4286d65-f463-4ef6-bf28-fce8e7dfc4c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:35.147559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b4286d65-f463-4ef6-bf28-fce8e7dfc4c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:35.158730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4286d65-f463-4ef6-bf28-fce8e7dfc4c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:35.159565 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4286d65-f463-4ef6-bf28-fce8e7dfc4c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:35.160296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4286d65-f463-4ef6-bf28-fce8e7dfc4c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:35.161420 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4286d65-f463-4ef6-bf28-fce8e7dfc4c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:35.162165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4286d65-f463-4ef6-bf28-fce8e7dfc4c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:35.162906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4286d65-f463-4ef6-bf28-fce8e7dfc4c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:35.233073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b4286d65-f463-4ef6-bf28-fce8e7dfc4c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:35.245825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b4286d65-f463-4ef6-bf28-fce8e7dfc4c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.105713 Sep 13 20:24:35.246691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1213/2504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:35 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:36.272155 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-35e52715-c61a-4eb7-bedd-c38e2b35e9a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:36.272781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-35e52715-c61a-4eb7-bedd-c38e2b35e9a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:36.279876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35e52715-c61a-4eb7-bedd-c38e2b35e9a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:36.280360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35e52715-c61a-4eb7-bedd-c38e2b35e9a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:36.280794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35e52715-c61a-4eb7-bedd-c38e2b35e9a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:36.281481 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35e52715-c61a-4eb7-bedd-c38e2b35e9a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:36.281931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35e52715-c61a-4eb7-bedd-c38e2b35e9a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:36.282347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35e52715-c61a-4eb7-bedd-c38e2b35e9a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:36.345939 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-35e52715-c61a-4eb7-bedd-c38e2b35e9a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:36.358861 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-35e52715-c61a-4eb7-bedd-c38e2b35e9a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090415 Sep 13 20:24:36.359652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1292/2505] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:36 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:37.387697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b010f6ae-154f-4baf-90cf-465935bbf7ab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:37.388716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b010f6ae-154f-4baf-90cf-465935bbf7ab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:37.397883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b010f6ae-154f-4baf-90cf-465935bbf7ab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:37.398390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b010f6ae-154f-4baf-90cf-465935bbf7ab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:37.398829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b010f6ae-154f-4baf-90cf-465935bbf7ab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:37.399514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b010f6ae-154f-4baf-90cf-465935bbf7ab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:37.399965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b010f6ae-154f-4baf-90cf-465935bbf7ab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:37.400389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b010f6ae-154f-4baf-90cf-465935bbf7ab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:37.517486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b010f6ae-154f-4baf-90cf-465935bbf7ab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:37.525947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b010f6ae-154f-4baf-90cf-465935bbf7ab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.144831 Sep 13 20:24:37.526540 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1214/2506] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:37 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:38.553177 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-219e4b0a-ac3f-4606-936b-af3beb692cb4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:38.554230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-219e4b0a-ac3f-4606-936b-af3beb692cb4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:38.565105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-219e4b0a-ac3f-4606-936b-af3beb692cb4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:38.565902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-219e4b0a-ac3f-4606-936b-af3beb692cb4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:38.566741 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-219e4b0a-ac3f-4606-936b-af3beb692cb4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:38.567433 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-219e4b0a-ac3f-4606-936b-af3beb692cb4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:38.567883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-219e4b0a-ac3f-4606-936b-af3beb692cb4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:38.568310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-219e4b0a-ac3f-4606-936b-af3beb692cb4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:38.630012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-219e4b0a-ac3f-4606-936b-af3beb692cb4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:38.639079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-219e4b0a-ac3f-4606-936b-af3beb692cb4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092478 Sep 13 20:24:38.639640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1293/2507] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:38 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:39.665547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1e490845-6046-45c0-8c7c-4623386cce2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:39.666523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1e490845-6046-45c0-8c7c-4623386cce2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:39.676590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e490845-6046-45c0-8c7c-4623386cce2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:39.677068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e490845-6046-45c0-8c7c-4623386cce2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:39.677504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e490845-6046-45c0-8c7c-4623386cce2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:39.678192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e490845-6046-45c0-8c7c-4623386cce2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:39.678669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e490845-6046-45c0-8c7c-4623386cce2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:39.679094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1e490845-6046-45c0-8c7c-4623386cce2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:39.752448 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1e490845-6046-45c0-8c7c-4623386cce2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:39.761571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1e490845-6046-45c0-8c7c-4623386cce2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.102017 Sep 13 20:24:39.762162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1215/2508] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:39 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:40.786547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7c2bf34b-91bb-47e8-8fb3-f00ad5833ec5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:40.787198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7c2bf34b-91bb-47e8-8fb3-f00ad5833ec5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:40.793772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7c2bf34b-91bb-47e8-8fb3-f00ad5833ec5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:40.794258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7c2bf34b-91bb-47e8-8fb3-f00ad5833ec5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:40.794712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7c2bf34b-91bb-47e8-8fb3-f00ad5833ec5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:40.795405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7c2bf34b-91bb-47e8-8fb3-f00ad5833ec5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:40.795849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7c2bf34b-91bb-47e8-8fb3-f00ad5833ec5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:40.796279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7c2bf34b-91bb-47e8-8fb3-f00ad5833ec5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:40.860945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7c2bf34b-91bb-47e8-8fb3-f00ad5833ec5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:40.869530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7c2bf34b-91bb-47e8-8fb3-f00ad5833ec5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087859 Sep 13 20:24:40.870079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1294/2509] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:40 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:41.896173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6a06ecc5-8f5b-4c1d-bdf5-57b7ddb31379 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:41.896864 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6a06ecc5-8f5b-4c1d-bdf5-57b7ddb31379 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:41.899733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=28 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:24:41.906357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a06ecc5-8f5b-4c1d-bdf5-57b7ddb31379 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:41.906999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a06ecc5-8f5b-4c1d-bdf5-57b7ddb31379 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:41.907541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a06ecc5-8f5b-4c1d-bdf5-57b7ddb31379 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:41.908390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a06ecc5-8f5b-4c1d-bdf5-57b7ddb31379 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:41.908947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a06ecc5-8f5b-4c1d-bdf5-57b7ddb31379 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:41.909449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a06ecc5-8f5b-4c1d-bdf5-57b7ddb31379 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:41.979550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6a06ecc5-8f5b-4c1d-bdf5-57b7ddb31379 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:41.992739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6a06ecc5-8f5b-4c1d-bdf5-57b7ddb31379 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.102609 Sep 13 20:24:41.993622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1216/2510] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:41 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:43.024894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-43bdb222-d988-4475-a88d-bdfb57731c91 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:43.027056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-43bdb222-d988-4475-a88d-bdfb57731c91 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:43.037182 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43bdb222-d988-4475-a88d-bdfb57731c91 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:43.037656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43bdb222-d988-4475-a88d-bdfb57731c91 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:43.038080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43bdb222-d988-4475-a88d-bdfb57731c91 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:43.038798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43bdb222-d988-4475-a88d-bdfb57731c91 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:43.039245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43bdb222-d988-4475-a88d-bdfb57731c91 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:43.039657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43bdb222-d988-4475-a88d-bdfb57731c91 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:43.103204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-43bdb222-d988-4475-a88d-bdfb57731c91 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:43.111652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-43bdb222-d988-4475-a88d-bdfb57731c91 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093400 Sep 13 20:24:43.112264 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1295/2511] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:43 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:44.138911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-507a16ef-4204-45ac-958f-aa777e40556d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:44.139889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-507a16ef-4204-45ac-958f-aa777e40556d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:44.148734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-507a16ef-4204-45ac-958f-aa777e40556d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:44.149221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-507a16ef-4204-45ac-958f-aa777e40556d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:44.149655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-507a16ef-4204-45ac-958f-aa777e40556d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:44.150357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-507a16ef-4204-45ac-958f-aa777e40556d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:44.150848 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-507a16ef-4204-45ac-958f-aa777e40556d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:44.151275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-507a16ef-4204-45ac-958f-aa777e40556d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:44.153883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=84 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:24:44.214961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-507a16ef-4204-45ac-958f-aa777e40556d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:44.223353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-507a16ef-4204-45ac-958f-aa777e40556d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091015 Sep 13 20:24:44.223936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1217/2512] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:44 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:45.250914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-80a58739-b4a6-44ae-be91-5cfc5e7180d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:45.251899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-80a58739-b4a6-44ae-be91-5cfc5e7180d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:45.254874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=28 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:24:45.260418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80a58739-b4a6-44ae-be91-5cfc5e7180d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:45.260899 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80a58739-b4a6-44ae-be91-5cfc5e7180d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:45.261338 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80a58739-b4a6-44ae-be91-5cfc5e7180d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:45.262010 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80a58739-b4a6-44ae-be91-5cfc5e7180d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:45.262496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80a58739-b4a6-44ae-be91-5cfc5e7180d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:45.262909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-80a58739-b4a6-44ae-be91-5cfc5e7180d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:45.324951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-80a58739-b4a6-44ae-be91-5cfc5e7180d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:45.333787 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-80a58739-b4a6-44ae-be91-5cfc5e7180d3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.089610 Sep 13 20:24:45.334344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1296/2513] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:45 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:46.360625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d916c4b6-a17e-4995-a774-da2e61a5453d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:46.361567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d916c4b6-a17e-4995-a774-da2e61a5453d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:46.369810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d916c4b6-a17e-4995-a774-da2e61a5453d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:46.370335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d916c4b6-a17e-4995-a774-da2e61a5453d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:46.370855 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d916c4b6-a17e-4995-a774-da2e61a5453d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:46.371599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d916c4b6-a17e-4995-a774-da2e61a5453d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:46.372092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d916c4b6-a17e-4995-a774-da2e61a5453d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:46.372553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d916c4b6-a17e-4995-a774-da2e61a5453d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:46.436370 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d916c4b6-a17e-4995-a774-da2e61a5453d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:46.444834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d916c4b6-a17e-4995-a774-da2e61a5453d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090663 Sep 13 20:24:46.445393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1218/2514] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:46 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:47.472419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bcf0a9c9-b063-416b-98cc-422bfd3eddc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:47.473330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bcf0a9c9-b063-416b-98cc-422bfd3eddc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:47.481831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcf0a9c9-b063-416b-98cc-422bfd3eddc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:47.482425 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcf0a9c9-b063-416b-98cc-422bfd3eddc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:47.483002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcf0a9c9-b063-416b-98cc-422bfd3eddc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:47.483890 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcf0a9c9-b063-416b-98cc-422bfd3eddc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:47.484421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcf0a9c9-b063-416b-98cc-422bfd3eddc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:47.484946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcf0a9c9-b063-416b-98cc-422bfd3eddc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:47.550209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bcf0a9c9-b063-416b-98cc-422bfd3eddc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:47.559033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bcf0a9c9-b063-416b-98cc-422bfd3eddc5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093225 Sep 13 20:24:47.559590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1297/2515] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:47 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:48.583922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f06f091c-4e26-477a-87ac-2738a52db9a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:48.584539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f06f091c-4e26-477a-87ac-2738a52db9a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:48.591921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f06f091c-4e26-477a-87ac-2738a52db9a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:48.592406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f06f091c-4e26-477a-87ac-2738a52db9a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:48.592876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f06f091c-4e26-477a-87ac-2738a52db9a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:48.593867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f06f091c-4e26-477a-87ac-2738a52db9a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:48.594319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f06f091c-4e26-477a-87ac-2738a52db9a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:48.594779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f06f091c-4e26-477a-87ac-2738a52db9a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:48.655556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f06f091c-4e26-477a-87ac-2738a52db9a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:48.663761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f06f091c-4e26-477a-87ac-2738a52db9a5 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.084198 Sep 13 20:24:48.664361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1219/2516] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:48 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:49.690990 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9771e6c2-b7ee-4041-999f-d3ebf50609b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:49.691905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9771e6c2-b7ee-4041-999f-d3ebf50609b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:49.699087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9771e6c2-b7ee-4041-999f-d3ebf50609b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:49.699562 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9771e6c2-b7ee-4041-999f-d3ebf50609b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:49.699982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9771e6c2-b7ee-4041-999f-d3ebf50609b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:49.700657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9771e6c2-b7ee-4041-999f-d3ebf50609b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:49.701095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9771e6c2-b7ee-4041-999f-d3ebf50609b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:49.701495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9771e6c2-b7ee-4041-999f-d3ebf50609b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:49.763287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9771e6c2-b7ee-4041-999f-d3ebf50609b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:49.772027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9771e6c2-b7ee-4041-999f-d3ebf50609b7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087668 Sep 13 20:24:49.772586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1298/2517] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:49 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:50.799582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f78ba6b9-351a-431a-8370-b5a9f19446b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:50.800515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f78ba6b9-351a-431a-8370-b5a9f19446b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:50.808272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f78ba6b9-351a-431a-8370-b5a9f19446b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:50.808804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f78ba6b9-351a-431a-8370-b5a9f19446b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:50.809283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f78ba6b9-351a-431a-8370-b5a9f19446b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:50.810040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f78ba6b9-351a-431a-8370-b5a9f19446b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:50.841889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f78ba6b9-351a-431a-8370-b5a9f19446b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:50.841889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f78ba6b9-351a-431a-8370-b5a9f19446b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:50.885729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f78ba6b9-351a-431a-8370-b5a9f19446b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:50.894306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f78ba6b9-351a-431a-8370-b5a9f19446b1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.101422 Sep 13 20:24:50.895080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1220/2518] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:50 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:51.922018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a478560f-5ff8-49fb-b128-9fbc5a28cc33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:51.923065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a478560f-5ff8-49fb-b128-9fbc5a28cc33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:51.933966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a478560f-5ff8-49fb-b128-9fbc5a28cc33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:51.934833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a478560f-5ff8-49fb-b128-9fbc5a28cc33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:51.935552 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a478560f-5ff8-49fb-b128-9fbc5a28cc33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:51.936676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a478560f-5ff8-49fb-b128-9fbc5a28cc33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:51.937428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a478560f-5ff8-49fb-b128-9fbc5a28cc33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:51.938129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a478560f-5ff8-49fb-b128-9fbc5a28cc33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:52.007922 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a478560f-5ff8-49fb-b128-9fbc5a28cc33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:52.018204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a478560f-5ff8-49fb-b128-9fbc5a28cc33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.102380 Sep 13 20:24:52.018894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1299/2519] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:51 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:53.048449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ce1bf37e-5b11-4529-a67b-2b109c68e2f3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:53.049450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ce1bf37e-5b11-4529-a67b-2b109c68e2f3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:53.057050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ce1bf37e-5b11-4529-a67b-2b109c68e2f3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:53.057539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ce1bf37e-5b11-4529-a67b-2b109c68e2f3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:53.057974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ce1bf37e-5b11-4529-a67b-2b109c68e2f3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:53.058699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ce1bf37e-5b11-4529-a67b-2b109c68e2f3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:53.059152 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ce1bf37e-5b11-4529-a67b-2b109c68e2f3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:53.059571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ce1bf37e-5b11-4529-a67b-2b109c68e2f3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:53.123625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ce1bf37e-5b11-4529-a67b-2b109c68e2f3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:53.136099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ce1bf37e-5b11-4529-a67b-2b109c68e2f3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094033 Sep 13 20:24:53.136857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1221/2520] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:53 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:54.165487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1a5c52fb-b118-4211-a491-bdff02b52287 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:54.166610 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1a5c52fb-b118-4211-a491-bdff02b52287 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:54.177456 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a5c52fb-b118-4211-a491-bdff02b52287 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:54.178250 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a5c52fb-b118-4211-a491-bdff02b52287 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:54.179003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a5c52fb-b118-4211-a491-bdff02b52287 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:54.180115 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a5c52fb-b118-4211-a491-bdff02b52287 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:54.180850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a5c52fb-b118-4211-a491-bdff02b52287 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:54.181539 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a5c52fb-b118-4211-a491-bdff02b52287 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:54.246238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1a5c52fb-b118-4211-a491-bdff02b52287 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:54.254687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1a5c52fb-b118-4211-a491-bdff02b52287 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095160 Sep 13 20:24:54.255251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1300/2521] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:54 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:55.282394 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-12c25c1e-ee60-498c-a921-442cb571884c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:55.283423 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-12c25c1e-ee60-498c-a921-442cb571884c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:55.294274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12c25c1e-ee60-498c-a921-442cb571884c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:55.295137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12c25c1e-ee60-498c-a921-442cb571884c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:55.295858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12c25c1e-ee60-498c-a921-442cb571884c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:55.296987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12c25c1e-ee60-498c-a921-442cb571884c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:55.297740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12c25c1e-ee60-498c-a921-442cb571884c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:55.298461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-12c25c1e-ee60-498c-a921-442cb571884c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:55.362222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-12c25c1e-ee60-498c-a921-442cb571884c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:55.370770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-12c25c1e-ee60-498c-a921-442cb571884c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094979 Sep 13 20:24:55.371333 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1222/2522] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:55 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:56.398205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9edf834d-898e-4688-8952-b2a538949fc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:56.399260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9edf834d-898e-4688-8952-b2a538949fc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:56.410345 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9edf834d-898e-4688-8952-b2a538949fc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:56.410892 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9edf834d-898e-4688-8952-b2a538949fc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:56.411330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9edf834d-898e-4688-8952-b2a538949fc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:56.412015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9edf834d-898e-4688-8952-b2a538949fc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:56.412462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9edf834d-898e-4688-8952-b2a538949fc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:56.412882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9edf834d-898e-4688-8952-b2a538949fc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:56.477360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9edf834d-898e-4688-8952-b2a538949fc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:56.486560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9edf834d-898e-4688-8952-b2a538949fc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094889 Sep 13 20:24:56.487135 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1301/2523] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:56 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:57.509392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6bf5dbc3-1339-4ee6-8d44-434c53b395ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:57.510277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6bf5dbc3-1339-4ee6-8d44-434c53b395ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:57.517484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6bf5dbc3-1339-4ee6-8d44-434c53b395ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:57.517978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6bf5dbc3-1339-4ee6-8d44-434c53b395ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:57.518432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6bf5dbc3-1339-4ee6-8d44-434c53b395ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:57.519147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6bf5dbc3-1339-4ee6-8d44-434c53b395ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:57.519593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6bf5dbc3-1339-4ee6-8d44-434c53b395ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:57.520018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6bf5dbc3-1339-4ee6-8d44-434c53b395ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:57.589574 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6bf5dbc3-1339-4ee6-8d44-434c53b395ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:57.597915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6bf5dbc3-1339-4ee6-8d44-434c53b395ae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092482 Sep 13 20:24:57.598544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1223/2524] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:57 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:58.670163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6fc62c36-c50c-4cd6-a173-077ef286f6e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:58.670807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6fc62c36-c50c-4cd6-a173-077ef286f6e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:58.677136 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6fc62c36-c50c-4cd6-a173-077ef286f6e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:58.677620 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6fc62c36-c50c-4cd6-a173-077ef286f6e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:58.678055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6fc62c36-c50c-4cd6-a173-077ef286f6e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:58.678777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6fc62c36-c50c-4cd6-a173-077ef286f6e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:58.679235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6fc62c36-c50c-4cd6-a173-077ef286f6e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:58.679647 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6fc62c36-c50c-4cd6-a173-077ef286f6e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:58.741742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6fc62c36-c50c-4cd6-a173-077ef286f6e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:58.750180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6fc62c36-c50c-4cd6-a173-077ef286f6e4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.132639 Sep 13 20:24:58.750773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1302/2525] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:58 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:24:59.777761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6a0e8504-b0a5-42b7-8211-a9265f2bd269 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.778862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6a0e8504-b0a5-42b7-8211-a9265f2bd269 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.789371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a0e8504-b0a5-42b7-8211-a9265f2bd269 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.790170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a0e8504-b0a5-42b7-8211-a9265f2bd269 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.790951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a0e8504-b0a5-42b7-8211-a9265f2bd269 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.792086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a0e8504-b0a5-42b7-8211-a9265f2bd269 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.792834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a0e8504-b0a5-42b7-8211-a9265f2bd269 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.793540 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6a0e8504-b0a5-42b7-8211-a9265f2bd269 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.863329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6a0e8504-b0a5-42b7-8211-a9265f2bd269 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:24:59.872105 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6a0e8504-b0a5-42b7-8211-a9265f2bd269 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.101522 Sep 13 20:24:59.872683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1224/2526] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:59 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:00.896105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f0259288-4b98-4c31-846a-8b392eb16636 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:00.896632 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f0259288-4b98-4c31-846a-8b392eb16636 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:00.903656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0259288-4b98-4c31-846a-8b392eb16636 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:00.904127 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0259288-4b98-4c31-846a-8b392eb16636 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:00.904546 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0259288-4b98-4c31-846a-8b392eb16636 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:00.905220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0259288-4b98-4c31-846a-8b392eb16636 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:00.905664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0259288-4b98-4c31-846a-8b392eb16636 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:00.906072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0259288-4b98-4c31-846a-8b392eb16636 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:00.969986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f0259288-4b98-4c31-846a-8b392eb16636 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:00.978463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f0259288-4b98-4c31-846a-8b392eb16636 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.086421 Sep 13 20:25:00.979072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1303/2527] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:00 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:02.004963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b943c010-0a40-4c0a-b359-834b3068bd2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:02.005962 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b943c010-0a40-4c0a-b359-834b3068bd2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:02.017453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b943c010-0a40-4c0a-b359-834b3068bd2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:02.018253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b943c010-0a40-4c0a-b359-834b3068bd2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:02.019028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b943c010-0a40-4c0a-b359-834b3068bd2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:02.020154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b943c010-0a40-4c0a-b359-834b3068bd2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:02.020876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b943c010-0a40-4c0a-b359-834b3068bd2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:02.021297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b943c010-0a40-4c0a-b359-834b3068bd2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:02.095425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b943c010-0a40-4c0a-b359-834b3068bd2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:02.107679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b943c010-0a40-4c0a-b359-834b3068bd2d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.108920 Sep 13 20:25:02.108418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1225/2528] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:03.135523 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-241bd583-d2e5-40a8-ae60-ce590247e516 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:03.136521 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-241bd583-d2e5-40a8-ae60-ce590247e516 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:03.147416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-241bd583-d2e5-40a8-ae60-ce590247e516 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:03.148222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-241bd583-d2e5-40a8-ae60-ce590247e516 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:03.148925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-241bd583-d2e5-40a8-ae60-ce590247e516 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:03.150045 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-241bd583-d2e5-40a8-ae60-ce590247e516 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:03.150836 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-241bd583-d2e5-40a8-ae60-ce590247e516 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:03.151536 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-241bd583-d2e5-40a8-ae60-ce590247e516 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:03.216438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-241bd583-d2e5-40a8-ae60-ce590247e516 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:03.224824 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-241bd583-d2e5-40a8-ae60-ce590247e516 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095931 Sep 13 20:25:03.225395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1304/2529] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:03 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:04.247857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9a4523e8-5806-4aaf-8a51-be96952ebaae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:04.248440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9a4523e8-5806-4aaf-8a51-be96952ebaae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:04.255406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a4523e8-5806-4aaf-8a51-be96952ebaae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:04.255891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a4523e8-5806-4aaf-8a51-be96952ebaae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:04.256326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a4523e8-5806-4aaf-8a51-be96952ebaae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:04.257013 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a4523e8-5806-4aaf-8a51-be96952ebaae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:04.257462 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a4523e8-5806-4aaf-8a51-be96952ebaae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:04.257882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9a4523e8-5806-4aaf-8a51-be96952ebaae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:04.328573 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9a4523e8-5806-4aaf-8a51-be96952ebaae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:04.337148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9a4523e8-5806-4aaf-8a51-be96952ebaae tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093308 Sep 13 20:25:04.337719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1226/2530] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:04 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:05.364332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2be92696-55a1-4f58-879b-7d0bd470b65d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:05.365296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2be92696-55a1-4f58-879b-7d0bd470b65d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:05.377158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2be92696-55a1-4f58-879b-7d0bd470b65d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:05.378042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2be92696-55a1-4f58-879b-7d0bd470b65d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:05.378842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2be92696-55a1-4f58-879b-7d0bd470b65d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:05.379947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2be92696-55a1-4f58-879b-7d0bd470b65d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:05.380744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2be92696-55a1-4f58-879b-7d0bd470b65d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:05.381380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2be92696-55a1-4f58-879b-7d0bd470b65d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:05.384106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=84 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:05.442738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2be92696-55a1-4f58-879b-7d0bd470b65d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:05.451512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2be92696-55a1-4f58-879b-7d0bd470b65d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093879 Sep 13 20:25:05.452074 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1305/2531] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:05 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:06.478674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5472f08c-44bb-495b-8f98-e580c985efab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:06.479675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5472f08c-44bb-495b-8f98-e580c985efab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:06.490662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5472f08c-44bb-495b-8f98-e580c985efab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:06.491146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5472f08c-44bb-495b-8f98-e580c985efab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:06.491583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5472f08c-44bb-495b-8f98-e580c985efab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:06.492302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5472f08c-44bb-495b-8f98-e580c985efab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:06.492752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5472f08c-44bb-495b-8f98-e580c985efab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:06.493174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5472f08c-44bb-495b-8f98-e580c985efab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:06.564806 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5472f08c-44bb-495b-8f98-e580c985efab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:06.574002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5472f08c-44bb-495b-8f98-e580c985efab tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.101947 Sep 13 20:25:06.574611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1227/2532] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:07.597494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6bd7f77b-7d10-4af0-a2ff-0fc33a31b896 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:07.598099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6bd7f77b-7d10-4af0-a2ff-0fc33a31b896 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:07.605178 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6bd7f77b-7d10-4af0-a2ff-0fc33a31b896 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:07.605659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6bd7f77b-7d10-4af0-a2ff-0fc33a31b896 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:07.606069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6bd7f77b-7d10-4af0-a2ff-0fc33a31b896 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:07.606789 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6bd7f77b-7d10-4af0-a2ff-0fc33a31b896 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:07.607245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6bd7f77b-7d10-4af0-a2ff-0fc33a31b896 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:07.607653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6bd7f77b-7d10-4af0-a2ff-0fc33a31b896 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:07.671947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6bd7f77b-7d10-4af0-a2ff-0fc33a31b896 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:07.680959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6bd7f77b-7d10-4af0-a2ff-0fc33a31b896 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087451 Sep 13 20:25:07.681535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1306/2533] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:08.708008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6ca15bfd-c2e6-46a4-ae95-44872e59315c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:08.709062 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6ca15bfd-c2e6-46a4-ae95-44872e59315c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:08.716633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6ca15bfd-c2e6-46a4-ae95-44872e59315c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:08.717136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6ca15bfd-c2e6-46a4-ae95-44872e59315c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:08.717617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6ca15bfd-c2e6-46a4-ae95-44872e59315c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:08.718332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6ca15bfd-c2e6-46a4-ae95-44872e59315c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:08.718837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6ca15bfd-c2e6-46a4-ae95-44872e59315c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:08.719279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6ca15bfd-c2e6-46a4-ae95-44872e59315c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:08.784900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6ca15bfd-c2e6-46a4-ae95-44872e59315c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:08.793828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6ca15bfd-c2e6-46a4-ae95-44872e59315c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092296 Sep 13 20:25:08.794396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1228/2534] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:09.817198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fa2704dc-5a5f-4569-9f63-4bc7b953d2b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:09.817800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fa2704dc-5a5f-4569-9f63-4bc7b953d2b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:09.825141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa2704dc-5a5f-4569-9f63-4bc7b953d2b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:09.825621 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa2704dc-5a5f-4569-9f63-4bc7b953d2b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:09.826046 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa2704dc-5a5f-4569-9f63-4bc7b953d2b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:09.826766 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa2704dc-5a5f-4569-9f63-4bc7b953d2b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:09.827207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa2704dc-5a5f-4569-9f63-4bc7b953d2b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:09.827615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fa2704dc-5a5f-4569-9f63-4bc7b953d2b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:09.891053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fa2704dc-5a5f-4569-9f63-4bc7b953d2b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:09.900053 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fa2704dc-5a5f-4569-9f63-4bc7b953d2b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.086816 Sep 13 20:25:09.900634 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1307/2535] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:10.927304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c64add1a-ec36-4850-a11d-8a9fa75afe95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:10.928297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c64add1a-ec36-4850-a11d-8a9fa75afe95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:10.935454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c64add1a-ec36-4850-a11d-8a9fa75afe95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:10.935928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c64add1a-ec36-4850-a11d-8a9fa75afe95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:10.936352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c64add1a-ec36-4850-a11d-8a9fa75afe95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:10.937028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c64add1a-ec36-4850-a11d-8a9fa75afe95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:10.937465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c64add1a-ec36-4850-a11d-8a9fa75afe95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:10.937874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c64add1a-ec36-4850-a11d-8a9fa75afe95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:11.004206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c64add1a-ec36-4850-a11d-8a9fa75afe95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:11.012547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c64add1a-ec36-4850-a11d-8a9fa75afe95 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091908 Sep 13 20:25:11.013097 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1229/2536] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:10 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:12.039386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-89aeda57-1c78-4826-ac71-7391f3d98e08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:12.040052 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-89aeda57-1c78-4826-ac71-7391f3d98e08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:12.047475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-89aeda57-1c78-4826-ac71-7391f3d98e08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:12.048000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-89aeda57-1c78-4826-ac71-7391f3d98e08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:12.048477 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-89aeda57-1c78-4826-ac71-7391f3d98e08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:12.049231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-89aeda57-1c78-4826-ac71-7391f3d98e08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:12.049724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-89aeda57-1c78-4826-ac71-7391f3d98e08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:12.050184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-89aeda57-1c78-4826-ac71-7391f3d98e08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:12.122448 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-89aeda57-1c78-4826-ac71-7391f3d98e08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:12.131313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-89aeda57-1c78-4826-ac71-7391f3d98e08 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098130 Sep 13 20:25:12.131881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1308/2537] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:12 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:13.155734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ae0909f5-ebc9-461a-a2b4-c46387fa1760 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:13.156367 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ae0909f5-ebc9-461a-a2b4-c46387fa1760 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:13.159140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=28 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:13.165550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae0909f5-ebc9-461a-a2b4-c46387fa1760 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:13.166107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae0909f5-ebc9-461a-a2b4-c46387fa1760 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:13.166647 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae0909f5-ebc9-461a-a2b4-c46387fa1760 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:13.167432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae0909f5-ebc9-461a-a2b4-c46387fa1760 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:13.167960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae0909f5-ebc9-461a-a2b4-c46387fa1760 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:13.168454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ae0909f5-ebc9-461a-a2b4-c46387fa1760 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:13.232678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ae0909f5-ebc9-461a-a2b4-c46387fa1760 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:13.241330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ae0909f5-ebc9-461a-a2b4-c46387fa1760 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090100 Sep 13 20:25:13.242000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1230/2538] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:14.269140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-82400de9-749d-4ced-98a4-e166f09e0494 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:14.271744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-82400de9-749d-4ced-98a4-e166f09e0494 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:14.281756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82400de9-749d-4ced-98a4-e166f09e0494 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:14.282644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82400de9-749d-4ced-98a4-e166f09e0494 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:14.283391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82400de9-749d-4ced-98a4-e166f09e0494 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:14.284518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82400de9-749d-4ced-98a4-e166f09e0494 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:14.285251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82400de9-749d-4ced-98a4-e166f09e0494 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:14.285944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-82400de9-749d-4ced-98a4-e166f09e0494 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:14.348174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-82400de9-749d-4ced-98a4-e166f09e0494 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:14.356520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-82400de9-749d-4ced-98a4-e166f09e0494 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094300 Sep 13 20:25:14.357302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1309/2539] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:14 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:15.383697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-111cc8b7-46cf-4548-98dd-1baf8c75158b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:15.384675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-111cc8b7-46cf-4548-98dd-1baf8c75158b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:15.395613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-111cc8b7-46cf-4548-98dd-1baf8c75158b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:15.396396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-111cc8b7-46cf-4548-98dd-1baf8c75158b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:15.397110 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-111cc8b7-46cf-4548-98dd-1baf8c75158b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:15.398231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-111cc8b7-46cf-4548-98dd-1baf8c75158b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:15.399014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-111cc8b7-46cf-4548-98dd-1baf8c75158b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:15.399709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-111cc8b7-46cf-4548-98dd-1baf8c75158b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:15.402397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=84 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:15.462765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-111cc8b7-46cf-4548-98dd-1baf8c75158b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:15.471287 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-111cc8b7-46cf-4548-98dd-1baf8c75158b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094097 Sep 13 20:25:15.471851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1231/2540] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:16.498146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-020f0aaa-bd6f-42dc-8ee3-e690e82b6158 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:16.499176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-020f0aaa-bd6f-42dc-8ee3-e690e82b6158 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:16.503374 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=28 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:16.511206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-020f0aaa-bd6f-42dc-8ee3-e690e82b6158 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:16.511673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-020f0aaa-bd6f-42dc-8ee3-e690e82b6158 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:16.512091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-020f0aaa-bd6f-42dc-8ee3-e690e82b6158 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:16.512765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-020f0aaa-bd6f-42dc-8ee3-e690e82b6158 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:16.513201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-020f0aaa-bd6f-42dc-8ee3-e690e82b6158 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:16.513609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-020f0aaa-bd6f-42dc-8ee3-e690e82b6158 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:16.586293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-020f0aaa-bd6f-42dc-8ee3-e690e82b6158 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:16.595132 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-020f0aaa-bd6f-42dc-8ee3-e690e82b6158 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.103420 Sep 13 20:25:16.595682 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1310/2541] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:16 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:17.621645 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4c325ba8-d00c-4804-8ea5-3a5097beb552 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:17.622401 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4c325ba8-d00c-4804-8ea5-3a5097beb552 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:17.630801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c325ba8-d00c-4804-8ea5-3a5097beb552 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:17.631521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c325ba8-d00c-4804-8ea5-3a5097beb552 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:17.632064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c325ba8-d00c-4804-8ea5-3a5097beb552 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:17.632927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c325ba8-d00c-4804-8ea5-3a5097beb552 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:17.633493 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c325ba8-d00c-4804-8ea5-3a5097beb552 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:17.634028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c325ba8-d00c-4804-8ea5-3a5097beb552 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:17.706076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4c325ba8-d00c-4804-8ea5-3a5097beb552 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:17.714811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4c325ba8-d00c-4804-8ea5-3a5097beb552 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098064 Sep 13 20:25:17.715377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1232/2542] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:17 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:18.749625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-35adc650-2eb1-401f-b4df-6110b7513092 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:18.750640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-35adc650-2eb1-401f-b4df-6110b7513092 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:18.760882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35adc650-2eb1-401f-b4df-6110b7513092 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:18.761351 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35adc650-2eb1-401f-b4df-6110b7513092 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:18.761770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35adc650-2eb1-401f-b4df-6110b7513092 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:18.762475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35adc650-2eb1-401f-b4df-6110b7513092 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:18.762921 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35adc650-2eb1-401f-b4df-6110b7513092 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:18.763325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35adc650-2eb1-401f-b4df-6110b7513092 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:18.831734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-35adc650-2eb1-401f-b4df-6110b7513092 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:18.840227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-35adc650-2eb1-401f-b4df-6110b7513092 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.097184 Sep 13 20:25:18.840790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1311/2543] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:19.867659 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6c65c78f-5c92-4576-9d00-0c9e9bc2a89b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:19.868852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6c65c78f-5c92-4576-9d00-0c9e9bc2a89b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:19.877165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c65c78f-5c92-4576-9d00-0c9e9bc2a89b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:19.877673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c65c78f-5c92-4576-9d00-0c9e9bc2a89b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:19.878106 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c65c78f-5c92-4576-9d00-0c9e9bc2a89b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:19.878836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c65c78f-5c92-4576-9d00-0c9e9bc2a89b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:19.879285 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c65c78f-5c92-4576-9d00-0c9e9bc2a89b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:19.879706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6c65c78f-5c92-4576-9d00-0c9e9bc2a89b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:19.943700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6c65c78f-5c92-4576-9d00-0c9e9bc2a89b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:19.953018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6c65c78f-5c92-4576-9d00-0c9e9bc2a89b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091942 Sep 13 20:25:19.953587 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1233/2544] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:19 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:20.980635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-20b3d023-75fa-404b-a815-7fb1c85ef948 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:20.981600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-20b3d023-75fa-404b-a815-7fb1c85ef948 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:20.992466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20b3d023-75fa-404b-a815-7fb1c85ef948 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:20.993262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20b3d023-75fa-404b-a815-7fb1c85ef948 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:20.993976 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20b3d023-75fa-404b-a815-7fb1c85ef948 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:20.995158 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20b3d023-75fa-404b-a815-7fb1c85ef948 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:20.995950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20b3d023-75fa-404b-a815-7fb1c85ef948 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:20.996654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-20b3d023-75fa-404b-a815-7fb1c85ef948 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:21.063923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-20b3d023-75fa-404b-a815-7fb1c85ef948 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:21.073219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-20b3d023-75fa-404b-a815-7fb1c85ef948 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099233 Sep 13 20:25:21.073787 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1312/2545] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:22.100520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c94092a0-ce25-4375-a1b5-c5fe54968e62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:22.101529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c94092a0-ce25-4375-a1b5-c5fe54968e62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:22.112536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c94092a0-ce25-4375-a1b5-c5fe54968e62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:22.113343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c94092a0-ce25-4375-a1b5-c5fe54968e62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:22.114068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c94092a0-ce25-4375-a1b5-c5fe54968e62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:22.115258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c94092a0-ce25-4375-a1b5-c5fe54968e62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:22.116009 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c94092a0-ce25-4375-a1b5-c5fe54968e62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:22.116723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c94092a0-ce25-4375-a1b5-c5fe54968e62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:22.180148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c94092a0-ce25-4375-a1b5-c5fe54968e62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:22.188638 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c94092a0-ce25-4375-a1b5-c5fe54968e62 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094890 Sep 13 20:25:22.189207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1234/2546] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:23.212185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d74074d0-4e19-40fd-8eea-df0d9c48642b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:23.212772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d74074d0-4e19-40fd-8eea-df0d9c48642b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:23.219659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d74074d0-4e19-40fd-8eea-df0d9c48642b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:23.220139 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d74074d0-4e19-40fd-8eea-df0d9c48642b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:23.220571 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d74074d0-4e19-40fd-8eea-df0d9c48642b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:23.221253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d74074d0-4e19-40fd-8eea-df0d9c48642b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:23.221701 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d74074d0-4e19-40fd-8eea-df0d9c48642b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:23.222115 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d74074d0-4e19-40fd-8eea-df0d9c48642b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:23.284737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d74074d0-4e19-40fd-8eea-df0d9c48642b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:23.293740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d74074d0-4e19-40fd-8eea-df0d9c48642b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085511 Sep 13 20:25:23.294309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1313/2547] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:24.320563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f5056d1c-ca82-47bb-b7ba-b33a6464b581 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:24.321506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f5056d1c-ca82-47bb-b7ba-b33a6464b581 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:24.333136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f5056d1c-ca82-47bb-b7ba-b33a6464b581 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:24.333901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f5056d1c-ca82-47bb-b7ba-b33a6464b581 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:24.334725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f5056d1c-ca82-47bb-b7ba-b33a6464b581 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:24.335892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f5056d1c-ca82-47bb-b7ba-b33a6464b581 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:24.336662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f5056d1c-ca82-47bb-b7ba-b33a6464b581 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:24.337531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f5056d1c-ca82-47bb-b7ba-b33a6464b581 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:24.412512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f5056d1c-ca82-47bb-b7ba-b33a6464b581 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:24.425103 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f5056d1c-ca82-47bb-b7ba-b33a6464b581 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.110948 Sep 13 20:25:24.425915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1235/2548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:24 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:25.448423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5355b290-7b42-4f8b-a5ac-156af3e6f3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:25.449027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5355b290-7b42-4f8b-a5ac-156af3e6f3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:25.455672 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5355b290-7b42-4f8b-a5ac-156af3e6f3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:25.456148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5355b290-7b42-4f8b-a5ac-156af3e6f3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:25.456575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5355b290-7b42-4f8b-a5ac-156af3e6f3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:25.457371 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5355b290-7b42-4f8b-a5ac-156af3e6f3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:25.457977 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5355b290-7b42-4f8b-a5ac-156af3e6f3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:25.458409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5355b290-7b42-4f8b-a5ac-156af3e6f3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:25.519259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5355b290-7b42-4f8b-a5ac-156af3e6f3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:25.527696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5355b290-7b42-4f8b-a5ac-156af3e6f3e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.083501 Sep 13 20:25:25.528285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1314/2549] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:26.551005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d8f424d1-7b39-4c85-9969-490e74dea013 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:26.551644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d8f424d1-7b39-4c85-9969-490e74dea013 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:26.558197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8f424d1-7b39-4c85-9969-490e74dea013 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:26.558724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8f424d1-7b39-4c85-9969-490e74dea013 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:26.559157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8f424d1-7b39-4c85-9969-490e74dea013 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:26.559844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8f424d1-7b39-4c85-9969-490e74dea013 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:26.560296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8f424d1-7b39-4c85-9969-490e74dea013 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:26.560721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8f424d1-7b39-4c85-9969-490e74dea013 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:26.641521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d8f424d1-7b39-4c85-9969-490e74dea013 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:26.650130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d8f424d1-7b39-4c85-9969-490e74dea013 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.103085 Sep 13 20:25:26.650899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1236/2550] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:26.877552 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-1163ae06-8ad3-49d1-b981-b511754c27ea req-8fa562d4-0fe3-4d64-a899-4a846785e8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0decb4-2f46-4f2f-860f-e8ca277f7080", "name": "network-vif-deleted", "tag": "2f770f4f-2f9f-4723-a236-5204e36adea7"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:25:26.888031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-1163ae06-8ad3-49d1-b981-b511754c27ea req-8fa562d4-0fe3-4d64-a899-4a846785e8da service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:26.888494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-1163ae06-8ad3-49d1-b981-b511754c27ea req-8fa562d4-0fe3-4d64-a899-4a846785e8da service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:26.888914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-1163ae06-8ad3-49d1-b981-b511754c27ea req-8fa562d4-0fe3-4d64-a899-4a846785e8da service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:26.902414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-1163ae06-8ad3-49d1-b981-b511754c27ea req-8fa562d4-0fe3-4d64-a899-4a846785e8da service nova] Creating event network-vif-deleted:2f770f4f-2f9f-4723-a236-5204e36adea7 for instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 on hv-cinder-85427 Sep 13 20:25:26.907686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-1163ae06-8ad3-49d1-b981-b511754c27ea req-8fa562d4-0fe3-4d64-a899-4a846785e8da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033854 Sep 13 20:25:26.908286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1315/2551] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:27.677353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-384e30a7-e72d-4919-8bbc-8c2b9a80be06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:27.678397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-384e30a7-e72d-4919-8bbc-8c2b9a80be06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:27.689332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-384e30a7-e72d-4919-8bbc-8c2b9a80be06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:27.690123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-384e30a7-e72d-4919-8bbc-8c2b9a80be06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:27.690891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-384e30a7-e72d-4919-8bbc-8c2b9a80be06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:27.692008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-384e30a7-e72d-4919-8bbc-8c2b9a80be06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:27.692748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-384e30a7-e72d-4919-8bbc-8c2b9a80be06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:27.693442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-384e30a7-e72d-4919-8bbc-8c2b9a80be06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:27.759084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-384e30a7-e72d-4919-8bbc-8c2b9a80be06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:27.767655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-384e30a7-e72d-4919-8bbc-8c2b9a80be06 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096854 Sep 13 20:25:27.768219 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1237/2552] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:27 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:28.792270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c347685a-c27c-4ccb-9d4e-6d2786ef67de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:28.792983 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c347685a-c27c-4ccb-9d4e-6d2786ef67de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:28.799832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c347685a-c27c-4ccb-9d4e-6d2786ef67de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:28.800326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c347685a-c27c-4ccb-9d4e-6d2786ef67de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:28.800770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c347685a-c27c-4ccb-9d4e-6d2786ef67de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:28.801478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c347685a-c27c-4ccb-9d4e-6d2786ef67de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:28.801944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c347685a-c27c-4ccb-9d4e-6d2786ef67de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:28.802408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c347685a-c27c-4ccb-9d4e-6d2786ef67de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:28.868744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c347685a-c27c-4ccb-9d4e-6d2786ef67de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:28.877372 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c347685a-c27c-4ccb-9d4e-6d2786ef67de tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090139 Sep 13 20:25:28.877951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1316/2553] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:29.905034 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-552284df-6410-45a7-953d-5c59b419f5ff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:29.905978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-552284df-6410-45a7-953d-5c59b419f5ff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:29.916470 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-552284df-6410-45a7-953d-5c59b419f5ff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:29.916961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-552284df-6410-45a7-953d-5c59b419f5ff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:29.917397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-552284df-6410-45a7-953d-5c59b419f5ff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:29.918081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-552284df-6410-45a7-953d-5c59b419f5ff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:29.918569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-552284df-6410-45a7-953d-5c59b419f5ff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:29.918992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-552284df-6410-45a7-953d-5c59b419f5ff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:29.992214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-552284df-6410-45a7-953d-5c59b419f5ff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:30.001213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-552284df-6410-45a7-953d-5c59b419f5ff tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.103339 Sep 13 20:25:30.001788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1238/2554] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:31.026856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-97569aac-3364-4654-b526-6b6645e68e75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:31.027468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-97569aac-3364-4654-b526-6b6645e68e75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:31.034163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97569aac-3364-4654-b526-6b6645e68e75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:31.034778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97569aac-3364-4654-b526-6b6645e68e75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:31.035204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97569aac-3364-4654-b526-6b6645e68e75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:31.035874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97569aac-3364-4654-b526-6b6645e68e75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:31.036347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97569aac-3364-4654-b526-6b6645e68e75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:31.036757 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-97569aac-3364-4654-b526-6b6645e68e75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:31.097840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-97569aac-3364-4654-b526-6b6645e68e75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:31.106654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-97569aac-3364-4654-b526-6b6645e68e75 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.083866 Sep 13 20:25:31.107208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1317/2555] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:31 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:32.133342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-23f91ef1-8b1f-4b91-989b-d9a757987f67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:32.134240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-23f91ef1-8b1f-4b91-989b-d9a757987f67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:32.141527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23f91ef1-8b1f-4b91-989b-d9a757987f67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:32.141995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23f91ef1-8b1f-4b91-989b-d9a757987f67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:32.142423 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23f91ef1-8b1f-4b91-989b-d9a757987f67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:32.143115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23f91ef1-8b1f-4b91-989b-d9a757987f67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:32.143552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23f91ef1-8b1f-4b91-989b-d9a757987f67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:32.143964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23f91ef1-8b1f-4b91-989b-d9a757987f67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:32.206682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-23f91ef1-8b1f-4b91-989b-d9a757987f67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:32.215022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-23f91ef1-8b1f-4b91-989b-d9a757987f67 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.088416 Sep 13 20:25:32.215590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1239/2556] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:32 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:33.238174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-034d05e4-db07-40d8-889a-c04514bbb7b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:33.238792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-034d05e4-db07-40d8-889a-c04514bbb7b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:33.245778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-034d05e4-db07-40d8-889a-c04514bbb7b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:33.246258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-034d05e4-db07-40d8-889a-c04514bbb7b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:33.246721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-034d05e4-db07-40d8-889a-c04514bbb7b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:33.247399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-034d05e4-db07-40d8-889a-c04514bbb7b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:33.247864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-034d05e4-db07-40d8-889a-c04514bbb7b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:33.248260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-034d05e4-db07-40d8-889a-c04514bbb7b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:33.316345 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-034d05e4-db07-40d8-889a-c04514bbb7b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:33.329154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-034d05e4-db07-40d8-889a-c04514bbb7b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094623 Sep 13 20:25:33.329812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1318/2557] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:33 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:34.358611 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0ef658d7-d65e-4e12-882f-ba6ab2d476ef tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:34.359616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0ef658d7-d65e-4e12-882f-ba6ab2d476ef tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:34.370624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0ef658d7-d65e-4e12-882f-ba6ab2d476ef tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:34.371431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0ef658d7-d65e-4e12-882f-ba6ab2d476ef tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:34.372155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0ef658d7-d65e-4e12-882f-ba6ab2d476ef tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:34.373289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0ef658d7-d65e-4e12-882f-ba6ab2d476ef tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:34.374038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0ef658d7-d65e-4e12-882f-ba6ab2d476ef tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:34.374793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0ef658d7-d65e-4e12-882f-ba6ab2d476ef tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:34.440466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0ef658d7-d65e-4e12-882f-ba6ab2d476ef tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:34.449251 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0ef658d7-d65e-4e12-882f-ba6ab2d476ef tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.097265 Sep 13 20:25:34.449803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1240/2558] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:34 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:35.477231 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2994bfd8-a6cd-4b3a-b087-03bed7ea6c33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:35.478220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2994bfd8-a6cd-4b3a-b087-03bed7ea6c33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:35.489241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2994bfd8-a6cd-4b3a-b087-03bed7ea6c33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:35.490097 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2994bfd8-a6cd-4b3a-b087-03bed7ea6c33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:35.490863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2994bfd8-a6cd-4b3a-b087-03bed7ea6c33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:35.491995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2994bfd8-a6cd-4b3a-b087-03bed7ea6c33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:35.492780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2994bfd8-a6cd-4b3a-b087-03bed7ea6c33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:35.493706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2994bfd8-a6cd-4b3a-b087-03bed7ea6c33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:35.496946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=80 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:35.558913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2994bfd8-a6cd-4b3a-b087-03bed7ea6c33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:35.569555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2994bfd8-a6cd-4b3a-b087-03bed7ea6c33 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098894 Sep 13 20:25:35.570359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1319/2559] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:35 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:36.598646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9b426e47-c03a-4517-9e00-947ee89d8dbe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:36.599252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9b426e47-c03a-4517-9e00-947ee89d8dbe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:36.606257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b426e47-c03a-4517-9e00-947ee89d8dbe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:36.606773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b426e47-c03a-4517-9e00-947ee89d8dbe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:36.607205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b426e47-c03a-4517-9e00-947ee89d8dbe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:36.607896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b426e47-c03a-4517-9e00-947ee89d8dbe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:36.608349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b426e47-c03a-4517-9e00-947ee89d8dbe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:36.608772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9b426e47-c03a-4517-9e00-947ee89d8dbe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:36.671527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9b426e47-c03a-4517-9e00-947ee89d8dbe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:36.679987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9b426e47-c03a-4517-9e00-947ee89d8dbe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085367 Sep 13 20:25:36.680564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1241/2560] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:36 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:37.707418 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3ddc5437-e5bd-4fb9-9889-43c7f83159a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:37.708471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3ddc5437-e5bd-4fb9-9889-43c7f83159a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:37.717596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ddc5437-e5bd-4fb9-9889-43c7f83159a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:37.718078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ddc5437-e5bd-4fb9-9889-43c7f83159a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:37.718549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ddc5437-e5bd-4fb9-9889-43c7f83159a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:37.719242 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ddc5437-e5bd-4fb9-9889-43c7f83159a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:37.719690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ddc5437-e5bd-4fb9-9889-43c7f83159a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:37.720174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3ddc5437-e5bd-4fb9-9889-43c7f83159a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:37.793095 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3ddc5437-e5bd-4fb9-9889-43c7f83159a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:37.801428 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3ddc5437-e5bd-4fb9-9889-43c7f83159a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.100718 Sep 13 20:25:37.802008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1320/2561] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:37 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:38.829254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e98cb968-56c4-49a0-bf01-0c4af78418f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:38.830094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e98cb968-56c4-49a0-bf01-0c4af78418f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:38.841119 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e98cb968-56c4-49a0-bf01-0c4af78418f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:38.841913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e98cb968-56c4-49a0-bf01-0c4af78418f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:38.842705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e98cb968-56c4-49a0-bf01-0c4af78418f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:38.843838 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e98cb968-56c4-49a0-bf01-0c4af78418f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:38.844584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e98cb968-56c4-49a0-bf01-0c4af78418f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:38.845289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e98cb968-56c4-49a0-bf01-0c4af78418f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:38.915935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e98cb968-56c4-49a0-bf01-0c4af78418f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:38.925194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e98cb968-56c4-49a0-bf01-0c4af78418f7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.103174 Sep 13 20:25:38.925779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1242/2562] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:38 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:39.953540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-33c74b3b-6092-4a44-870d-24bc7bc20723 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:39.954590 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-33c74b3b-6092-4a44-870d-24bc7bc20723 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:39.965241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c74b3b-6092-4a44-870d-24bc7bc20723 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:39.965722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c74b3b-6092-4a44-870d-24bc7bc20723 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:39.966148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c74b3b-6092-4a44-870d-24bc7bc20723 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:39.966869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c74b3b-6092-4a44-870d-24bc7bc20723 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:39.967318 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c74b3b-6092-4a44-870d-24bc7bc20723 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:39.967741 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-33c74b3b-6092-4a44-870d-24bc7bc20723 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:40.038277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-33c74b3b-6092-4a44-870d-24bc7bc20723 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:40.047049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-33c74b3b-6092-4a44-870d-24bc7bc20723 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.100327 Sep 13 20:25:40.047543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1321/2563] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:39 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:41.072726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-939889ec-1bd7-447f-951d-65db297cc7e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:41.073670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-939889ec-1bd7-447f-951d-65db297cc7e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:41.080682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-939889ec-1bd7-447f-951d-65db297cc7e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:41.081165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-939889ec-1bd7-447f-951d-65db297cc7e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:41.081594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-939889ec-1bd7-447f-951d-65db297cc7e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:41.082281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-939889ec-1bd7-447f-951d-65db297cc7e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:41.082771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-939889ec-1bd7-447f-951d-65db297cc7e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:41.083193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-939889ec-1bd7-447f-951d-65db297cc7e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:41.144304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-939889ec-1bd7-447f-951d-65db297cc7e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:41.152739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-939889ec-1bd7-447f-951d-65db297cc7e2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085612 Sep 13 20:25:41.153313 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1243/2564] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:41 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:42.180272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3734c5bd-cd19-4e4e-abbe-2ed18bc9babd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:42.181267 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3734c5bd-cd19-4e4e-abbe-2ed18bc9babd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:42.188911 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3734c5bd-cd19-4e4e-abbe-2ed18bc9babd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:42.189386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3734c5bd-cd19-4e4e-abbe-2ed18bc9babd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:42.189814 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3734c5bd-cd19-4e4e-abbe-2ed18bc9babd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:42.190537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3734c5bd-cd19-4e4e-abbe-2ed18bc9babd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:42.190981 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3734c5bd-cd19-4e4e-abbe-2ed18bc9babd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:42.191400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3734c5bd-cd19-4e4e-abbe-2ed18bc9babd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:42.252429 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3734c5bd-cd19-4e4e-abbe-2ed18bc9babd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:42.260961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3734c5bd-cd19-4e4e-abbe-2ed18bc9babd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087345 Sep 13 20:25:42.261556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1322/2565] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:42 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:43.288461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d3623f28-ce3e-412a-970a-7939515ef81b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:43.289397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d3623f28-ce3e-412a-970a-7939515ef81b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:43.292901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=28 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:43.298410 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3623f28-ce3e-412a-970a-7939515ef81b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:43.298878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3623f28-ce3e-412a-970a-7939515ef81b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:43.299321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3623f28-ce3e-412a-970a-7939515ef81b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:43.300001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3623f28-ce3e-412a-970a-7939515ef81b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:43.300463 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3623f28-ce3e-412a-970a-7939515ef81b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:43.300875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d3623f28-ce3e-412a-970a-7939515ef81b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:43.363386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d3623f28-ce3e-412a-970a-7939515ef81b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:43.372253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d3623f28-ce3e-412a-970a-7939515ef81b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090384 Sep 13 20:25:43.372827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1244/2566] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:43 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:44.399667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-35687335-d219-47c8-9db5-10c4f94c1279 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:44.400714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-35687335-d219-47c8-9db5-10c4f94c1279 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:44.411112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35687335-d219-47c8-9db5-10c4f94c1279 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:44.411954 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35687335-d219-47c8-9db5-10c4f94c1279 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:44.412660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35687335-d219-47c8-9db5-10c4f94c1279 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:44.413782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35687335-d219-47c8-9db5-10c4f94c1279 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:44.414569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35687335-d219-47c8-9db5-10c4f94c1279 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:44.415261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35687335-d219-47c8-9db5-10c4f94c1279 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:44.478305 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-35687335-d219-47c8-9db5-10c4f94c1279 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:44.486655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-35687335-d219-47c8-9db5-10c4f94c1279 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093555 Sep 13 20:25:44.487222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1323/2567] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:44 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:45.513593 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-498a6315-b420-4421-ab55-a6b0a846b610 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:45.514827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-498a6315-b420-4421-ab55-a6b0a846b610 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:45.525675 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-498a6315-b420-4421-ab55-a6b0a846b610 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:45.526527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-498a6315-b420-4421-ab55-a6b0a846b610 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:45.527210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-498a6315-b420-4421-ab55-a6b0a846b610 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:45.527915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-498a6315-b420-4421-ab55-a6b0a846b610 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:45.528369 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-498a6315-b420-4421-ab55-a6b0a846b610 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:45.528761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-498a6315-b420-4421-ab55-a6b0a846b610 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:45.531516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=84 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:45.596927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-498a6315-b420-4421-ab55-a6b0a846b610 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:45.605601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-498a6315-b420-4421-ab55-a6b0a846b610 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098502 Sep 13 20:25:45.606157 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1245/2568] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:45 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:46.632674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-48856b6a-8767-469e-855c-43c1e00639fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:46.633765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-48856b6a-8767-469e-855c-43c1e00639fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:46.637064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=28 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:46.642747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48856b6a-8767-469e-855c-43c1e00639fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:46.643224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48856b6a-8767-469e-855c-43c1e00639fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:46.643654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48856b6a-8767-469e-855c-43c1e00639fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:46.644453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48856b6a-8767-469e-855c-43c1e00639fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:46.644908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48856b6a-8767-469e-855c-43c1e00639fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:46.645326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-48856b6a-8767-469e-855c-43c1e00639fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:46.714694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-48856b6a-8767-469e-855c-43c1e00639fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:46.724014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-48856b6a-8767-469e-855c-43c1e00639fa tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098080 Sep 13 20:25:46.724615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1324/2569] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:46 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:47.752672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-887183cc-b93e-40f9-8e24-a6acecae2cc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:47.753724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-887183cc-b93e-40f9-8e24-a6acecae2cc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:47.764815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-887183cc-b93e-40f9-8e24-a6acecae2cc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:47.765623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-887183cc-b93e-40f9-8e24-a6acecae2cc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:47.766331 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-887183cc-b93e-40f9-8e24-a6acecae2cc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:47.767529 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-887183cc-b93e-40f9-8e24-a6acecae2cc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:47.768281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-887183cc-b93e-40f9-8e24-a6acecae2cc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:47.768991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-887183cc-b93e-40f9-8e24-a6acecae2cc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:47.842147 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-887183cc-b93e-40f9-8e24-a6acecae2cc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:47.850791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-887183cc-b93e-40f9-8e24-a6acecae2cc1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.104717 Sep 13 20:25:47.851362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1246/2570] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:47 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:48.877471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f7c29989-39a1-4cdb-a8d6-fb2768d006e1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:48.878461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f7c29989-39a1-4cdb-a8d6-fb2768d006e1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:48.888392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c29989-39a1-4cdb-a8d6-fb2768d006e1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:48.888868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c29989-39a1-4cdb-a8d6-fb2768d006e1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:48.889296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c29989-39a1-4cdb-a8d6-fb2768d006e1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:48.889980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c29989-39a1-4cdb-a8d6-fb2768d006e1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:48.890461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c29989-39a1-4cdb-a8d6-fb2768d006e1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:48.891194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f7c29989-39a1-4cdb-a8d6-fb2768d006e1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:48.954106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f7c29989-39a1-4cdb-a8d6-fb2768d006e1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:48.962807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f7c29989-39a1-4cdb-a8d6-fb2768d006e1 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092041 Sep 13 20:25:48.963408 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1325/2571] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:48 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:49.990003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-67ac2bf0-af12-44fb-ba46-8579c15f3ff8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:49.991064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-67ac2bf0-af12-44fb-ba46-8579c15f3ff8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:49.999612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67ac2bf0-af12-44fb-ba46-8579c15f3ff8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:50.000100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67ac2bf0-af12-44fb-ba46-8579c15f3ff8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:50.000530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67ac2bf0-af12-44fb-ba46-8579c15f3ff8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:50.001213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67ac2bf0-af12-44fb-ba46-8579c15f3ff8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:50.001660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67ac2bf0-af12-44fb-ba46-8579c15f3ff8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:50.002080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-67ac2bf0-af12-44fb-ba46-8579c15f3ff8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:50.062939 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-67ac2bf0-af12-44fb-ba46-8579c15f3ff8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:50.071338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-67ac2bf0-af12-44fb-ba46-8579c15f3ff8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087919 Sep 13 20:25:50.072234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1247/2572] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:49 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:51.099072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-442929fb-607b-4967-9c03-b1ae2dae2b66 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:51.100120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-442929fb-607b-4967-9c03-b1ae2dae2b66 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:51.109360 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-442929fb-607b-4967-9c03-b1ae2dae2b66 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:51.109842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-442929fb-607b-4967-9c03-b1ae2dae2b66 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:51.110269 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-442929fb-607b-4967-9c03-b1ae2dae2b66 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:51.110989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-442929fb-607b-4967-9c03-b1ae2dae2b66 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:51.111444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-442929fb-607b-4967-9c03-b1ae2dae2b66 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:51.111854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-442929fb-607b-4967-9c03-b1ae2dae2b66 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:51.175064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-442929fb-607b-4967-9c03-b1ae2dae2b66 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:51.183639 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-442929fb-607b-4967-9c03-b1ae2dae2b66 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091124 Sep 13 20:25:51.184206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1326/2573] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:51 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:52.211334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bafb6548-ab49-4206-be68-6b641d24f214 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:52.212303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bafb6548-ab49-4206-be68-6b641d24f214 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:52.220095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bafb6548-ab49-4206-be68-6b641d24f214 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:52.220590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bafb6548-ab49-4206-be68-6b641d24f214 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:52.221041 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bafb6548-ab49-4206-be68-6b641d24f214 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:52.221718 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bafb6548-ab49-4206-be68-6b641d24f214 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:52.222165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bafb6548-ab49-4206-be68-6b641d24f214 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:52.222626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bafb6548-ab49-4206-be68-6b641d24f214 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:52.291308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bafb6548-ab49-4206-be68-6b641d24f214 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:52.299863 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bafb6548-ab49-4206-be68-6b641d24f214 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095255 Sep 13 20:25:52.300447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1248/2574] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:52 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:53.327124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a5d09748-4f7c-40b6-9bd9-85be5c9ff000 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:53.327798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a5d09748-4f7c-40b6-9bd9-85be5c9ff000 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:53.334673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5d09748-4f7c-40b6-9bd9-85be5c9ff000 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:53.335149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5d09748-4f7c-40b6-9bd9-85be5c9ff000 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:53.335574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5d09748-4f7c-40b6-9bd9-85be5c9ff000 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:53.336260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5d09748-4f7c-40b6-9bd9-85be5c9ff000 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:53.336707 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5d09748-4f7c-40b6-9bd9-85be5c9ff000 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:53.337120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a5d09748-4f7c-40b6-9bd9-85be5c9ff000 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:53.400195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a5d09748-4f7c-40b6-9bd9-85be5c9ff000 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:53.408932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a5d09748-4f7c-40b6-9bd9-85be5c9ff000 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.088605 Sep 13 20:25:53.409872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1327/2575] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:53 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:54.436652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-77d981c0-b6cf-49a2-904f-4c65ebb5eb7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:54.437702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-77d981c0-b6cf-49a2-904f-4c65ebb5eb7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:54.449056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-77d981c0-b6cf-49a2-904f-4c65ebb5eb7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:54.449850 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-77d981c0-b6cf-49a2-904f-4c65ebb5eb7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:54.450628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-77d981c0-b6cf-49a2-904f-4c65ebb5eb7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:54.451769 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-77d981c0-b6cf-49a2-904f-4c65ebb5eb7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:54.452518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-77d981c0-b6cf-49a2-904f-4c65ebb5eb7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:54.453226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-77d981c0-b6cf-49a2-904f-4c65ebb5eb7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:54.524390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-77d981c0-b6cf-49a2-904f-4c65ebb5eb7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:54.537291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-77d981c0-b6cf-49a2-904f-4c65ebb5eb7d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.107025 Sep 13 20:25:54.538114 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1249/2576] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:54 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:55.564982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-34c8da1d-e033-40de-a234-79944fc80168 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:55.565964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-34c8da1d-e033-40de-a234-79944fc80168 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:55.576663 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-34c8da1d-e033-40de-a234-79944fc80168 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:55.577147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-34c8da1d-e033-40de-a234-79944fc80168 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:55.577584 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-34c8da1d-e033-40de-a234-79944fc80168 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:55.578274 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-34c8da1d-e033-40de-a234-79944fc80168 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:55.578758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-34c8da1d-e033-40de-a234-79944fc80168 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:55.579176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-34c8da1d-e033-40de-a234-79944fc80168 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:55.646400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-34c8da1d-e033-40de-a234-79944fc80168 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:55.655445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-34c8da1d-e033-40de-a234-79944fc80168 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.097693 Sep 13 20:25:55.656015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1328/2577] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:55 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:56.682600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fb398876-c50e-47dc-974a-e164a1dc26b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:56.683609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fb398876-c50e-47dc-974a-e164a1dc26b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:56.690938 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb398876-c50e-47dc-974a-e164a1dc26b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:56.691423 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb398876-c50e-47dc-974a-e164a1dc26b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:56.691860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb398876-c50e-47dc-974a-e164a1dc26b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:56.692549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb398876-c50e-47dc-974a-e164a1dc26b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:56.693032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb398876-c50e-47dc-974a-e164a1dc26b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:56.693454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fb398876-c50e-47dc-974a-e164a1dc26b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:56.758683 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fb398876-c50e-47dc-974a-e164a1dc26b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:56.767149 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fb398876-c50e-47dc-974a-e164a1dc26b8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091029 Sep 13 20:25:56.767720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1250/2578] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:56 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:57.789252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1fb76ae2-4c9b-4063-b087-77b71707f137 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:57.789846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1fb76ae2-4c9b-4063-b087-77b71707f137 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:57.792130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:25:57.792283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:25:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e (ip 10.222.0.52) !!! Sep 13 20:25:57.800341 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fb76ae2-4c9b-4063-b087-77b71707f137 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:57.800810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fb76ae2-4c9b-4063-b087-77b71707f137 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:57.801235 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fb76ae2-4c9b-4063-b087-77b71707f137 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:57.801914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fb76ae2-4c9b-4063-b087-77b71707f137 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:57.802726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fb76ae2-4c9b-4063-b087-77b71707f137 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:57.802822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1fb76ae2-4c9b-4063-b087-77b71707f137 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:57.865991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1fb76ae2-4c9b-4063-b087-77b71707f137 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:57.874458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1fb76ae2-4c9b-4063-b087-77b71707f137 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.089075 Sep 13 20:25:57.875026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1329/2579] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:57 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:58.902115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8a0ad5b7-6277-432b-b2f2-83bcec764980 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:58.903168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8a0ad5b7-6277-432b-b2f2-83bcec764980 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:58.909960 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a0ad5b7-6277-432b-b2f2-83bcec764980 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:58.910469 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a0ad5b7-6277-432b-b2f2-83bcec764980 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:58.910906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a0ad5b7-6277-432b-b2f2-83bcec764980 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:58.911594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a0ad5b7-6277-432b-b2f2-83bcec764980 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:58.912042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a0ad5b7-6277-432b-b2f2-83bcec764980 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:58.912471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a0ad5b7-6277-432b-b2f2-83bcec764980 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:58.984381 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8a0ad5b7-6277-432b-b2f2-83bcec764980 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:58.993050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8a0ad5b7-6277-432b-b2f2-83bcec764980 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098244 Sep 13 20:25:58.993627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1251/2580] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:58 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:00.020455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0e73661f-da3e-4318-9539-63e034cd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:00.021443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0e73661f-da3e-4318-9539-63e034cd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:00.032247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e73661f-da3e-4318-9539-63e034cd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:00.033026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e73661f-da3e-4318-9539-63e034cd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:00.033727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e73661f-da3e-4318-9539-63e034cd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:00.034882 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e73661f-da3e-4318-9539-63e034cd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:00.035622 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e73661f-da3e-4318-9539-63e034cd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:00.036314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e73661f-da3e-4318-9539-63e034cd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:00.101813 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0e73661f-da3e-4318-9539-63e034cd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:00.110087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0e73661f-da3e-4318-9539-63e034cd9715 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096115 Sep 13 20:26:00.110652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1330/2581] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:00 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:01.137571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c9d94f7e-e98a-4789-8a21-3d3f7b4042f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:01.138596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c9d94f7e-e98a-4789-8a21-3d3f7b4042f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:01.148877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9d94f7e-e98a-4789-8a21-3d3f7b4042f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:01.149666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9d94f7e-e98a-4789-8a21-3d3f7b4042f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:01.150409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9d94f7e-e98a-4789-8a21-3d3f7b4042f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:01.151538 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9d94f7e-e98a-4789-8a21-3d3f7b4042f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:01.152272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9d94f7e-e98a-4789-8a21-3d3f7b4042f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:01.152961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9d94f7e-e98a-4789-8a21-3d3f7b4042f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:01.218342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c9d94f7e-e98a-4789-8a21-3d3f7b4042f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:01.231244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c9d94f7e-e98a-4789-8a21-3d3f7b4042f9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.100170 Sep 13 20:26:01.232021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1252/2582] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:02.263646 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c3132901-d495-4878-a0f2-7a9cb92f9cba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:02.264394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c3132901-d495-4878-a0f2-7a9cb92f9cba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:02.272962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3132901-d495-4878-a0f2-7a9cb92f9cba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:02.273558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3132901-d495-4878-a0f2-7a9cb92f9cba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:02.274099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3132901-d495-4878-a0f2-7a9cb92f9cba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:02.274993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3132901-d495-4878-a0f2-7a9cb92f9cba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:02.275548 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3132901-d495-4878-a0f2-7a9cb92f9cba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:02.276067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c3132901-d495-4878-a0f2-7a9cb92f9cba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:02.341015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c3132901-d495-4878-a0f2-7a9cb92f9cba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:02.349712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c3132901-d495-4878-a0f2-7a9cb92f9cba tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092597 Sep 13 20:26:02.350281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1331/2583] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:02 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:03.377050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-58543cd1-ad11-42fc-9864-86b3106f5192 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:03.378040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-58543cd1-ad11-42fc-9864-86b3106f5192 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:03.389228 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58543cd1-ad11-42fc-9864-86b3106f5192 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:03.390066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58543cd1-ad11-42fc-9864-86b3106f5192 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:03.390856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58543cd1-ad11-42fc-9864-86b3106f5192 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:03.392029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58543cd1-ad11-42fc-9864-86b3106f5192 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:03.392763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58543cd1-ad11-42fc-9864-86b3106f5192 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:03.393453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58543cd1-ad11-42fc-9864-86b3106f5192 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:03.462183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-58543cd1-ad11-42fc-9864-86b3106f5192 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:03.470854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-58543cd1-ad11-42fc-9864-86b3106f5192 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.100577 Sep 13 20:26:03.471435 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1253/2584] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:03 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:04.497931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-73625eb9-2807-435d-9c7b-6cb12386b48a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:04.498992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-73625eb9-2807-435d-9c7b-6cb12386b48a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:04.509874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73625eb9-2807-435d-9c7b-6cb12386b48a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:04.510742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73625eb9-2807-435d-9c7b-6cb12386b48a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:04.511466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73625eb9-2807-435d-9c7b-6cb12386b48a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:04.512758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73625eb9-2807-435d-9c7b-6cb12386b48a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:04.513239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73625eb9-2807-435d-9c7b-6cb12386b48a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:04.513661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-73625eb9-2807-435d-9c7b-6cb12386b48a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:04.577979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-73625eb9-2807-435d-9c7b-6cb12386b48a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:04.586535 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-73625eb9-2807-435d-9c7b-6cb12386b48a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095175 Sep 13 20:26:04.587081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1332/2585] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:04 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:05.610129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-be116cda-d763-475c-91a7-4e24defb54be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:05.610845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-be116cda-d763-475c-91a7-4e24defb54be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:05.618334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be116cda-d763-475c-91a7-4e24defb54be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:05.618899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be116cda-d763-475c-91a7-4e24defb54be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:05.619382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be116cda-d763-475c-91a7-4e24defb54be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:05.620143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be116cda-d763-475c-91a7-4e24defb54be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:05.620641 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be116cda-d763-475c-91a7-4e24defb54be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:05.621111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-be116cda-d763-475c-91a7-4e24defb54be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:05.682968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-be116cda-d763-475c-91a7-4e24defb54be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:05.691598 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-be116cda-d763-475c-91a7-4e24defb54be tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085841 Sep 13 20:26:05.692136 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1254/2586] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:05 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:06.718986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9a968ef4-c30c-4a86-9376-93de1d39f5c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:06.719995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9a968ef4-c30c-4a86-9376-93de1d39f5c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:06.730894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a968ef4-c30c-4a86-9376-93de1d39f5c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:06.731743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a968ef4-c30c-4a86-9376-93de1d39f5c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:06.732166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a968ef4-c30c-4a86-9376-93de1d39f5c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:06.732843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a968ef4-c30c-4a86-9376-93de1d39f5c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:06.733286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a968ef4-c30c-4a86-9376-93de1d39f5c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:06.733695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9a968ef4-c30c-4a86-9376-93de1d39f5c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:06.736230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=84 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:26:06.801734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9a968ef4-c30c-4a86-9376-93de1d39f5c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:06.810474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9a968ef4-c30c-4a86-9376-93de1d39f5c8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098000 Sep 13 20:26:06.811042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1333/2587] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:07.837476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3b62acb1-7d13-4cf8-93f3-1584fc48aa6e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:07.838523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3b62acb1-7d13-4cf8-93f3-1584fc48aa6e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:07.846741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b62acb1-7d13-4cf8-93f3-1584fc48aa6e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:07.847226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b62acb1-7d13-4cf8-93f3-1584fc48aa6e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:07.847658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b62acb1-7d13-4cf8-93f3-1584fc48aa6e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:07.848377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b62acb1-7d13-4cf8-93f3-1584fc48aa6e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:07.848829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b62acb1-7d13-4cf8-93f3-1584fc48aa6e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:07.849259 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3b62acb1-7d13-4cf8-93f3-1584fc48aa6e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:07.910974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3b62acb1-7d13-4cf8-93f3-1584fc48aa6e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:07.919548 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3b62acb1-7d13-4cf8-93f3-1584fc48aa6e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.088741 Sep 13 20:26:07.920126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1255/2588] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:08.948054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ced40715-1193-48b5-a015-a477dcea1aca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:08.948889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ced40715-1193-48b5-a015-a477dcea1aca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:08.957011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ced40715-1193-48b5-a015-a477dcea1aca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:08.957495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ced40715-1193-48b5-a015-a477dcea1aca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:08.957926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ced40715-1193-48b5-a015-a477dcea1aca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:08.958653 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ced40715-1193-48b5-a015-a477dcea1aca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:08.959102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ced40715-1193-48b5-a015-a477dcea1aca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:08.959522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ced40715-1193-48b5-a015-a477dcea1aca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:09.031486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ced40715-1193-48b5-a015-a477dcea1aca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:09.039781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ced40715-1193-48b5-a015-a477dcea1aca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098779 Sep 13 20:26:09.040349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1334/2589] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:10.069150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c9768fad-1b4d-4b1f-90a3-4eafed587959 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:10.070150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c9768fad-1b4d-4b1f-90a3-4eafed587959 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:10.081777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9768fad-1b4d-4b1f-90a3-4eafed587959 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:10.082646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9768fad-1b4d-4b1f-90a3-4eafed587959 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:10.083356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9768fad-1b4d-4b1f-90a3-4eafed587959 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:10.084468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9768fad-1b4d-4b1f-90a3-4eafed587959 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:10.085211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9768fad-1b4d-4b1f-90a3-4eafed587959 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:10.086011 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c9768fad-1b4d-4b1f-90a3-4eafed587959 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:10.149335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c9768fad-1b4d-4b1f-90a3-4eafed587959 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:10.158029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c9768fad-1b4d-4b1f-90a3-4eafed587959 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095479 Sep 13 20:26:10.158626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1256/2590] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:10 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:26:11.182531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1a61d329-54a3-433f-890c-a6f6bb321104 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:11.183111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1a61d329-54a3-433f-890c-a6f6bb321104 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:11.192577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a61d329-54a3-433f-890c-a6f6bb321104 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:11.193060 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a61d329-54a3-433f-890c-a6f6bb321104 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:11.193485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a61d329-54a3-433f-890c-a6f6bb321104 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:11.194200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a61d329-54a3-433f-890c-a6f6bb321104 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:11.194678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a61d329-54a3-433f-890c-a6f6bb321104 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:11.195354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1a61d329-54a3-433f-890c-a6f6bb321104 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:11.262065 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1a61d329-54a3-433f-890c-a6f6bb321104 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:11.270765 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1a61d329-54a3-433f-890c-a6f6bb321104 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093180 Sep 13 20:26:11.271338 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1335/2591] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:11 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:12.297930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e150449f-df88-40ab-ad8c-073a6fee95b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:12.299055 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e150449f-df88-40ab-ad8c-073a6fee95b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:12.309930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e150449f-df88-40ab-ad8c-073a6fee95b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:12.310809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e150449f-df88-40ab-ad8c-073a6fee95b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:12.311464 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e150449f-df88-40ab-ad8c-073a6fee95b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:12.312156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e150449f-df88-40ab-ad8c-073a6fee95b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:12.312602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e150449f-df88-40ab-ad8c-073a6fee95b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:12.313022 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e150449f-df88-40ab-ad8c-073a6fee95b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:12.387284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e150449f-df88-40ab-ad8c-073a6fee95b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:12.395933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e150449f-df88-40ab-ad8c-073a6fee95b0 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.104541 Sep 13 20:26:12.396499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1257/2592] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:12 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:13.423118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a53989b3-2d73-409a-8275-e00fc93e421c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:13.423844 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a53989b3-2d73-409a-8275-e00fc93e421c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:13.431799 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a53989b3-2d73-409a-8275-e00fc93e421c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:13.432399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a53989b3-2d73-409a-8275-e00fc93e421c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:13.432934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a53989b3-2d73-409a-8275-e00fc93e421c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:13.433799 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a53989b3-2d73-409a-8275-e00fc93e421c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:13.434357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a53989b3-2d73-409a-8275-e00fc93e421c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:13.434948 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a53989b3-2d73-409a-8275-e00fc93e421c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:13.509142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a53989b3-2d73-409a-8275-e00fc93e421c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:13.518084 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a53989b3-2d73-409a-8275-e00fc93e421c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.101610 Sep 13 20:26:13.518706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1336/2593] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:13 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:14.545530 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9d84cbd0-ab73-4eec-83e5-f437719900c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:14.546731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9d84cbd0-ab73-4eec-83e5-f437719900c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:14.550594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=28 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:26:14.561539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d84cbd0-ab73-4eec-83e5-f437719900c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:14.562415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d84cbd0-ab73-4eec-83e5-f437719900c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:14.562829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d84cbd0-ab73-4eec-83e5-f437719900c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:14.563513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d84cbd0-ab73-4eec-83e5-f437719900c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:14.563955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d84cbd0-ab73-4eec-83e5-f437719900c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:14.564362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9d84cbd0-ab73-4eec-83e5-f437719900c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:14.628362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9d84cbd0-ab73-4eec-83e5-f437719900c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:14.636821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9d84cbd0-ab73-4eec-83e5-f437719900c3 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.097724 Sep 13 20:26:14.637361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1258/2594] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:14 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:15.663927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dfabec78-92e5-4daa-94af-b6c41e163705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:15.664896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dfabec78-92e5-4daa-94af-b6c41e163705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:15.674603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfabec78-92e5-4daa-94af-b6c41e163705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:15.675085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfabec78-92e5-4daa-94af-b6c41e163705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:15.675517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfabec78-92e5-4daa-94af-b6c41e163705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:15.676193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfabec78-92e5-4daa-94af-b6c41e163705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:15.676637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfabec78-92e5-4daa-94af-b6c41e163705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:15.677055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dfabec78-92e5-4daa-94af-b6c41e163705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:15.739332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dfabec78-92e5-4daa-94af-b6c41e163705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:15.747671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dfabec78-92e5-4daa-94af-b6c41e163705 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090204 Sep 13 20:26:15.748233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1337/2595] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:15 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:16.774468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-06af2557-b66b-470e-925c-eb8ac3961272 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:16.775429 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-06af2557-b66b-470e-925c-eb8ac3961272 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:16.784381 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06af2557-b66b-470e-925c-eb8ac3961272 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:16.784854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06af2557-b66b-470e-925c-eb8ac3961272 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:16.785282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06af2557-b66b-470e-925c-eb8ac3961272 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:16.785963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06af2557-b66b-470e-925c-eb8ac3961272 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:16.786414 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06af2557-b66b-470e-925c-eb8ac3961272 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:16.786842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06af2557-b66b-470e-925c-eb8ac3961272 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:16.789388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=84 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:26:16.853785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-06af2557-b66b-470e-925c-eb8ac3961272 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:16.862180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-06af2557-b66b-470e-925c-eb8ac3961272 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094153 Sep 13 20:26:16.862771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1259/2596] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:16 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:17.889902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-74d6ffc9-ff7b-41b1-955d-fcb4cc33f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:17.890924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-74d6ffc9-ff7b-41b1-955d-fcb4cc33f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:17.893482 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=28 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:26:17.899907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74d6ffc9-ff7b-41b1-955d-fcb4cc33f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:17.900385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74d6ffc9-ff7b-41b1-955d-fcb4cc33f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:17.900808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74d6ffc9-ff7b-41b1-955d-fcb4cc33f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:17.901484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74d6ffc9-ff7b-41b1-955d-fcb4cc33f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:17.901929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74d6ffc9-ff7b-41b1-955d-fcb4cc33f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:17.902339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-74d6ffc9-ff7b-41b1-955d-fcb4cc33f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:17.969950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-74d6ffc9-ff7b-41b1-955d-fcb4cc33f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:17.978511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-74d6ffc9-ff7b-41b1-955d-fcb4cc33f433 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095686 Sep 13 20:26:17.979083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1338/2597] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:17 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:19.007918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-53175610-9992-4783-9b29-7a4f754048a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:19.008891 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-53175610-9992-4783-9b29-7a4f754048a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:19.019773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-53175610-9992-4783-9b29-7a4f754048a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:19.020551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-53175610-9992-4783-9b29-7a4f754048a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:19.024062 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-53175610-9992-4783-9b29-7a4f754048a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:19.025271 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-53175610-9992-4783-9b29-7a4f754048a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:19.026029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-53175610-9992-4783-9b29-7a4f754048a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:19.026786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-53175610-9992-4783-9b29-7a4f754048a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:19.091822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-53175610-9992-4783-9b29-7a4f754048a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:19.100396 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-53175610-9992-4783-9b29-7a4f754048a7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099212 Sep 13 20:26:19.100955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1260/2598] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:18 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:20.126774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6cb98dbb-9fdc-425b-a44c-ad6e5230732a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:20.127763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6cb98dbb-9fdc-425b-a44c-ad6e5230732a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:20.138703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cb98dbb-9fdc-425b-a44c-ad6e5230732a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:20.139486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cb98dbb-9fdc-425b-a44c-ad6e5230732a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:20.140188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cb98dbb-9fdc-425b-a44c-ad6e5230732a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:20.141407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cb98dbb-9fdc-425b-a44c-ad6e5230732a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:20.141852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cb98dbb-9fdc-425b-a44c-ad6e5230732a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:20.142259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cb98dbb-9fdc-425b-a44c-ad6e5230732a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:20.203452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6cb98dbb-9fdc-425b-a44c-ad6e5230732a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:20.212023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6cb98dbb-9fdc-425b-a44c-ad6e5230732a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091758 Sep 13 20:26:20.212595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1339/2599] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:20 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:21.239713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3a8932a1-f313-4b39-9dbf-57bd9e9627dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:21.240659 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3a8932a1-f313-4b39-9dbf-57bd9e9627dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:21.251409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a8932a1-f313-4b39-9dbf-57bd9e9627dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:21.251883 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a8932a1-f313-4b39-9dbf-57bd9e9627dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:21.252310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a8932a1-f313-4b39-9dbf-57bd9e9627dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:21.252966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a8932a1-f313-4b39-9dbf-57bd9e9627dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:21.253424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a8932a1-f313-4b39-9dbf-57bd9e9627dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:21.253836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3a8932a1-f313-4b39-9dbf-57bd9e9627dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:21.318173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3a8932a1-f313-4b39-9dbf-57bd9e9627dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:21.327076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3a8932a1-f313-4b39-9dbf-57bd9e9627dc tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093888 Sep 13 20:26:21.327631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1261/2600] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:21 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:22.353558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cd0a545c-0728-4ca3-9d15-57875bf900f2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:22.354608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cd0a545c-0728-4ca3-9d15-57875bf900f2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:22.363580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd0a545c-0728-4ca3-9d15-57875bf900f2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:22.364059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd0a545c-0728-4ca3-9d15-57875bf900f2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:22.364490 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd0a545c-0728-4ca3-9d15-57875bf900f2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:22.365180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd0a545c-0728-4ca3-9d15-57875bf900f2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:22.365629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd0a545c-0728-4ca3-9d15-57875bf900f2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:22.366049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cd0a545c-0728-4ca3-9d15-57875bf900f2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:22.430759 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cd0a545c-0728-4ca3-9d15-57875bf900f2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:22.439337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cd0a545c-0728-4ca3-9d15-57875bf900f2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092363 Sep 13 20:26:22.439918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1340/2601] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:22 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:23.467386 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-eb9b068b-2200-488f-9636-04c378c31396 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:23.468344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-eb9b068b-2200-488f-9636-04c378c31396 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:23.476337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb9b068b-2200-488f-9636-04c378c31396 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:23.476847 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb9b068b-2200-488f-9636-04c378c31396 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:23.477362 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb9b068b-2200-488f-9636-04c378c31396 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:23.478122 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb9b068b-2200-488f-9636-04c378c31396 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:23.478672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb9b068b-2200-488f-9636-04c378c31396 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:23.479148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-eb9b068b-2200-488f-9636-04c378c31396 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:23.805412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eb9b068b-2200-488f-9636-04c378c31396 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:23.814526 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-eb9b068b-2200-488f-9636-04c378c31396 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.353726 Sep 13 20:26:23.815073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1262/2602] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:23 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:24.845889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3d8d181d-e23f-439b-a9f0-d641bba9298d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:24.846558 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3d8d181d-e23f-439b-a9f0-d641bba9298d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:24.855845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d8d181d-e23f-439b-a9f0-d641bba9298d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:24.857113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d8d181d-e23f-439b-a9f0-d641bba9298d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:24.857677 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d8d181d-e23f-439b-a9f0-d641bba9298d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:24.858583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d8d181d-e23f-439b-a9f0-d641bba9298d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:24.859157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d8d181d-e23f-439b-a9f0-d641bba9298d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:24.859676 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d8d181d-e23f-439b-a9f0-d641bba9298d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:24.926190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3d8d181d-e23f-439b-a9f0-d641bba9298d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:24.934889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3d8d181d-e23f-439b-a9f0-d641bba9298d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.095641 Sep 13 20:26:24.935468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1341/2603] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:24 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:25.961957 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8c8a7cad-a00d-41e4-8c53-e98a8f2ced1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:25.963052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8c8a7cad-a00d-41e4-8c53-e98a8f2ced1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:25.974138 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c8a7cad-a00d-41e4-8c53-e98a8f2ced1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:25.974995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c8a7cad-a00d-41e4-8c53-e98a8f2ced1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:25.975727 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c8a7cad-a00d-41e4-8c53-e98a8f2ced1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:25.976854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c8a7cad-a00d-41e4-8c53-e98a8f2ced1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:25.977662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c8a7cad-a00d-41e4-8c53-e98a8f2ced1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:25.978398 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8c8a7cad-a00d-41e4-8c53-e98a8f2ced1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:26.043197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8c8a7cad-a00d-41e4-8c53-e98a8f2ced1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:26.051726 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8c8a7cad-a00d-41e4-8c53-e98a8f2ced1d tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096281 Sep 13 20:26:26.052294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1263/2604] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:25 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:27.078510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-902c06bf-39ef-4526-b85c-92b2388154dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:27.079511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-902c06bf-39ef-4526-b85c-92b2388154dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:27.092605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-902c06bf-39ef-4526-b85c-92b2388154dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:27.093394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-902c06bf-39ef-4526-b85c-92b2388154dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:27.094070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-902c06bf-39ef-4526-b85c-92b2388154dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:27.095209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-902c06bf-39ef-4526-b85c-92b2388154dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:27.095686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-902c06bf-39ef-4526-b85c-92b2388154dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:27.096106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-902c06bf-39ef-4526-b85c-92b2388154dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:27.158755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-902c06bf-39ef-4526-b85c-92b2388154dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:27.169850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-902c06bf-39ef-4526-b85c-92b2388154dd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098299 Sep 13 20:26:27.170412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1342/2605] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:27 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:28.197881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-21809377-cb68-4067-b247-e84227c94c97 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:28.198822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-21809377-cb68-4067-b247-e84227c94c97 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:28.207881 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21809377-cb68-4067-b247-e84227c94c97 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:28.208354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21809377-cb68-4067-b247-e84227c94c97 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:28.208785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21809377-cb68-4067-b247-e84227c94c97 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:28.209461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21809377-cb68-4067-b247-e84227c94c97 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:28.209898 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21809377-cb68-4067-b247-e84227c94c97 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:28.210310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-21809377-cb68-4067-b247-e84227c94c97 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:28.271328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-21809377-cb68-4067-b247-e84227c94c97 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:28.279889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-21809377-cb68-4067-b247-e84227c94c97 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.088984 Sep 13 20:26:28.280449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1264/2606] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:28 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:29.307293 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9095b022-c60a-4b1d-b550-9d3d40ae6be2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:29.308300 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9095b022-c60a-4b1d-b550-9d3d40ae6be2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:29.317354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9095b022-c60a-4b1d-b550-9d3d40ae6be2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:29.317863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9095b022-c60a-4b1d-b550-9d3d40ae6be2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:29.318318 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9095b022-c60a-4b1d-b550-9d3d40ae6be2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:29.319012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9095b022-c60a-4b1d-b550-9d3d40ae6be2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:29.319471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9095b022-c60a-4b1d-b550-9d3d40ae6be2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:29.319896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9095b022-c60a-4b1d-b550-9d3d40ae6be2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:29.382729 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9095b022-c60a-4b1d-b550-9d3d40ae6be2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:29.391130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9095b022-c60a-4b1d-b550-9d3d40ae6be2 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090473 Sep 13 20:26:29.391693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1343/2607] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:29 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:30.418735 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-33f08842-d885-4a22-8628-f8128e4db57f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:30.419740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-33f08842-d885-4a22-8628-f8128e4db57f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:30.427679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33f08842-d885-4a22-8628-f8128e4db57f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:30.428164 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33f08842-d885-4a22-8628-f8128e4db57f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:30.428613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33f08842-d885-4a22-8628-f8128e4db57f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:30.429298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33f08842-d885-4a22-8628-f8128e4db57f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:30.429745 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33f08842-d885-4a22-8628-f8128e4db57f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:30.430171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-33f08842-d885-4a22-8628-f8128e4db57f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:30.501617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-33f08842-d885-4a22-8628-f8128e4db57f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:30.510048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-33f08842-d885-4a22-8628-f8128e4db57f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.098227 Sep 13 20:26:30.510647 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1265/2608] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:30 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:31.536313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9ab838fe-5e83-4197-8bb2-663ef365538c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:31.536912 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9ab838fe-5e83-4197-8bb2-663ef365538c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:31.544654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9ab838fe-5e83-4197-8bb2-663ef365538c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:31.545154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9ab838fe-5e83-4197-8bb2-663ef365538c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:31.545597 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9ab838fe-5e83-4197-8bb2-663ef365538c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:31.546581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9ab838fe-5e83-4197-8bb2-663ef365538c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:31.547044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9ab838fe-5e83-4197-8bb2-663ef365538c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:31.547473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9ab838fe-5e83-4197-8bb2-663ef365538c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:31.614347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9ab838fe-5e83-4197-8bb2-663ef365538c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:31.622779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9ab838fe-5e83-4197-8bb2-663ef365538c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092124 Sep 13 20:26:31.623354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1344/2609] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:31 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:32.647791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0823ab0f-b6e4-4cc1-b36e-61c649fe0954 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:32.648497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0823ab0f-b6e4-4cc1-b36e-61c649fe0954 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:32.656067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0823ab0f-b6e4-4cc1-b36e-61c649fe0954 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:32.656600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0823ab0f-b6e4-4cc1-b36e-61c649fe0954 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:32.657083 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0823ab0f-b6e4-4cc1-b36e-61c649fe0954 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:32.657843 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0823ab0f-b6e4-4cc1-b36e-61c649fe0954 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:32.658342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0823ab0f-b6e4-4cc1-b36e-61c649fe0954 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:32.658845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0823ab0f-b6e4-4cc1-b36e-61c649fe0954 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:32.723590 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0823ab0f-b6e4-4cc1-b36e-61c649fe0954 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:32.732558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0823ab0f-b6e4-4cc1-b36e-61c649fe0954 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.089833 Sep 13 20:26:32.733131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1266/2610] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:32 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:33.758752 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4124ce43-ccc5-407a-b8d5-4ddce816a86a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:33.759505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4124ce43-ccc5-407a-b8d5-4ddce816a86a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:33.767792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4124ce43-ccc5-407a-b8d5-4ddce816a86a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:33.768379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4124ce43-ccc5-407a-b8d5-4ddce816a86a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:33.768916 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4124ce43-ccc5-407a-b8d5-4ddce816a86a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:33.769764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4124ce43-ccc5-407a-b8d5-4ddce816a86a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:33.770314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4124ce43-ccc5-407a-b8d5-4ddce816a86a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:33.770885 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4124ce43-ccc5-407a-b8d5-4ddce816a86a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:33.835120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4124ce43-ccc5-407a-b8d5-4ddce816a86a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:33.843716 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4124ce43-ccc5-407a-b8d5-4ddce816a86a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090317 Sep 13 20:26:33.844285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1345/2611] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:33 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:34.868852 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-39de522f-2202-491e-90c3-054c88498a4a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:34.869412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-39de522f-2202-491e-90c3-054c88498a4a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:34.876289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39de522f-2202-491e-90c3-054c88498a4a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:34.876784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39de522f-2202-491e-90c3-054c88498a4a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:34.877188 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39de522f-2202-491e-90c3-054c88498a4a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:34.877864 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39de522f-2202-491e-90c3-054c88498a4a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:34.878309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39de522f-2202-491e-90c3-054c88498a4a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:34.878770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-39de522f-2202-491e-90c3-054c88498a4a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:34.946023 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-39de522f-2202-491e-90c3-054c88498a4a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:34.954724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-39de522f-2202-491e-90c3-054c88498a4a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090302 Sep 13 20:26:34.955280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1267/2612] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:34 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:35.981710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d4d12f38-2187-4687-afbe-8ca489c5774f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:35.982718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d4d12f38-2187-4687-afbe-8ca489c5774f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:35.993820 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4d12f38-2187-4687-afbe-8ca489c5774f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:35.994674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4d12f38-2187-4687-afbe-8ca489c5774f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:35.995386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4d12f38-2187-4687-afbe-8ca489c5774f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:35.996513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4d12f38-2187-4687-afbe-8ca489c5774f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:35.997253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4d12f38-2187-4687-afbe-8ca489c5774f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:35.997951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d4d12f38-2187-4687-afbe-8ca489c5774f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:36.062807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d4d12f38-2187-4687-afbe-8ca489c5774f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:36.071754 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d4d12f38-2187-4687-afbe-8ca489c5774f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096623 Sep 13 20:26:36.072665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1346/2613] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:35 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:37.099186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b8275de6-943e-4c3f-b782-d3e619a767d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:37.100232 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b8275de6-943e-4c3f-b782-d3e619a767d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:37.112389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b8275de6-943e-4c3f-b782-d3e619a767d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:37.113247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b8275de6-943e-4c3f-b782-d3e619a767d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:37.113975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b8275de6-943e-4c3f-b782-d3e619a767d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:37.114985 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b8275de6-943e-4c3f-b782-d3e619a767d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:37.115432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b8275de6-943e-4c3f-b782-d3e619a767d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:37.115854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b8275de6-943e-4c3f-b782-d3e619a767d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:37.176734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b8275de6-943e-4c3f-b782-d3e619a767d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:37.185776 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b8275de6-943e-4c3f-b782-d3e619a767d8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093019 Sep 13 20:26:37.186338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1268/2614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:37 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:38.210446 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c27dc995-8df0-4ecf-9807-8fe97d957e04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:38.211056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c27dc995-8df0-4ecf-9807-8fe97d957e04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:38.219140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c27dc995-8df0-4ecf-9807-8fe97d957e04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:38.219708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c27dc995-8df0-4ecf-9807-8fe97d957e04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:38.220212 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c27dc995-8df0-4ecf-9807-8fe97d957e04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:38.221027 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c27dc995-8df0-4ecf-9807-8fe97d957e04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:38.221556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c27dc995-8df0-4ecf-9807-8fe97d957e04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:38.222049 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c27dc995-8df0-4ecf-9807-8fe97d957e04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:38.225030 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=84 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:26:38.284624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c27dc995-8df0-4ecf-9807-8fe97d957e04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:38.293381 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c27dc995-8df0-4ecf-9807-8fe97d957e04 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.087708 Sep 13 20:26:38.293935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1347/2615] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:38 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:39.317488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9e2f8785-023b-438a-b05f-2520572765fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:39.318197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9e2f8785-023b-438a-b05f-2520572765fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:39.325743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e2f8785-023b-438a-b05f-2520572765fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:39.326230 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e2f8785-023b-438a-b05f-2520572765fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:39.326875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e2f8785-023b-438a-b05f-2520572765fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:39.327582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e2f8785-023b-438a-b05f-2520572765fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:39.328035 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e2f8785-023b-438a-b05f-2520572765fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:39.328464 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9e2f8785-023b-438a-b05f-2520572765fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:39.390692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9e2f8785-023b-438a-b05f-2520572765fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:39.399203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9e2f8785-023b-438a-b05f-2520572765fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085985 Sep 13 20:26:39.399765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1269/2616] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:39 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:40.426139 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-979220e5-933b-4f27-a6dc-82e4da0b0f6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:40.427297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-979220e5-933b-4f27-a6dc-82e4da0b0f6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:40.435197 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-979220e5-933b-4f27-a6dc-82e4da0b0f6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:40.435750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-979220e5-933b-4f27-a6dc-82e4da0b0f6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:40.436248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-979220e5-933b-4f27-a6dc-82e4da0b0f6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:40.437041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-979220e5-933b-4f27-a6dc-82e4da0b0f6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:40.437557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-979220e5-933b-4f27-a6dc-82e4da0b0f6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:40.438038 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-979220e5-933b-4f27-a6dc-82e4da0b0f6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:40.505537 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-979220e5-933b-4f27-a6dc-82e4da0b0f6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:40.513872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-979220e5-933b-4f27-a6dc-82e4da0b0f6c tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094289 Sep 13 20:26:40.514444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1348/2617] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:40 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:41.539377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b4ba1097-6136-4f36-a7a3-5229bc81b034 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:41.539975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b4ba1097-6136-4f36-a7a3-5229bc81b034 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:41.547182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4ba1097-6136-4f36-a7a3-5229bc81b034 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:41.547684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4ba1097-6136-4f36-a7a3-5229bc81b034 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:41.548131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4ba1097-6136-4f36-a7a3-5229bc81b034 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:41.548844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4ba1097-6136-4f36-a7a3-5229bc81b034 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:41.549315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4ba1097-6136-4f36-a7a3-5229bc81b034 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:41.549751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b4ba1097-6136-4f36-a7a3-5229bc81b034 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:41.617842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-b4ba1097-6136-4f36-a7a3-5229bc81b034 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:41.630894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b4ba1097-6136-4f36-a7a3-5229bc81b034 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096452 Sep 13 20:26:41.631674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1270/2618] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:41 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:42.663728 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7d98a441-81bc-4ab5-8ce6-3fb79cf35253 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:42.664801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7d98a441-81bc-4ab5-8ce6-3fb79cf35253 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:42.675805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d98a441-81bc-4ab5-8ce6-3fb79cf35253 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:42.676605 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d98a441-81bc-4ab5-8ce6-3fb79cf35253 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:42.677315 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d98a441-81bc-4ab5-8ce6-3fb79cf35253 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:42.678171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d98a441-81bc-4ab5-8ce6-3fb79cf35253 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:42.678664 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d98a441-81bc-4ab5-8ce6-3fb79cf35253 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:42.679055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7d98a441-81bc-4ab5-8ce6-3fb79cf35253 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:42.741555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7d98a441-81bc-4ab5-8ce6-3fb79cf35253 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:42.749989 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7d98a441-81bc-4ab5-8ce6-3fb79cf35253 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092779 Sep 13 20:26:42.750598 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1349/2619] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:42 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:43.773430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5c14c18b-5f70-4e20-8db1-abc9903f1549 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:43.773933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5c14c18b-5f70-4e20-8db1-abc9903f1549 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:43.780830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c14c18b-5f70-4e20-8db1-abc9903f1549 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:43.781318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c14c18b-5f70-4e20-8db1-abc9903f1549 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:43.781751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c14c18b-5f70-4e20-8db1-abc9903f1549 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:43.782479 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c14c18b-5f70-4e20-8db1-abc9903f1549 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:43.782930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c14c18b-5f70-4e20-8db1-abc9903f1549 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:43.783355 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5c14c18b-5f70-4e20-8db1-abc9903f1549 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:43.846515 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5c14c18b-5f70-4e20-8db1-abc9903f1549 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:43.855065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5c14c18b-5f70-4e20-8db1-abc9903f1549 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085729 Sep 13 20:26:43.855640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1271/2620] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:43 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:44.881098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-44b5b16a-8878-4b2f-a94e-7967d8fb625a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:44.881894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-44b5b16a-8878-4b2f-a94e-7967d8fb625a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:44.891683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44b5b16a-8878-4b2f-a94e-7967d8fb625a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:44.892398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44b5b16a-8878-4b2f-a94e-7967d8fb625a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:44.893087 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44b5b16a-8878-4b2f-a94e-7967d8fb625a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:44.894191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44b5b16a-8878-4b2f-a94e-7967d8fb625a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:44.894985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44b5b16a-8878-4b2f-a94e-7967d8fb625a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:44.895648 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-44b5b16a-8878-4b2f-a94e-7967d8fb625a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:44.956436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-44b5b16a-8878-4b2f-a94e-7967d8fb625a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:44.964758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-44b5b16a-8878-4b2f-a94e-7967d8fb625a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090600 Sep 13 20:26:44.965321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1350/2621] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:44 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:45.991218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2ad05d7c-c358-4221-9f3b-0038ab8e4b14 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:45.992265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2ad05d7c-c358-4221-9f3b-0038ab8e4b14 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:45.996095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=28 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:26:46.005144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ad05d7c-c358-4221-9f3b-0038ab8e4b14 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:46.005947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ad05d7c-c358-4221-9f3b-0038ab8e4b14 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:46.006747 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ad05d7c-c358-4221-9f3b-0038ab8e4b14 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:46.007982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ad05d7c-c358-4221-9f3b-0038ab8e4b14 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:46.008433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ad05d7c-c358-4221-9f3b-0038ab8e4b14 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:46.008856 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2ad05d7c-c358-4221-9f3b-0038ab8e4b14 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:46.081450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2ad05d7c-c358-4221-9f3b-0038ab8e4b14 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:46.091725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2ad05d7c-c358-4221-9f3b-0038ab8e4b14 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.106975 Sep 13 20:26:46.092237 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1272/2622] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:45 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:47.118168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-43333a5d-7c41-40cf-a7fc-745f6d865010 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:47.118991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-43333a5d-7c41-40cf-a7fc-745f6d865010 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:47.127523 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43333a5d-7c41-40cf-a7fc-745f6d865010 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:47.128113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43333a5d-7c41-40cf-a7fc-745f6d865010 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:47.128645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43333a5d-7c41-40cf-a7fc-745f6d865010 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:47.129490 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43333a5d-7c41-40cf-a7fc-745f6d865010 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:47.130047 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43333a5d-7c41-40cf-a7fc-745f6d865010 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:47.130614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-43333a5d-7c41-40cf-a7fc-745f6d865010 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:47.194160 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-43333a5d-7c41-40cf-a7fc-745f6d865010 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:47.203316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-43333a5d-7c41-40cf-a7fc-745f6d865010 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.091422 Sep 13 20:26:47.203873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1351/2623] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:47 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:48.229609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d5fa472e-a597-4c5b-bf78-e6446708410b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:48.230402 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d5fa472e-a597-4c5b-bf78-e6446708410b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:48.239651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d5fa472e-a597-4c5b-bf78-e6446708410b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:48.240304 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d5fa472e-a597-4c5b-bf78-e6446708410b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:48.240886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d5fa472e-a597-4c5b-bf78-e6446708410b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:48.241788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d5fa472e-a597-4c5b-bf78-e6446708410b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:48.242423 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d5fa472e-a597-4c5b-bf78-e6446708410b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:48.243085 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d5fa472e-a597-4c5b-bf78-e6446708410b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:48.245647 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=84 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:26:48.305803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d5fa472e-a597-4c5b-bf78-e6446708410b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:48.315764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d5fa472e-a597-4c5b-bf78-e6446708410b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092281 Sep 13 20:26:48.316507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1273/2624] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:48 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:49.343615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0e0cee13-e48c-4f8e-9484-8df5c2367ab7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:49.344618 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0e0cee13-e48c-4f8e-9484-8df5c2367ab7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:49.348245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=28 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:26:49.357430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e0cee13-e48c-4f8e-9484-8df5c2367ab7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:49.358210 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e0cee13-e48c-4f8e-9484-8df5c2367ab7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:49.358982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e0cee13-e48c-4f8e-9484-8df5c2367ab7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:49.360111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e0cee13-e48c-4f8e-9484-8df5c2367ab7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:49.360858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e0cee13-e48c-4f8e-9484-8df5c2367ab7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:49.361560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0e0cee13-e48c-4f8e-9484-8df5c2367ab7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:49.430188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-0e0cee13-e48c-4f8e-9484-8df5c2367ab7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:49.438856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0e0cee13-e48c-4f8e-9484-8df5c2367ab7 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.101861 Sep 13 20:26:49.439426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1352/2625] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:49 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:50.465283 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c428e44f-9d77-4775-8b75-f2a35bae072f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:50.466263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c428e44f-9d77-4775-8b75-f2a35bae072f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:50.477099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c428e44f-9d77-4775-8b75-f2a35bae072f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:50.477770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c428e44f-9d77-4775-8b75-f2a35bae072f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:50.478194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c428e44f-9d77-4775-8b75-f2a35bae072f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:50.478901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c428e44f-9d77-4775-8b75-f2a35bae072f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:50.479346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c428e44f-9d77-4775-8b75-f2a35bae072f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:50.479772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c428e44f-9d77-4775-8b75-f2a35bae072f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:50.546946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c428e44f-9d77-4775-8b75-f2a35bae072f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:50.555578 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c428e44f-9d77-4775-8b75-f2a35bae072f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096652 Sep 13 20:26:50.556148 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1274/2626] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:50 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:51.579404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8326d4cf-9042-4f5e-b2a3-52e5333b44e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:51.580024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8326d4cf-9042-4f5e-b2a3-52e5333b44e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:51.587020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8326d4cf-9042-4f5e-b2a3-52e5333b44e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:51.587493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8326d4cf-9042-4f5e-b2a3-52e5333b44e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:51.587923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8326d4cf-9042-4f5e-b2a3-52e5333b44e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:51.588594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8326d4cf-9042-4f5e-b2a3-52e5333b44e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:51.589031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8326d4cf-9042-4f5e-b2a3-52e5333b44e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:51.589438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8326d4cf-9042-4f5e-b2a3-52e5333b44e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:51.656656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8326d4cf-9042-4f5e-b2a3-52e5333b44e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:51.665615 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8326d4cf-9042-4f5e-b2a3-52e5333b44e6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090193 Sep 13 20:26:51.666240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1353/2627] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:51 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:52.693095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-416607cb-c3f2-420b-9f44-a7baec1e8851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:52.694095 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-416607cb-c3f2-420b-9f44-a7baec1e8851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:52.702326 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-416607cb-c3f2-420b-9f44-a7baec1e8851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:52.702846 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-416607cb-c3f2-420b-9f44-a7baec1e8851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:52.703281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-416607cb-c3f2-420b-9f44-a7baec1e8851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:52.703967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-416607cb-c3f2-420b-9f44-a7baec1e8851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:52.704418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-416607cb-c3f2-420b-9f44-a7baec1e8851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:52.704840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-416607cb-c3f2-420b-9f44-a7baec1e8851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:52.767513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-416607cb-c3f2-420b-9f44-a7baec1e8851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:52.776524 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-416607cb-c3f2-420b-9f44-a7baec1e8851 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090082 Sep 13 20:26:52.777082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1275/2628] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:52 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:53.803357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4c38fe44-45cf-4fa4-b283-2722bbaa9c83 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:53.804370 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4c38fe44-45cf-4fa4-b283-2722bbaa9c83 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:53.812494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c38fe44-45cf-4fa4-b283-2722bbaa9c83 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:53.812969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c38fe44-45cf-4fa4-b283-2722bbaa9c83 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:53.813405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c38fe44-45cf-4fa4-b283-2722bbaa9c83 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:53.814118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c38fe44-45cf-4fa4-b283-2722bbaa9c83 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:53.814610 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c38fe44-45cf-4fa4-b283-2722bbaa9c83 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:53.815032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4c38fe44-45cf-4fa4-b283-2722bbaa9c83 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:53.879969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4c38fe44-45cf-4fa4-b283-2722bbaa9c83 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:53.888691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4c38fe44-45cf-4fa4-b283-2722bbaa9c83 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092011 Sep 13 20:26:53.889280 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1354/2629] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:53 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:54.916146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d51ba067-cdad-465f-bdfe-7e01a2e15173 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:54.917039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d51ba067-cdad-465f-bdfe-7e01a2e15173 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:54.924223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d51ba067-cdad-465f-bdfe-7e01a2e15173 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:54.924698 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d51ba067-cdad-465f-bdfe-7e01a2e15173 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:54.925132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d51ba067-cdad-465f-bdfe-7e01a2e15173 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:54.925812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d51ba067-cdad-465f-bdfe-7e01a2e15173 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:54.926260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d51ba067-cdad-465f-bdfe-7e01a2e15173 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:54.926720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d51ba067-cdad-465f-bdfe-7e01a2e15173 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:54.993794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d51ba067-cdad-465f-bdfe-7e01a2e15173 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:55.002484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d51ba067-cdad-465f-bdfe-7e01a2e15173 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.093032 Sep 13 20:26:55.003064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1276/2630] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:54 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:56.028868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-785ae07c-a6cb-48fd-80b7-dc420bbba7c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:56.029923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-785ae07c-a6cb-48fd-80b7-dc420bbba7c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:56.041042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-785ae07c-a6cb-48fd-80b7-dc420bbba7c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:56.041838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-785ae07c-a6cb-48fd-80b7-dc420bbba7c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:56.042596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-785ae07c-a6cb-48fd-80b7-dc420bbba7c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:56.043650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-785ae07c-a6cb-48fd-80b7-dc420bbba7c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:56.044102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-785ae07c-a6cb-48fd-80b7-dc420bbba7c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:56.044522 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-785ae07c-a6cb-48fd-80b7-dc420bbba7c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:56.106695 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-785ae07c-a6cb-48fd-80b7-dc420bbba7c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:56.115096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-785ae07c-a6cb-48fd-80b7-dc420bbba7c9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092818 Sep 13 20:26:56.115699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1355/2631] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:56 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:57.139963 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-60122e1b-2d42-449f-a1e6-d29a34a09290 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:57.140560 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-60122e1b-2d42-449f-a1e6-d29a34a09290 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:57.147434 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-60122e1b-2d42-449f-a1e6-d29a34a09290 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:57.147914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-60122e1b-2d42-449f-a1e6-d29a34a09290 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:57.148347 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-60122e1b-2d42-449f-a1e6-d29a34a09290 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:57.149083 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-60122e1b-2d42-449f-a1e6-d29a34a09290 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:57.149507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-60122e1b-2d42-449f-a1e6-d29a34a09290 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:57.149927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-60122e1b-2d42-449f-a1e6-d29a34a09290 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:57.220635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-60122e1b-2d42-449f-a1e6-d29a34a09290 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:57.231311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-60122e1b-2d42-449f-a1e6-d29a34a09290 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.096266 Sep 13 20:26:57.231872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1277/2632] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:57 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:58.258436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d68f73d9-b1b0-4dcc-872c-e56a502a2e4e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:58.263926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d68f73d9-b1b0-4dcc-872c-e56a502a2e4e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:58.268202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:26:58.268437 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:26:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e (ip 10.222.0.52) !!! Sep 13 20:26:58.272077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d68f73d9-b1b0-4dcc-872c-e56a502a2e4e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:58.272872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d68f73d9-b1b0-4dcc-872c-e56a502a2e4e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:58.273582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d68f73d9-b1b0-4dcc-872c-e56a502a2e4e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:58.274742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d68f73d9-b1b0-4dcc-872c-e56a502a2e4e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:58.275480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d68f73d9-b1b0-4dcc-872c-e56a502a2e4e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:58.276170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d68f73d9-b1b0-4dcc-872c-e56a502a2e4e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:58.343052 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d68f73d9-b1b0-4dcc-872c-e56a502a2e4e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:58.351299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d68f73d9-b1b0-4dcc-872c-e56a502a2e4e tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.099377 Sep 13 20:26:58.351879 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1356/2633] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:58 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:59.378061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e9d75ca9-ee97-45ff-9699-856651f20817 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:59.379238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e9d75ca9-ee97-45ff-9699-856651f20817 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:59.389081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9d75ca9-ee97-45ff-9699-856651f20817 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:59.389567 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9d75ca9-ee97-45ff-9699-856651f20817 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:59.389999 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9d75ca9-ee97-45ff-9699-856651f20817 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:59.390724 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9d75ca9-ee97-45ff-9699-856651f20817 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:59.391179 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9d75ca9-ee97-45ff-9699-856651f20817 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:59.391604 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9d75ca9-ee97-45ff-9699-856651f20817 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:59.456896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e9d75ca9-ee97-45ff-9699-856651f20817 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:59.465665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e9d75ca9-ee97-45ff-9699-856651f20817 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094184 Sep 13 20:26:59.466235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1278/2634] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:59 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:00.501388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bdffdc5b-a4f5-4e07-a3cc-7a311ce64dbf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:00.502353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bdffdc5b-a4f5-4e07-a3cc-7a311ce64dbf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:00.513138 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bdffdc5b-a4f5-4e07-a3cc-7a311ce64dbf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:00.513914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bdffdc5b-a4f5-4e07-a3cc-7a311ce64dbf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:00.514665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bdffdc5b-a4f5-4e07-a3cc-7a311ce64dbf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:00.515774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bdffdc5b-a4f5-4e07-a3cc-7a311ce64dbf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:00.516504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bdffdc5b-a4f5-4e07-a3cc-7a311ce64dbf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:00.517185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bdffdc5b-a4f5-4e07-a3cc-7a311ce64dbf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:00.583569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bdffdc5b-a4f5-4e07-a3cc-7a311ce64dbf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:00.592298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bdffdc5b-a4f5-4e07-a3cc-7a311ce64dbf tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.097641 Sep 13 20:27:00.592851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1357/2635] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:00 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:01.619818 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c8af102d-b065-47f3-87f4-7324534a2cb6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:01.620826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c8af102d-b065-47f3-87f4-7324534a2cb6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:01.631336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8af102d-b065-47f3-87f4-7324534a2cb6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:01.632129 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8af102d-b065-47f3-87f4-7324534a2cb6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:01.632840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8af102d-b065-47f3-87f4-7324534a2cb6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:01.633964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8af102d-b065-47f3-87f4-7324534a2cb6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:01.634758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8af102d-b065-47f3-87f4-7324534a2cb6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:01.635468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c8af102d-b065-47f3-87f4-7324534a2cb6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:01.706720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c8af102d-b065-47f3-87f4-7324534a2cb6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:01.717786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c8af102d-b065-47f3-87f4-7324534a2cb6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.104549 Sep 13 20:27:01.718359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1279/2636] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:01 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:02.744514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2da73b6d-06b3-402e-8261-ea3b54368eb9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:02.745526 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2da73b6d-06b3-402e-8261-ea3b54368eb9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:02.752932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2da73b6d-06b3-402e-8261-ea3b54368eb9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:02.753388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2da73b6d-06b3-402e-8261-ea3b54368eb9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:02.753810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2da73b6d-06b3-402e-8261-ea3b54368eb9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:02.754528 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2da73b6d-06b3-402e-8261-ea3b54368eb9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:02.754975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2da73b6d-06b3-402e-8261-ea3b54368eb9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:02.755390 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2da73b6d-06b3-402e-8261-ea3b54368eb9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:02.817462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2da73b6d-06b3-402e-8261-ea3b54368eb9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:02.826586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2da73b6d-06b3-402e-8261-ea3b54368eb9 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.088680 Sep 13 20:27:02.827083 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1358/2637] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:02 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:03.852764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-30ab9d35-5626-4a5f-ad2b-bf0731cb0bad tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:03.853779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-30ab9d35-5626-4a5f-ad2b-bf0731cb0bad tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:03.861666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30ab9d35-5626-4a5f-ad2b-bf0731cb0bad tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:03.862168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30ab9d35-5626-4a5f-ad2b-bf0731cb0bad tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:03.862617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30ab9d35-5626-4a5f-ad2b-bf0731cb0bad tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:03.863298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30ab9d35-5626-4a5f-ad2b-bf0731cb0bad tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:03.863743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30ab9d35-5626-4a5f-ad2b-bf0731cb0bad tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:03.864168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-30ab9d35-5626-4a5f-ad2b-bf0731cb0bad tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:03.929490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-30ab9d35-5626-4a5f-ad2b-bf0731cb0bad tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:03.938353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-30ab9d35-5626-4a5f-ad2b-bf0731cb0bad tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092025 Sep 13 20:27:03.938953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1280/2638] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:03 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:04.965493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2f0df014-43df-46e9-89f4-882b20f38e7b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:04.966221 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2f0df014-43df-46e9-89f4-882b20f38e7b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:04.974607 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f0df014-43df-46e9-89f4-882b20f38e7b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:04.975206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f0df014-43df-46e9-89f4-882b20f38e7b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:04.975739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f0df014-43df-46e9-89f4-882b20f38e7b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:04.976591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f0df014-43df-46e9-89f4-882b20f38e7b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:04.977159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f0df014-43df-46e9-89f4-882b20f38e7b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:04.977688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2f0df014-43df-46e9-89f4-882b20f38e7b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:05.042260 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2f0df014-43df-46e9-89f4-882b20f38e7b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:05.051022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2f0df014-43df-46e9-89f4-882b20f38e7b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.092230 Sep 13 20:27:05.051588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1359/2639] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:04 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:06.086006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e08c6a43-9ba3-4064-8189-983d772e8226 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:06.087437 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e08c6a43-9ba3-4064-8189-983d772e8226 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:06.098520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e08c6a43-9ba3-4064-8189-983d772e8226 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:06.099221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e08c6a43-9ba3-4064-8189-983d772e8226 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:06.099928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e08c6a43-9ba3-4064-8189-983d772e8226 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:06.101044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e08c6a43-9ba3-4064-8189-983d772e8226 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:06.101824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e08c6a43-9ba3-4064-8189-983d772e8226 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:06.102522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e08c6a43-9ba3-4064-8189-983d772e8226 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:06.167472 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e08c6a43-9ba3-4064-8189-983d772e8226 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:06.180443 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e08c6a43-9ba3-4064-8189-983d772e8226 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.100757 Sep 13 20:27:06.181328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1281/2640] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:06 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:07.208048 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-27e6485e-5487-47d5-9286-375ff93fabca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:07.209023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-27e6485e-5487-47d5-9286-375ff93fabca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:07.218530 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27e6485e-5487-47d5-9286-375ff93fabca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:07.218979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27e6485e-5487-47d5-9286-375ff93fabca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:07.219439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27e6485e-5487-47d5-9286-375ff93fabca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:07.220129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27e6485e-5487-47d5-9286-375ff93fabca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:07.220577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27e6485e-5487-47d5-9286-375ff93fabca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:07.220979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-27e6485e-5487-47d5-9286-375ff93fabca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:07.283460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-27e6485e-5487-47d5-9286-375ff93fabca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:07.291896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-27e6485e-5487-47d5-9286-375ff93fabca tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.090490 Sep 13 20:27:07.292478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1360/2641] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:07 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:08.314391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-649eac86-9839-4a33-b444-a041f61cab58 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:08.314978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-649eac86-9839-4a33-b444-a041f61cab58 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:08.322170 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-649eac86-9839-4a33-b444-a041f61cab58 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:08.323047 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-649eac86-9839-4a33-b444-a041f61cab58 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:08.323483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-649eac86-9839-4a33-b444-a041f61cab58 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:08.324168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-649eac86-9839-4a33-b444-a041f61cab58 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:08.324616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-649eac86-9839-4a33-b444-a041f61cab58 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:08.325039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-649eac86-9839-4a33-b444-a041f61cab58 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:08.387273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-649eac86-9839-4a33-b444-a041f61cab58 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:08.395759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-649eac86-9839-4a33-b444-a041f61cab58 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.085416 Sep 13 20:27:08.396324 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1282/2642] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:08 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:09.419499 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-19cb8194-a8ee-4d29-9777-d087b4c8b390 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:09.420057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-19cb8194-a8ee-4d29-9777-d087b4c8b390 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:09.426812 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19cb8194-a8ee-4d29-9777-d087b4c8b390 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:09.427294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19cb8194-a8ee-4d29-9777-d087b4c8b390 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:09.427724 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19cb8194-a8ee-4d29-9777-d087b4c8b390 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:09.428409 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19cb8194-a8ee-4d29-9777-d087b4c8b390 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:09.428854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19cb8194-a8ee-4d29-9777-d087b4c8b390 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:09.429272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-19cb8194-a8ee-4d29-9777-d087b4c8b390 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:09.431853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=84 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:09.497753 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-19cb8194-a8ee-4d29-9777-d087b4c8b390 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:09.509973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-19cb8194-a8ee-4d29-9777-d087b4c8b390 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 200 len: 1369 microversion: 2.1 time: 0.094157 Sep 13 20:27:09.510794 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1361/2643] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:09 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:09.534308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b9ce05ae-061b-44a3-8717-0c495188a866 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '.version_select at 0x7f9849cf3af0>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:09.538878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9ce05ae-061b-44a3-8717-0c495188a866 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [e1310efb-0708-4b2b-9059-57ee60101871] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 20:27:10.550285 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9ce05ae-061b-44a3-8717-0c495188a866 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [e1310efb-0708-4b2b-9059-57ee60101871] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 55720. Sep 13 20:27:10.572246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b9ce05ae-061b-44a3-8717-0c495188a866 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519092093" status: 202 len: 0 microversion: 2.1 time: 1.041765 Sep 13 20:27:10.573222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1283/2644] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 13 20:27:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519092093 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:27:11.482078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9f42bae8-8c68-4b8b-9661-e860cd502e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Action: 'create', calling method: .version_select at 0x7f98467465e0>, body: {"keypair": {"name": "tempest-keypair-1404074111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN89KWVoV9Yz1LGJRhS78yasesnUBnN3XulfltaYRS+h2lIHaurnLZENdEHpXVZ87KuRvrWVe+2wCDCClYZLCEl5y3JigkwEJoH7gxhaZ2UAYm82ZlCDEVobFFWMno6tlw=="}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:27:11.498144 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-9f42bae8-8c68-4b8b-9661-e860cd502e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Getting quotas for project b3fa762826924accaa8012d7ceaf17eb. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:27:11.502189 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-9f42bae8-8c68-4b8b-9661-e860cd502e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Getting quotas for user 87c4f9c4b9334b66ac89e01a278436bc and project b3fa762826924accaa8012d7ceaf17eb. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:27:11.529805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9f42bae8-8c68-4b8b-9661-e860cd502e50 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051629 Sep 13 20:27:11.530495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1362/2645] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 13 20:27:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:27:12.784184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1043516769", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "990730b3-824d-4a88-9c88-3fdb4c9e239c"}], "security_groups": [{"name": "tempest-securitygroup--839055153"}], "key_name": "tempest-keypair-1404074111", "user_data": "}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:27:12.902328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] validate_networks() for [('990730b3-824d-4a88-9c88-3fdb4c9e239c', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:27:13.335774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:27:13.336361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:27:13.336918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:27:13.337553 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:27:13.338128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:27:13.351748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:13.352431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:13.353070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:13.354179 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:13.354921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:13.355537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:13.375348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Getting quotas for project b3fa762826924accaa8012d7ceaf17eb. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:27:13.379787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Getting quotas for user 87c4f9c4b9334b66ac89e01a278436bc and project b3fa762826924accaa8012d7ceaf17eb. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:27:13.394572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:27:13.396862 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:27:13.449027 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-48c098f4-d01e-4754-a0fc-df46bfde8cc4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.669667 Sep 13 20:27:13.449649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1284/2646] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:27:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:27:13.460951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5544a32f-02b6-4ea9-b348-5621efbd88df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:13.461553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5544a32f-02b6-4ea9-b348-5621efbd88df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:13.516585 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5544a32f-02b6-4ea9-b348-5621efbd88df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:13.524214 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5544a32f-02b6-4ea9-b348-5621efbd88df tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1238 microversion: 2.1 time: 0.067104 Sep 13 20:27:13.524737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1363/2647] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:13 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:14.552210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2845cc83-e63d-4f56-987c-a2a4c9d08088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:14.553056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2845cc83-e63d-4f56-987c-a2a4c9d08088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:14.562817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2845cc83-e63d-4f56-987c-a2a4c9d08088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:14.563286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2845cc83-e63d-4f56-987c-a2a4c9d08088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:14.563774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2845cc83-e63d-4f56-987c-a2a4c9d08088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:14.564489 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2845cc83-e63d-4f56-987c-a2a4c9d08088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:14.564928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2845cc83-e63d-4f56-987c-a2a4c9d08088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:14.565364 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2845cc83-e63d-4f56-987c-a2a4c9d08088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:14.627841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-2845cc83-e63d-4f56-987c-a2a4c9d08088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:14.635878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2845cc83-e63d-4f56-987c-a2a4c9d08088 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1290 microversion: 2.1 time: 0.091360 Sep 13 20:27:14.636427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1285/2648] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:14 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:15.663734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fb6f757a-14a2-4493-bb92-8326e175687f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:15.664272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fb6f757a-14a2-4493-bb92-8326e175687f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:15.670694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb6f757a-14a2-4493-bb92-8326e175687f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:15.671285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb6f757a-14a2-4493-bb92-8326e175687f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:15.671715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb6f757a-14a2-4493-bb92-8326e175687f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:15.672398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb6f757a-14a2-4493-bb92-8326e175687f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:15.672849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb6f757a-14a2-4493-bb92-8326e175687f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:15.673265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fb6f757a-14a2-4493-bb92-8326e175687f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:15.801469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-fb6f757a-14a2-4493-bb92-8326e175687f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:15.809170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fb6f757a-14a2-4493-bb92-8326e175687f tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1363 microversion: 2.1 time: 0.150361 Sep 13 20:27:15.809738 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1364/2649] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:15 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:16.157261 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-efa122f9-372f-40e2-871c-e874a9c0bd5b req-04204a6d-7c77-416c-aee3-c48459b90b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b", "tag": "f7274628-4d52-46a0-8ffc-461979557405"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:27:16.162042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:16.167579 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-efa122f9-372f-40e2-871c-e874a9c0bd5b req-04204a6d-7c77-416c-aee3-c48459b90b4e service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:16.167981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-efa122f9-372f-40e2-871c-e874a9c0bd5b req-04204a6d-7c77-416c-aee3-c48459b90b4e service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:16.168400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-efa122f9-372f-40e2-871c-e874a9c0bd5b req-04204a6d-7c77-416c-aee3-c48459b90b4e service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:16.180123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-efa122f9-372f-40e2-871c-e874a9c0bd5b req-04204a6d-7c77-416c-aee3-c48459b90b4e service nova] Creating event network-changed:f7274628-4d52-46a0-8ffc-461979557405 for instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b on hv-cinder-85427 Sep 13 20:27:16.183635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR oslo.messaging._drivers.impl_rabbit [req-efa122f9-372f-40e2-871c-e874a9c0bd5b req-04204a6d-7c77-416c-aee3-c48459b90b4e service nova] [25b124a0-7c2f-44d7-bf98-9123f9d85af0] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 20:27:16.837014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3c531e54-dcd0-4dc4-9ffe-4e712ee11ec4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:16.838015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3c531e54-dcd0-4dc4-9ffe-4e712ee11ec4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:16.847542 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c531e54-dcd0-4dc4-9ffe-4e712ee11ec4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:16.848020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c531e54-dcd0-4dc4-9ffe-4e712ee11ec4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:16.848450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c531e54-dcd0-4dc4-9ffe-4e712ee11ec4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:16.849134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c531e54-dcd0-4dc4-9ffe-4e712ee11ec4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:16.849581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c531e54-dcd0-4dc4-9ffe-4e712ee11ec4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:16.850002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3c531e54-dcd0-4dc4-9ffe-4e712ee11ec4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:16.985884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3c531e54-dcd0-4dc4-9ffe-4e712ee11ec4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:16.994340 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3c531e54-dcd0-4dc4-9ffe-4e712ee11ec4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1363 microversion: 2.1 time: 0.163940 Sep 13 20:27:16.994926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1365/2650] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:16 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:17.195721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [req-efa122f9-372f-40e2-871c-e874a9c0bd5b req-04204a6d-7c77-416c-aee3-c48459b90b4e service nova] [25b124a0-7c2f-44d7-bf98-9123f9d85af0] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 55784. Sep 13 20:27:17.202089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-efa122f9-372f-40e2-871c-e874a9c0bd5b req-04204a6d-7c77-416c-aee3-c48459b90b4e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.103398 Sep 13 20:27:17.203121 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1286/2651] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:27:18.029337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d91bfdfa-e82c-4ae6-8529-d66d15adfffd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:18.030275 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d91bfdfa-e82c-4ae6-8529-d66d15adfffd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:18.038406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d91bfdfa-e82c-4ae6-8529-d66d15adfffd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:18.038934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d91bfdfa-e82c-4ae6-8529-d66d15adfffd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:18.039365 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d91bfdfa-e82c-4ae6-8529-d66d15adfffd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:18.040051 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d91bfdfa-e82c-4ae6-8529-d66d15adfffd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:18.040504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d91bfdfa-e82c-4ae6-8529-d66d15adfffd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:18.040924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d91bfdfa-e82c-4ae6-8529-d66d15adfffd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:18.173383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d91bfdfa-e82c-4ae6-8529-d66d15adfffd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:18.181412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d91bfdfa-e82c-4ae6-8529-d66d15adfffd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1363 microversion: 2.1 time: 0.158730 Sep 13 20:27:18.181987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1366/2652] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:18 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:19.207584 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-52e6d385-956e-4510-a3b3-b2ba2ff642a6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:19.208395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-52e6d385-956e-4510-a3b3-b2ba2ff642a6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:19.216116 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52e6d385-956e-4510-a3b3-b2ba2ff642a6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:19.216677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52e6d385-956e-4510-a3b3-b2ba2ff642a6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:19.217183 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52e6d385-956e-4510-a3b3-b2ba2ff642a6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:19.217983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52e6d385-956e-4510-a3b3-b2ba2ff642a6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:19.218551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52e6d385-956e-4510-a3b3-b2ba2ff642a6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:19.219042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-52e6d385-956e-4510-a3b3-b2ba2ff642a6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:19.222144 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=70 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:19.360677 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-52e6d385-956e-4510-a3b3-b2ba2ff642a6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:19.368664 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-52e6d385-956e-4510-a3b3-b2ba2ff642a6 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1363 microversion: 2.1 time: 0.166883 Sep 13 20:27:19.369206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1287/2653] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:19 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:20.391687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-aab3f32a-e472-4b5c-9dc1-df6942af7e5b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:20.392269 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-aab3f32a-e472-4b5c-9dc1-df6942af7e5b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:20.394685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:20.400342 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aab3f32a-e472-4b5c-9dc1-df6942af7e5b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:20.400832 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aab3f32a-e472-4b5c-9dc1-df6942af7e5b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:20.401252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aab3f32a-e472-4b5c-9dc1-df6942af7e5b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:20.401923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aab3f32a-e472-4b5c-9dc1-df6942af7e5b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:20.402380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aab3f32a-e472-4b5c-9dc1-df6942af7e5b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:20.402805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-aab3f32a-e472-4b5c-9dc1-df6942af7e5b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:20.536367 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-aab3f32a-e472-4b5c-9dc1-df6942af7e5b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:20.544785 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-aab3f32a-e472-4b5c-9dc1-df6942af7e5b tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1363 microversion: 2.1 time: 0.157007 Sep 13 20:27:20.545362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1367/2654] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:20 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:21.569045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8a31e4d8-054f-44f9-b611-be5273a23883 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:21.569789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8a31e4d8-054f-44f9-b611-be5273a23883 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:21.578673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a31e4d8-054f-44f9-b611-be5273a23883 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:21.579247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a31e4d8-054f-44f9-b611-be5273a23883 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:21.579756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a31e4d8-054f-44f9-b611-be5273a23883 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:21.580581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a31e4d8-054f-44f9-b611-be5273a23883 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:21.581108 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a31e4d8-054f-44f9-b611-be5273a23883 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:21.581660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8a31e4d8-054f-44f9-b611-be5273a23883 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:21.715599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8a31e4d8-054f-44f9-b611-be5273a23883 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:21.723637 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8a31e4d8-054f-44f9-b611-be5273a23883 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1363 microversion: 2.1 time: 0.159260 Sep 13 20:27:21.724212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1288/2655] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:21 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:22.403265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-35903c60-6755-4a31-955e-a0066beed400 req-e9a24dd7-9465-43e3-8aad-8dd53c5f87bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b", "name": "network-vif-plugged", "status": "completed", "tag": "f7274628-4d52-46a0-8ffc-461979557405"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:27:22.412961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-35903c60-6755-4a31-955e-a0066beed400 req-e9a24dd7-9465-43e3-8aad-8dd53c5f87bb service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:22.413394 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-35903c60-6755-4a31-955e-a0066beed400 req-e9a24dd7-9465-43e3-8aad-8dd53c5f87bb service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:22.414473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-35903c60-6755-4a31-955e-a0066beed400 req-e9a24dd7-9465-43e3-8aad-8dd53c5f87bb service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:22.425976 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-35903c60-6755-4a31-955e-a0066beed400 req-e9a24dd7-9465-43e3-8aad-8dd53c5f87bb service nova] Creating event network-vif-plugged:f7274628-4d52-46a0-8ffc-461979557405 for instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b on hv-cinder-85427 Sep 13 20:27:22.431188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-35903c60-6755-4a31-955e-a0066beed400 req-e9a24dd7-9465-43e3-8aad-8dd53c5f87bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084570 Sep 13 20:27:22.432014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1368/2656] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:27:22.749925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-37f44223-a3ef-427d-9786-139abfe734a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:22.750968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-37f44223-a3ef-427d-9786-139abfe734a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:22.759270 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37f44223-a3ef-427d-9786-139abfe734a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:22.759750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37f44223-a3ef-427d-9786-139abfe734a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:22.760185 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37f44223-a3ef-427d-9786-139abfe734a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:22.760874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37f44223-a3ef-427d-9786-139abfe734a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:22.761323 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37f44223-a3ef-427d-9786-139abfe734a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:22.761746 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37f44223-a3ef-427d-9786-139abfe734a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:22.893811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-37f44223-a3ef-427d-9786-139abfe734a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:22.902109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-37f44223-a3ef-427d-9786-139abfe734a8 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1363 microversion: 2.1 time: 0.158747 Sep 13 20:27:22.902736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1289/2657] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:22 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:23.925893 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-35361367-bc32-460c-b2b3-75e242621163 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:23.926714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-35361367-bc32-460c-b2b3-75e242621163 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:23.929128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=6 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:23.935216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35361367-bc32-460c-b2b3-75e242621163 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:23.935691 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35361367-bc32-460c-b2b3-75e242621163 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:23.936122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35361367-bc32-460c-b2b3-75e242621163 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:23.936808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35361367-bc32-460c-b2b3-75e242621163 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:23.937255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35361367-bc32-460c-b2b3-75e242621163 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:23.937668 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-35361367-bc32-460c-b2b3-75e242621163 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:24.086285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-35361367-bc32-460c-b2b3-75e242621163 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:24.094609 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-35361367-bc32-460c-b2b3-75e242621163 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1549 microversion: 2.1 time: 0.172916 Sep 13 20:27:24.095104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1369/2658] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:23 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:24.116992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a9c43f80-6923-46b5-be7f-b5859cbac752 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:24.117500 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a9c43f80-6923-46b5-be7f-b5859cbac752 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:24.119349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:24.120040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=6 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:24.126694 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9c43f80-6923-46b5-be7f-b5859cbac752 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:24.127175 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9c43f80-6923-46b5-be7f-b5859cbac752 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:24.127612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9c43f80-6923-46b5-be7f-b5859cbac752 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:24.128297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9c43f80-6923-46b5-be7f-b5859cbac752 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:24.128744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9c43f80-6923-46b5-be7f-b5859cbac752 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:24.129227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9c43f80-6923-46b5-be7f-b5859cbac752 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:24.206299 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a9c43f80-6923-46b5-be7f-b5859cbac752 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093155 Sep 13 20:27:24.206906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1290/2659] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 13 20:27:24 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:27:25.402191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-a5ac8086-8948-44cc-a8df-87dc24b97887 req-9533943e-c5ba-4920-b7e8-98fe87a8bcc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b", "tag": "f7274628-4d52-46a0-8ffc-461979557405"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:27:25.412105 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-a5ac8086-8948-44cc-a8df-87dc24b97887 req-9533943e-c5ba-4920-b7e8-98fe87a8bcc2 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:25.412575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-a5ac8086-8948-44cc-a8df-87dc24b97887 req-9533943e-c5ba-4920-b7e8-98fe87a8bcc2 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:25.413004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-a5ac8086-8948-44cc-a8df-87dc24b97887 req-9533943e-c5ba-4920-b7e8-98fe87a8bcc2 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:25.424294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-a5ac8086-8948-44cc-a8df-87dc24b97887 req-9533943e-c5ba-4920-b7e8-98fe87a8bcc2 service nova] Creating event network-changed:f7274628-4d52-46a0-8ffc-461979557405 for instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b on hv-cinder-85427 Sep 13 20:27:25.429743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-a5ac8086-8948-44cc-a8df-87dc24b97887 req-9533943e-c5ba-4920-b7e8-98fe87a8bcc2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081279 Sep 13 20:27:25.430618 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1370/2660] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:28:01.278298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=9 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:28:01.279696 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=21 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:28:01.287657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-23fa12e0-387e-42ec-bdb4-609d300f4c72 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:28:01.288378 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-23fa12e0-387e-42ec-bdb4-609d300f4c72 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:28:01.295450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23fa12e0-387e-42ec-bdb4-609d300f4c72 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:28:01.295926 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23fa12e0-387e-42ec-bdb4-609d300f4c72 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:28:01.296361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23fa12e0-387e-42ec-bdb4-609d300f4c72 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:28:01.297038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23fa12e0-387e-42ec-bdb4-609d300f4c72 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:28:01.297483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23fa12e0-387e-42ec-bdb4-609d300f4c72 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:28:01.297906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-23fa12e0-387e-42ec-bdb4-609d300f4c72 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:28:01.321011 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-23fa12e0-387e-42ec-bdb4-609d300f4c72 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b/ips" status: 200 len: 145 microversion: 2.1 time: 0.045250 Sep 13 20:28:01.321563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1291/2661] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 13 20:28:01 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:29:01.401835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=7 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:29:01.403082 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=39 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:29:01.410332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-303aff43-a4b3-4ff4-8fb5-7248f64a6550 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:01.410934 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-303aff43-a4b3-4ff4-8fb5-7248f64a6550 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:01.418146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-303aff43-a4b3-4ff4-8fb5-7248f64a6550 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:01.418650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-303aff43-a4b3-4ff4-8fb5-7248f64a6550 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:01.419069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-303aff43-a4b3-4ff4-8fb5-7248f64a6550 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:01.419746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-303aff43-a4b3-4ff4-8fb5-7248f64a6550 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:01.420195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-303aff43-a4b3-4ff4-8fb5-7248f64a6550 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:01.420617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-303aff43-a4b3-4ff4-8fb5-7248f64a6550 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:01.446465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-303aff43-a4b3-4ff4-8fb5-7248f64a6550 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Going to try to terminate instance {{(pid=120844) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:29:01.528479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-303aff43-a4b3-4ff4-8fb5-7248f64a6550 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 204 len: 0 microversion: 2.1 time: 0.129683 Sep 13 20:29:01.529308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1371/2662] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:29:01 2022] DELETE /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:29:01.536218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:29:01.536984 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=4 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:29:01.541150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4d14e1bb-8b09-453f-afcc-ac55966df4fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:01.541765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4d14e1bb-8b09-453f-afcc-ac55966df4fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:01.548537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d14e1bb-8b09-453f-afcc-ac55966df4fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:01.549020 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d14e1bb-8b09-453f-afcc-ac55966df4fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:01.549558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d14e1bb-8b09-453f-afcc-ac55966df4fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:01.550244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d14e1bb-8b09-453f-afcc-ac55966df4fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:01.550733 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d14e1bb-8b09-453f-afcc-ac55966df4fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:01.551154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4d14e1bb-8b09-453f-afcc-ac55966df4fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:01.681889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4d14e1bb-8b09-453f-afcc-ac55966df4fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:01.689815 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4d14e1bb-8b09-453f-afcc-ac55966df4fe tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1673 microversion: 2.1 time: 0.155873 Sep 13 20:29:01.690397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1292/2663] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:29:01 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:29:02.720031 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-91334964-5463-4523-8f0c-e9c3d0385364 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:02.721336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-91334964-5463-4523-8f0c-e9c3d0385364 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:02.728581 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91334964-5463-4523-8f0c-e9c3d0385364 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:02.729061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91334964-5463-4523-8f0c-e9c3d0385364 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:02.729496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91334964-5463-4523-8f0c-e9c3d0385364 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:02.730184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91334964-5463-4523-8f0c-e9c3d0385364 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:02.730669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91334964-5463-4523-8f0c-e9c3d0385364 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:02.731092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91334964-5463-4523-8f0c-e9c3d0385364 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:03.104941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-91334964-5463-4523-8f0c-e9c3d0385364 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:03.113012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-91334964-5463-4523-8f0c-e9c3d0385364 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1673 microversion: 2.1 time: 0.400242 Sep 13 20:29:03.113594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1372/2664] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:29:02 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1673 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:29:03.743348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-87ca2b1c-5d02-4f51-9ec3-2d98ca7381c8 req-06410b94-578b-47e3-8db3-572c5e5b0b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b", "name": "network-vif-deleted", "tag": "f7274628-4d52-46a0-8ffc-461979557405"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:29:03.757395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-87ca2b1c-5d02-4f51-9ec3-2d98ca7381c8 req-06410b94-578b-47e3-8db3-572c5e5b0b5f service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:03.758335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-87ca2b1c-5d02-4f51-9ec3-2d98ca7381c8 req-06410b94-578b-47e3-8db3-572c5e5b0b5f service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:03.758814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-87ca2b1c-5d02-4f51-9ec3-2d98ca7381c8 req-06410b94-578b-47e3-8db3-572c5e5b0b5f service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:03.773570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-87ca2b1c-5d02-4f51-9ec3-2d98ca7381c8 req-06410b94-578b-47e3-8db3-572c5e5b0b5f service nova] Creating event network-vif-deleted:f7274628-4d52-46a0-8ffc-461979557405 for instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b on hv-cinder-85427 Sep 13 20:29:03.779865 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-87ca2b1c-5d02-4f51-9ec3-2d98ca7381c8 req-06410b94-578b-47e3-8db3-572c5e5b0b5f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040566 Sep 13 20:29:03.780475 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1293/2665] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:29:04.136582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:04.137147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:04.144093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:04.144574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:04.145004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:04.145693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:04.146142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:04.146631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:04.178287 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:04.178793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:04.179517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:04.179965 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lazy-loading 'fault' on Instance uuid 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:29:04.221028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c4f9c4b9334b66ac89e01a278436bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fa762826924accaa8012d7ceaf17eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:04.229109 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4037d841-0363-40cc-aaeb-be677bdcb2c4 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 200 len: 1328 microversion: 2.1 time: 0.096609 Sep 13 20:29:04.229684 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1373/2666] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:29:04 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:29:05.257402 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ab8d64a8-6901-4712-8cc3-5c9606eb601a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:05.258204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ab8d64a8-6901-4712-8cc3-5c9606eb601a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:05.266555 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab8d64a8-6901-4712-8cc3-5c9606eb601a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:05.267118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab8d64a8-6901-4712-8cc3-5c9606eb601a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:05.267630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab8d64a8-6901-4712-8cc3-5c9606eb601a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:05.268440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab8d64a8-6901-4712-8cc3-5c9606eb601a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:05.269006 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab8d64a8-6901-4712-8cc3-5c9606eb601a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:05.269415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ab8d64a8-6901-4712-8cc3-5c9606eb601a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:05.282913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-ab8d64a8-6901-4712-8cc3-5c9606eb601a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] HTTP exception thrown: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ab8d64a8-6901-4712-8cc3-5c9606eb601a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Request method failure captured: Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b HTTP/1.1 Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOE8Mqk-IFhs0_Cf8CByqrzJ7U1fYDMUoNoXMaWM3G8zlpMzNH3OAeKkbk_zSN_QIujQ03FlgID1zQOvGdarkXTVNZ7oCTeu15uB51_9nWL3Sr1SmORESaFOLuKjHMvA9pXOdKxvp5483kAQRYJ7zrFgLLZiDq48UsFb01eNaeaPz3c Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: b3fa762826924accaa8012d7ceaf17eb Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:29:05.284551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:29:05.285893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b3fa762826924accaa8012d7ceaf17eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b3fa762826924accaa8012d7ceaf17eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3fa762826924accaa8012d7ceaf17eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3fa762826924accaa8012d7ceaf17eb"}]}] Sep 13 20:29:05.285893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:29:05.285893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: b3fa762826924accaa8012d7ceaf17eb Sep 13 20:29:05.285893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:29:05.285893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-AttachVolumeTestJSON-62978129-project Sep 13 20:29:05.285893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:29:05.285893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:29:05.285893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 87c4f9c4b9334b66ac89e01a278436bc Sep 13 20:29:05.285893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-AttachVolumeTestJSON-62978129-project Sep 13 20:29:05.285893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:29:05.285893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:05.285893 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b'} Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:29:05.286900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:05.288263 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:05.289580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ab8d64a8-6901-4712-8cc3-5c9606eb601a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Returning 404 to user: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:29:05.289580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ab8d64a8-6901-4712-8cc3-5c9606eb601a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 404 len: 111 microversion: 2.1 time: 0.034140 Sep 13 20:29:05.289580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1294/2667] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:29:05 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:29:05.295011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c4ac5cad-15c3-43b6-ae4c-ff5e70467bcd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '.version_select at 0x7f9846746160>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:05.318354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c4ac5cad-15c3-43b6-ae4c-ff5e70467bcd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1404074111" status: 202 len: 0 microversion: 2.1 time: 0.027183 Sep 13 20:29:05.318943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1374/2668] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 13 20:29:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1404074111 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:29:05.949127 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-70322361-d878-4698-8be9-509f16a791bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:05.949678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-70322361-d878-4698-8be9-509f16a791bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:05.955781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70322361-d878-4698-8be9-509f16a791bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:05.956282 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70322361-d878-4698-8be9-509f16a791bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:05.956713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70322361-d878-4698-8be9-509f16a791bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:05.957390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70322361-d878-4698-8be9-509f16a791bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:05.957834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70322361-d878-4698-8be9-509f16a791bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:05.958262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-70322361-d878-4698-8be9-509f16a791bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:05.971824 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-70322361-d878-4698-8be9-509f16a791bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] HTTP exception thrown: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-70322361-d878-4698-8be9-509f16a791bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Request method failure captured: Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: DELETE /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b HTTP/1.1 Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOE8Mqk-IFhs0_Cf8CByqrzJ7U1fYDMUoNoXMaWM3G8zlpMzNH3OAeKkbk_zSN_QIujQ03FlgID1zQOvGdarkXTVNZ7oCTeu15uB51_9nWL3Sr1SmORESaFOLuKjHMvA9pXOdKxvp5483kAQRYJ7zrFgLLZiDq48UsFb01eNaeaPz3c Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: b3fa762826924accaa8012d7ceaf17eb Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:29:05.973407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:29:05.974644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b3fa762826924accaa8012d7ceaf17eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b3fa762826924accaa8012d7ceaf17eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3fa762826924accaa8012d7ceaf17eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3fa762826924accaa8012d7ceaf17eb"}]}] Sep 13 20:29:05.974644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:29:05.974644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: b3fa762826924accaa8012d7ceaf17eb Sep 13 20:29:05.974644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:29:05.974644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-AttachVolumeTestJSON-62978129-project Sep 13 20:29:05.974644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:29:05.974644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:29:05.974644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 87c4f9c4b9334b66ac89e01a278436bc Sep 13 20:29:05.974644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-AttachVolumeTestJSON-62978129-project Sep 13 20:29:05.974644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:29:05.974644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:05.974644 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b'} Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:29:05.975343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:05.976445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:05.977626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-70322361-d878-4698-8be9-509f16a791bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Returning 404 to user: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:29:05.977626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-70322361-d878-4698-8be9-509f16a791bd tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 404 len: 111 microversion: 2.1 time: 0.029974 Sep 13 20:29:05.977626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1295/2669] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:29:05 2022] DELETE /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:29:05.983431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-31f53b7e-a0a9-48a9-a21d-01b1949585ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:05.984039 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-31f53b7e-a0a9-48a9-a21d-01b1949585ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:05.990967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31f53b7e-a0a9-48a9-a21d-01b1949585ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:05.991438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31f53b7e-a0a9-48a9-a21d-01b1949585ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:05.991866 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31f53b7e-a0a9-48a9-a21d-01b1949585ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:05.992544 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31f53b7e-a0a9-48a9-a21d-01b1949585ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:05.993006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31f53b7e-a0a9-48a9-a21d-01b1949585ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:05.993406 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-31f53b7e-a0a9-48a9-a21d-01b1949585ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:06.006771 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-31f53b7e-a0a9-48a9-a21d-01b1949585ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] HTTP exception thrown: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-31f53b7e-a0a9-48a9-a21d-01b1949585ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Request method failure captured: Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b HTTP/1.1 Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOE8Mqk-IFhs0_Cf8CByqrzJ7U1fYDMUoNoXMaWM3G8zlpMzNH3OAeKkbk_zSN_QIujQ03FlgID1zQOvGdarkXTVNZ7oCTeu15uB51_9nWL3Sr1SmORESaFOLuKjHMvA9pXOdKxvp5483kAQRYJ7zrFgLLZiDq48UsFb01eNaeaPz3c Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: b3fa762826924accaa8012d7ceaf17eb Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:29:06.008403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:29:06.009638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b3fa762826924accaa8012d7ceaf17eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b3fa762826924accaa8012d7ceaf17eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3fa762826924accaa8012d7ceaf17eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3fa762826924accaa8012d7ceaf17eb"}]}] Sep 13 20:29:06.009638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:29:06.009638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: b3fa762826924accaa8012d7ceaf17eb Sep 13 20:29:06.009638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:29:06.009638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeTestJSON-62978129-project Sep 13 20:29:06.009638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:29:06.009638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:29:06.009638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 87c4f9c4b9334b66ac89e01a278436bc Sep 13 20:29:06.009638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeTestJSON-62978129-project Sep 13 20:29:06.009638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:29:06.009638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:06.009638 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b'} Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:29:06.010330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. Sep 13 20:29:06.011564 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:29:06.012657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-31f53b7e-a0a9-48a9-a21d-01b1949585ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Returning 404 to user: Instance 5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:29:06.012657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-31f53b7e-a0a9-48a9-a21d-01b1949585ec tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b" status: 404 len: 111 microversion: 2.1 time: 0.030272 Sep 13 20:29:06.012975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1375/2670] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:29:05 2022] GET /compute/v2.1/servers/5cac94ed-d08d-4c9d-9bf9-8d1972fb7e9b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:29:26.840870 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2601a2f8-b892-488a-ba1f-a184e0a520c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:26.841399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2601a2f8-b892-488a-ba1f-a184e0a520c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:26.844211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=8 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:29:26.844913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=12 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:29:26.850402 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2601a2f8-b892-488a-ba1f-a184e0a520c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:26.850889 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2601a2f8-b892-488a-ba1f-a184e0a520c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:26.851319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2601a2f8-b892-488a-ba1f-a184e0a520c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:26.852046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2601a2f8-b892-488a-ba1f-a184e0a520c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:26.852490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2601a2f8-b892-488a-ba1f-a184e0a520c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:26.852910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2601a2f8-b892-488a-ba1f-a184e0a520c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:26.885735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c73d1b49-16ba-440f-beca-52cf97369ef9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:26.886361 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c73d1b49-16ba-440f-beca-52cf97369ef9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:26.890120 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2601a2f8-b892-488a-ba1f-a184e0a520c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Going to try to terminate instance {{(pid=120845) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:29:26.892156 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:29:26.893117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:29:26.894967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c73d1b49-16ba-440f-beca-52cf97369ef9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:26.895991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c73d1b49-16ba-440f-beca-52cf97369ef9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:26.896675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c73d1b49-16ba-440f-beca-52cf97369ef9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:26.897827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c73d1b49-16ba-440f-beca-52cf97369ef9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:26.898474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c73d1b49-16ba-440f-beca-52cf97369ef9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:26.899048 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c73d1b49-16ba-440f-beca-52cf97369ef9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:26.931924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c73d1b49-16ba-440f-beca-52cf97369ef9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Going to try to terminate instance {{(pid=120844) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:29:26.977964 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2601a2f8-b892-488a-ba1f-a184e0a520c2 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 204 len: 0 microversion: 2.1 time: 0.140941 Sep 13 20:29:26.979275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1296/2671] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:29:26 2022] DELETE /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:29:26.989602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a4136d68-4b4b-497f-bee7-db4e24688f07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:26.990684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a4136d68-4b4b-497f-bee7-db4e24688f07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:26.998198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a4136d68-4b4b-497f-bee7-db4e24688f07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:26.998777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a4136d68-4b4b-497f-bee7-db4e24688f07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:26.999254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a4136d68-4b4b-497f-bee7-db4e24688f07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:26.999951 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a4136d68-4b4b-497f-bee7-db4e24688f07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:27.000397 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a4136d68-4b4b-497f-bee7-db4e24688f07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:27.000859 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a4136d68-4b4b-497f-bee7-db4e24688f07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:27.015591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c73d1b49-16ba-440f-beca-52cf97369ef9 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "DELETE /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 204 len: 0 microversion: 2.20 time: 0.133506 Sep 13 20:29:27.016180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1376/2672] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 13 20:29:26 2022] DELETE /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 20:29:27.024860 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6ed8fece-f290-4627-a861-c2b77c54eb8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:27.025549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6ed8fece-f290-4627-a861-c2b77c54eb8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:27.031453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6ed8fece-f290-4627-a861-c2b77c54eb8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:27.031931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6ed8fece-f290-4627-a861-c2b77c54eb8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:27.032362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6ed8fece-f290-4627-a861-c2b77c54eb8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:27.033042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6ed8fece-f290-4627-a861-c2b77c54eb8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:27.033505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6ed8fece-f290-4627-a861-c2b77c54eb8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:27.033907 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6ed8fece-f290-4627-a861-c2b77c54eb8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:27.139394 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a4136d68-4b4b-497f-bee7-db4e24688f07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:27.147543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a4136d68-4b4b-497f-bee7-db4e24688f07 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1507 microversion: 2.1 time: 0.163804 Sep 13 20:29:27.148111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1297/2673] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:29:26 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:29:27.172466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6ed8fece-f290-4627-a861-c2b77c54eb8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:27.180688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6ed8fece-f290-4627-a861-c2b77c54eb8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:27.182118 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6ed8fece-f290-4627-a861-c2b77c54eb8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:27.183312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6ed8fece-f290-4627-a861-c2b77c54eb8d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 200 len: 1722 microversion: 2.20 time: 0.162564 Sep 13 20:29:27.183872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1377/2674] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:29:27 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:29:28.170739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f3ef80ed-9077-493e-a784-dd70478c8d61 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:28.171692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f3ef80ed-9077-493e-a784-dd70478c8d61 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:28.179539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3ef80ed-9077-493e-a784-dd70478c8d61 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:28.180186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3ef80ed-9077-493e-a784-dd70478c8d61 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:28.180728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3ef80ed-9077-493e-a784-dd70478c8d61 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:28.181711 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3ef80ed-9077-493e-a784-dd70478c8d61 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:28.182297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3ef80ed-9077-493e-a784-dd70478c8d61 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:28.182837 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f3ef80ed-9077-493e-a784-dd70478c8d61 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:28.208580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6cea2f23-eea6-4a60-a86b-d8e1b7ff7f1b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:28.209176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6cea2f23-eea6-4a60-a86b-d8e1b7ff7f1b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:28.216470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cea2f23-eea6-4a60-a86b-d8e1b7ff7f1b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:28.217276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cea2f23-eea6-4a60-a86b-d8e1b7ff7f1b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:28.217925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cea2f23-eea6-4a60-a86b-d8e1b7ff7f1b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:28.219069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cea2f23-eea6-4a60-a86b-d8e1b7ff7f1b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:28.219856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cea2f23-eea6-4a60-a86b-d8e1b7ff7f1b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:28.220475 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cea2f23-eea6-4a60-a86b-d8e1b7ff7f1b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:28.316758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f3ef80ed-9077-493e-a784-dd70478c8d61 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:28.342720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f3ef80ed-9077-493e-a784-dd70478c8d61 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 200 len: 1465 microversion: 2.1 time: 0.175873 Sep 13 20:29:28.359525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1298/2675] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:29:28 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 1465 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:29:28.364851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-aef3d47a-7e22-47a6-8562-ee219410712c req-eb3950f1-985d-443e-88c8-49ec8f89175a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fd2dce-024b-45c3-add3-01474a42c86f", "name": "network-vif-deleted", "tag": "60931cbe-66dd-401a-834f-6790eb3724c0"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:29:28.375706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-aef3d47a-7e22-47a6-8562-ee219410712c req-eb3950f1-985d-443e-88c8-49ec8f89175a service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:28.376353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-aef3d47a-7e22-47a6-8562-ee219410712c req-eb3950f1-985d-443e-88c8-49ec8f89175a service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:28.376961 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-aef3d47a-7e22-47a6-8562-ee219410712c req-eb3950f1-985d-443e-88c8-49ec8f89175a service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:28.386624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6cea2f23-eea6-4a60-a86b-d8e1b7ff7f1b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:28.393080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-aef3d47a-7e22-47a6-8562-ee219410712c req-eb3950f1-985d-443e-88c8-49ec8f89175a service nova] Creating event network-vif-deleted:60931cbe-66dd-401a-834f-6790eb3724c0 for instance e0fd2dce-024b-45c3-add3-01474a42c86f on hv-cinder-85427 Sep 13 20:29:28.398571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-aef3d47a-7e22-47a6-8562-ee219410712c req-eb3950f1-985d-443e-88c8-49ec8f89175a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037216 Sep 13 20:29:28.400080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1299/2676] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:29:28.402398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6cea2f23-eea6-4a60-a86b-d8e1b7ff7f1b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:28.404337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6cea2f23-eea6-4a60-a86b-d8e1b7ff7f1b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:28.405897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6cea2f23-eea6-4a60-a86b-d8e1b7ff7f1b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 200 len: 1722 microversion: 2.20 time: 0.201212 Sep 13 20:29:28.410404 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1378/2677] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:29:28 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:29:29.369948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-303411f1-d427-480c-a690-829c0681bcb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:29.370778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-303411f1-d427-480c-a690-829c0681bcb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: e0fd2dce-024b-45c3-add3-01474a42c86f] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:29.379932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-303411f1-d427-480c-a690-829c0681bcb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:29.380647 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-303411f1-d427-480c-a690-829c0681bcb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:29.381314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-303411f1-d427-480c-a690-829c0681bcb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:29.382050 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-303411f1-d427-480c-a690-829c0681bcb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:29.382628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-303411f1-d427-480c-a690-829c0681bcb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:29.383052 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-303411f1-d427-480c-a690-829c0681bcb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:29.396829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-303411f1-d427-480c-a690-829c0681bcb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] HTTP exception thrown: Instance e0fd2dce-024b-45c3-add3-01474a42c86f could not be found. Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-303411f1-d427-480c-a690-829c0681bcb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Request method failure captured: Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f HTTP/1.1 Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIODjpin5P12LMyIUegGlCoSGVMfXGu2Nxs3IFiIhuiJZDZclH8lXbMQoqdDqy_PWYg2k7m4QoAAHFfGmD7eQR3BJfmhy27yZk6YpUDgJpcQG4tV_vMnNwrcOcaFgXOAFqaDFEJ6wxipdPyiKiC0SUxZ_e28cOVQZnL1BQqEyYD6qS0Q Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: 23873d995d564c0388a4649e57821c69 Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1939790678 Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:29:29.398610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:29:29.400065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/23873d995d564c0388a4649e57821c69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_23873d995d564c0388a4649e57821c69", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/23873d995d564c0388a4649e57821c69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/23873d995d564c0388a4649e57821c69"}]}] Sep 13 20:29:29.400065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1939790678 Sep 13 20:29:29.400065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: 23873d995d564c0388a4649e57821c69 Sep 13 20:29:29.400065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1939790678 Sep 13 20:29:29.400065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-ServerRescueNegativeTestJSON-1939790678-project Sep 13 20:29:29.400065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:29:29.400065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:29:29.400065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 2577fc11946c4597857187ae7b464fe7 Sep 13 20:29:29.400065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1939790678-project Sep 13 20:29:29.400065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:29:29.400065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance e0fd2dce-024b-45c3-add3-01474a42c86f could not be found. Sep 13 20:29:29.400065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': 'e0fd2dce-024b-45c3-add3-01474a42c86f'} Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0fd2dce-024b-45c3-add3-01474a42c86f could not be found. Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:29:29.403901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0fd2dce-024b-45c3-add3-01474a42c86f could not be found. Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0fd2dce-024b-45c3-add3-01474a42c86f could not be found. Sep 13 20:29:29.405192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:29.406513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-303411f1-d427-480c-a690-829c0681bcb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Returning 404 to user: Instance e0fd2dce-024b-45c3-add3-01474a42c86f could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:29:29.406513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-303411f1-d427-480c-a690-829c0681bcb6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f" status: 404 len: 111 microversion: 2.1 time: 0.036879 Sep 13 20:29:29.406513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1300/2678] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:29:29 2022] GET /compute/v2.1/servers/e0fd2dce-024b-45c3-add3-01474a42c86f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:29:29.409200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dd44d8c0-59ef-4aa7-b6ef-05e808d04552 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:29.409841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dd44d8c0-59ef-4aa7-b6ef-05e808d04552 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:29.416261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd44d8c0-59ef-4aa7-b6ef-05e808d04552 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:29.416761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd44d8c0-59ef-4aa7-b6ef-05e808d04552 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:29.417170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd44d8c0-59ef-4aa7-b6ef-05e808d04552 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:29.417862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd44d8c0-59ef-4aa7-b6ef-05e808d04552 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:29.418307 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd44d8c0-59ef-4aa7-b6ef-05e808d04552 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:29.418770 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dd44d8c0-59ef-4aa7-b6ef-05e808d04552 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:29.432505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:29.434319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:29.444355 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:29.445045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:29.445598 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:29.446358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:29.447523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:29.448601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:29.449865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dd44d8c0-59ef-4aa7-b6ef-05e808d04552 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Going to try to terminate instance {{(pid=120844) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:29:29.488906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:29.489394 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:29.490295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:29.490477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.objects.instance [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lazy-loading 'fault' on Instance uuid 86eb3378-3f47-453b-a57e-31bf51583061 {{(pid=120845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:29:29.541699 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:29.551271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dd44d8c0-59ef-4aa7-b6ef-05e808d04552 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 204 len: 0 microversion: 2.1 time: 0.145463 Sep 13 20:29:29.552247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1379/2679] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:29:29 2022] DELETE /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:29:29.555363 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:29.556930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b07b8b251aaa456c9916c41f9a0b77e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc8b1b561f247ed84babfad941e55f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:29.558236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4f08aa9d-fa81-41cd-a793-224d9297e773 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 200 len: 1371 microversion: 2.20 time: 0.131545 Sep 13 20:29:29.571933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2e9d801a-dd08-4684-a0f9-d47a1f7f7ed6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:29.572145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1301/2680] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:29:29 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:29:29.573011 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2e9d801a-dd08-4684-a0f9-d47a1f7f7ed6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:29.579611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e9d801a-dd08-4684-a0f9-d47a1f7f7ed6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:29.580092 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e9d801a-dd08-4684-a0f9-d47a1f7f7ed6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:29.580567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e9d801a-dd08-4684-a0f9-d47a1f7f7ed6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:29.581263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e9d801a-dd08-4684-a0f9-d47a1f7f7ed6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:29.581710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e9d801a-dd08-4684-a0f9-d47a1f7f7ed6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:29.582124 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2e9d801a-dd08-4684-a0f9-d47a1f7f7ed6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:29.719853 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2e9d801a-dd08-4684-a0f9-d47a1f7f7ed6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:29.728219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2e9d801a-dd08-4684-a0f9-d47a1f7f7ed6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1521 microversion: 2.1 time: 0.169877 Sep 13 20:29:29.729004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1380/2681] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:29:29 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:29:30.416900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-177269d1-d6ab-47ff-adc8-13a5a014edb4 req-51301687-178e-412f-be90-8f6c1f172ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86eb3378-3f47-453b-a57e-31bf51583061", "name": "network-vif-deleted", "tag": "c0cafb63-b9f5-44ae-b8cb-42f30f6ca9c9"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:29:30.427517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-177269d1-d6ab-47ff-adc8-13a5a014edb4 req-51301687-178e-412f-be90-8f6c1f172ec7 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:30.427995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-177269d1-d6ab-47ff-adc8-13a5a014edb4 req-51301687-178e-412f-be90-8f6c1f172ec7 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:30.428549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-177269d1-d6ab-47ff-adc8-13a5a014edb4 req-51301687-178e-412f-be90-8f6c1f172ec7 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:30.440084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-177269d1-d6ab-47ff-adc8-13a5a014edb4 req-51301687-178e-412f-be90-8f6c1f172ec7 service nova] Creating event network-vif-deleted:c0cafb63-b9f5-44ae-b8cb-42f30f6ca9c9 for instance 86eb3378-3f47-453b-a57e-31bf51583061 on hv-cinder-85427 Sep 13 20:29:30.445196 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-177269d1-d6ab-47ff-adc8-13a5a014edb4 req-51301687-178e-412f-be90-8f6c1f172ec7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032445 Sep 13 20:29:30.445794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1302/2682] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:29:30.585128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f5277d69-fb96-475b-bac6-501a7ed73fa4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:30.586162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f5277d69-fb96-475b-bac6-501a7ed73fa4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:30.593514 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5277d69-fb96-475b-bac6-501a7ed73fa4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:30.594181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5277d69-fb96-475b-bac6-501a7ed73fa4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:30.594631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5277d69-fb96-475b-bac6-501a7ed73fa4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:30.595317 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5277d69-fb96-475b-bac6-501a7ed73fa4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:30.595758 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5277d69-fb96-475b-bac6-501a7ed73fa4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:30.596192 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f5277d69-fb96-475b-bac6-501a7ed73fa4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:30.611239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-f5277d69-fb96-475b-bac6-501a7ed73fa4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] HTTP exception thrown: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f5277d69-fb96-475b-bac6-501a7ed73fa4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Request method failure captured: Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 HTTP/1.1 Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIODidLRoRmcjg7W6PrVDX3azn8wN_DgqcJ1XeErPIodK6DRBoSHefF9pi_H8_pumHuSJq83GYzd--3H2QSDYEHtV_dhV-TkRchCLv9McxRRshkC0rH-qkkhNj5UsAfgHIAdNzvGDHfcPdP2cCsaYCie94FHs76UkRw0szdCgh5CRomw Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: fdc8b1b561f247ed84babfad941e55f6 Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:29:30.613616 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:29:30.614876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdc8b1b561f247ed84babfad941e55f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdc8b1b561f247ed84babfad941e55f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdc8b1b561f247ed84babfad941e55f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdc8b1b561f247ed84babfad941e55f6"}]}] Sep 13 20:29:30.614876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:29:30.614876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: fdc8b1b561f247ed84babfad941e55f6 Sep 13 20:29:30.614876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:29:30.614876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeShelveTestJSON-1922037285-project Sep 13 20:29:30.614876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:29:30.614876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:29:30.614876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: b07b8b251aaa456c9916c41f9a0b77e3 Sep 13 20:29:30.614876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1922037285-project Sep 13 20:29:30.614876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:29:30.614876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:29:30.614876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '86eb3378-3f47-453b-a57e-31bf51583061'} Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:29:30.615527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:29:30.616501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:29:30.617472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f5277d69-fb96-475b-bac6-501a7ed73fa4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Returning 404 to user: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:29:30.617472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f5277d69-fb96-475b-bac6-501a7ed73fa4 tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 404 len: 111 microversion: 2.20 time: 0.034833 Sep 13 20:29:30.617472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1381/2683] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:29:30 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:29:30.625281 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0a91202e-96fc-461d-adb5-2aa42fcf618b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '.version_select at 0x7f9849cca790>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:30.645453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0a91202e-96fc-461d-adb5-2aa42fcf618b tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417471735" status: 204 len: 0 microversion: 2.20 time: 0.024876 Sep 13 20:29:30.646268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1303/2684] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 13 20:29:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417471735 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 20:29:30.751379 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:30.751987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:30.760238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:30.760936 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:30.761547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:30.762579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:30.763175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:30.763744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:30.816646 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:30.817253 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:30.817802 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:30.818346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lazy-loading 'fault' on Instance uuid 1188b80c-75f7-4d0e-a43b-4f1285e63a69 {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:29:30.890669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2577fc11946c4597857187ae7b464fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23873d995d564c0388a4649e57821c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:29:30.899043 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-76efe18f-6886-450a-b0a5-220a138391d6 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 200 len: 1312 microversion: 2.1 time: 0.151870 Sep 13 20:29:30.899742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1382/2685] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:29:30 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:29:31.926460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-64de55f9-7d81-4219-aeb2-b0aed90f12d7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:29:31.927719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-64de55f9-7d81-4219-aeb2-b0aed90f12d7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] [instance: 1188b80c-75f7-4d0e-a43b-4f1285e63a69] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:29:31.937614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-64de55f9-7d81-4219-aeb2-b0aed90f12d7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:31.938092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-64de55f9-7d81-4219-aeb2-b0aed90f12d7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:31.938556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-64de55f9-7d81-4219-aeb2-b0aed90f12d7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:31.939265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-64de55f9-7d81-4219-aeb2-b0aed90f12d7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:31.939737 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-64de55f9-7d81-4219-aeb2-b0aed90f12d7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:31.940112 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-64de55f9-7d81-4219-aeb2-b0aed90f12d7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:32.116408 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-64de55f9-7d81-4219-aeb2-b0aed90f12d7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] HTTP exception thrown: Instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 could not be found. Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-64de55f9-7d81-4219-aeb2-b0aed90f12d7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Request method failure captured: Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 HTTP/1.1 Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIODjpin5P12LMyIUegGlCoSGVMfXGu2Nxs3IFiIhuiJZDZclH8lXbMQoqdDqy_PWYg2k7m4QoAAHFfGmD7eQR3BJfmhy27yZk6YpUDgJpcQG4tV_vMnNwrcOcaFgXOAFqaDFEJ6wxipdPyiKiC0SUxZ_e28cOVQZnL1BQqEyYD6qS0Q Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: 23873d995d564c0388a4649e57821c69 Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1939790678 Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:29:32.118130 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:29:32.119442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/23873d995d564c0388a4649e57821c69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_23873d995d564c0388a4649e57821c69", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/23873d995d564c0388a4649e57821c69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/23873d995d564c0388a4649e57821c69"}]}] Sep 13 20:29:32.119442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1939790678 Sep 13 20:29:32.119442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: 23873d995d564c0388a4649e57821c69 Sep 13 20:29:32.119442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1939790678 Sep 13 20:29:32.119442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-ServerRescueNegativeTestJSON-1939790678-project Sep 13 20:29:32.119442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:29:32.119442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:29:32.119442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 2577fc11946c4597857187ae7b464fe7 Sep 13 20:29:32.119442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1939790678-project Sep 13 20:29:32.119442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:29:32.119442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 could not be found. Sep 13 20:29:32.119442 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '1188b80c-75f7-4d0e-a43b-4f1285e63a69'} Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 could not be found. Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:29:32.120212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 could not be found. Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 could not be found. Sep 13 20:29:32.121571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:29:32.123356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-64de55f9-7d81-4219-aeb2-b0aed90f12d7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] Returning 404 to user: Instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:29:32.123356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-64de55f9-7d81-4219-aeb2-b0aed90f12d7 tempest-ServerRescueNegativeTestJSON-1939790678 tempest-ServerRescueNegativeTestJSON-1939790678-project] 10.222.0.52 "GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69" status: 404 len: 111 microversion: 2.1 time: 0.200615 Sep 13 20:29:32.123356 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1304/2686] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:29:31 2022] GET /compute/v2.1/servers/1188b80c-75f7-4d0e-a43b-4f1285e63a69 => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:29:32.464387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-20012d2f-d597-4148-a973-42e77ac517b5 req-9735d207-da6f-49ff-8a68-b8becfbe294f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1188b80c-75f7-4d0e-a43b-4f1285e63a69", "name": "network-vif-deleted", "tag": "472b58b8-c20c-4b18-bc4b-7be000f86805"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:29:32.476595 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-20012d2f-d597-4148-a973-42e77ac517b5 req-9735d207-da6f-49ff-8a68-b8becfbe294f service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:29:32.477070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-20012d2f-d597-4148-a973-42e77ac517b5 req-9735d207-da6f-49ff-8a68-b8becfbe294f service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:29:32.477531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-20012d2f-d597-4148-a973-42e77ac517b5 req-9735d207-da6f-49ff-8a68-b8becfbe294f service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:29:32.488831 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-20012d2f-d597-4148-a973-42e77ac517b5 req-9735d207-da6f-49ff-8a68-b8becfbe294f service nova] Creating event network-vif-deleted:472b58b8-c20c-4b18-bc4b-7be000f86805 for instance 1188b80c-75f7-4d0e-a43b-4f1285e63a69 on hv-cinder-85427 Sep 13 20:29:32.493985 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-20012d2f-d597-4148-a973-42e77ac517b5 req-9735d207-da6f-49ff-8a68-b8becfbe294f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033475 Sep 13 20:29:32.495141 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1383/2687] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:33:25.278570 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR oslo.messaging._drivers.impl_rabbit [-] [393e46d1-5232-4b1d-8df7-ab41d27fca40] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 20:33:25.284000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 20:33:25.284146 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:33:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 13 20:33:25.285650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 20:33:25.285650 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:33:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 13 20:33:25.286844 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:33:25.287131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:33:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 13 20:33:25.288236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:25.289830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:25.515896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-f7faf804-43f9-4d23-83de-a4a27935ad02 req-d5104176-4f1f-40c1-8de8-27f488e28385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de498757-f0f1-4f8b-a415-4d6b12f64d37", "name": "network-vif-deleted", "tag": "9aeccc5e-2b60-45ce-b5df-124a9dc9d3ac"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:33:25.525731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-f7faf804-43f9-4d23-83de-a4a27935ad02 req-d5104176-4f1f-40c1-8de8-27f488e28385 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:25.526310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-f7faf804-43f9-4d23-83de-a4a27935ad02 req-d5104176-4f1f-40c1-8de8-27f488e28385 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:25.526782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-f7faf804-43f9-4d23-83de-a4a27935ad02 req-d5104176-4f1f-40c1-8de8-27f488e28385 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:25.537601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-f7faf804-43f9-4d23-83de-a4a27935ad02 req-d5104176-4f1f-40c1-8de8-27f488e28385 service nova] Creating event network-vif-deleted:9aeccc5e-2b60-45ce-b5df-124a9dc9d3ac for instance de498757-f0f1-4f8b-a415-4d6b12f64d37 on hv-cinder-85427 Sep 13 20:33:25.543892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-f7faf804-43f9-4d23-83de-a4a27935ad02 req-d5104176-4f1f-40c1-8de8-27f488e28385 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267374 Sep 13 20:33:25.544895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1305/2688] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:34:45.351561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7030bbe-07db-45d4-874b-791cae3f5f37] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 20:34:45.352493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:34:45.353282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:34:45.354538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 20:34:45.354721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:34:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.52) !!! Sep 13 20:34:45.356302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 20:34:45.356458 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:34:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.52) !!! Sep 13 20:34:45.357504 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:34:45.357619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Tue Sep 13 20:34:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.52) !!! Sep 13 20:34:45.528008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-72367b61-7783-48aa-891a-99c043be493d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Action: 'create', calling method: .version_select at 0x7f9849dd7670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1825705146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcwwnzQj+gQ9f287XxsuJ5qcF0Mb/HhZzCPY3ymlOdIpO3fFfdAnSteJGmGzxV5/OtC5FojxYGRXGfwQ3qEyVM6jVY2Oso8QteTVpYQeZCkv7dchnrQl8dZDge/mEbyZA=="}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:34:45.546188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-72367b61-7783-48aa-891a-99c043be493d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Getting quotas for project 7878c5e6e1e143199681f42b5518cc1a. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:34:45.550900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-72367b61-7783-48aa-891a-99c043be493d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Getting quotas for user d20ba942c80848d7819aede8c0df1e7f and project 7878c5e6e1e143199681f42b5518cc1a. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:34:45.582881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-72367b61-7783-48aa-891a-99c043be493d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.233162 Sep 13 20:34:45.583492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1384/2689] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 13 20:34:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:35:01.976908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:01.977645 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:01.982393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1838564477", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1825705146", "security_groups": [{"name": "tempest-secgroup-smoke-1143406358"}], "block_device_mapping_v2": [{"uuid": "4f624eb4-0103-4241-9021-6b9eed2c2160", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd499434-1878-432b-bf48-fb9c3dc32248"}]}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:35:02.006424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] [393e46d1-5232-4b1d-8df7-ab41d27fca40] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 57432. Sep 13 20:35:02.204474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] validate_networks() for [('fd499434-1878-432b-bf48-fb9c3dc32248', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:35:02.715100 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:35:02.715528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:35:02.716007 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:35:02.716415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:35:02.716828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:35:02.726406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:02.726906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:02.727337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:02.728051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:02.728495 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:02.728907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:02.745723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Getting quotas for project 7878c5e6e1e143199681f42b5518cc1a. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:35:02.749878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Getting quotas for user d20ba942c80848d7819aede8c0df1e7f and project 7878c5e6e1e143199681f42b5518cc1a. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:35:02.808433 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:35:02.810708 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f624eb4-0103-4241-9021-6b9eed2c2160',volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:35:02.950988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e9c66200-2ea6-4a5f-83b2-ff5be8a5990c tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.975989 Sep 13 20:35:02.951668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1306/2690] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:35:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:35:02.961419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=4 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:02.962166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:02.966669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a4b248c8-2bc0-4eab-a17d-f1c11c609e20 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:02.967722 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a4b248c8-2bc0-4eab-a17d-f1c11c609e20 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:02.977833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7030bbe-07db-45d4-874b-791cae3f5f37] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 57452. Sep 13 20:35:03.098688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a4b248c8-2bc0-4eab-a17d-f1c11c609e20 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:03.106320 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a4b248c8-2bc0-4eab-a17d-f1c11c609e20 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1095 microversion: 2.1 time: 0.147413 Sep 13 20:35:03.106884 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1385/2691] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:02 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1095 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:04.128625 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-38b9c5cf-5f3f-45c4-96e8-1911ca85d4e0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:04.129254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-38b9c5cf-5f3f-45c4-96e8-1911ca85d4e0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:04.183518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-38b9c5cf-5f3f-45c4-96e8-1911ca85d4e0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:04.190343 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-38b9c5cf-5f3f-45c4-96e8-1911ca85d4e0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1095 microversion: 2.1 time: 0.065677 Sep 13 20:35:04.190927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1307/2692] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:04 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:05.220582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1e6bdaee-8c39-4b13-a485-baf34b33dd43 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:05.221224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1e6bdaee-8c39-4b13-a485-baf34b33dd43 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:05.275098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1e6bdaee-8c39-4b13-a485-baf34b33dd43 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:05.282768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1e6bdaee-8c39-4b13-a485-baf34b33dd43 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1095 microversion: 2.1 time: 0.066142 Sep 13 20:35:05.283298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1386/2693] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:05 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:06.309046 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-777ab9b1-0fb1-4241-a858-367770a9cbb4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:06.309610 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-777ab9b1-0fb1-4241-a858-367770a9cbb4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:06.374044 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-777ab9b1-0fb1-4241-a858-367770a9cbb4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:06.381235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-777ab9b1-0fb1-4241-a858-367770a9cbb4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1095 microversion: 2.1 time: 0.077734 Sep 13 20:35:06.381789 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1308/2694] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:06 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:07.408717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4522b270-b46f-4f2a-9d4d-4df72042df1e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:07.409563 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4522b270-b46f-4f2a-9d4d-4df72042df1e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:07.420706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4522b270-b46f-4f2a-9d4d-4df72042df1e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:07.421496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4522b270-b46f-4f2a-9d4d-4df72042df1e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:07.422218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4522b270-b46f-4f2a-9d4d-4df72042df1e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:07.423849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4522b270-b46f-4f2a-9d4d-4df72042df1e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:07.424602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4522b270-b46f-4f2a-9d4d-4df72042df1e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:07.425350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4522b270-b46f-4f2a-9d4d-4df72042df1e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:07.499357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4522b270-b46f-4f2a-9d4d-4df72042df1e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:07.507815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4522b270-b46f-4f2a-9d4d-4df72042df1e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1145 microversion: 2.1 time: 0.106050 Sep 13 20:35:07.508383 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1387/2695] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:07 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1145 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:08.531545 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-af53134e-f4e4-4779-b50f-8456cd34539d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:08.532156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-af53134e-f4e4-4779-b50f-8456cd34539d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:08.539450 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af53134e-f4e4-4779-b50f-8456cd34539d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:08.539940 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af53134e-f4e4-4779-b50f-8456cd34539d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:08.540373 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af53134e-f4e4-4779-b50f-8456cd34539d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:08.541069 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af53134e-f4e4-4779-b50f-8456cd34539d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:08.541560 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af53134e-f4e4-4779-b50f-8456cd34539d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:08.541987 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-af53134e-f4e4-4779-b50f-8456cd34539d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:08.632968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-af53134e-f4e4-4779-b50f-8456cd34539d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:08.640781 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-af53134e-f4e4-4779-b50f-8456cd34539d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1211 microversion: 2.1 time: 0.113289 Sep 13 20:35:08.641345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1309/2696] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:08 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:09.584501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-2bfb4a35-e0a1-4abd-bf1c-6547f681573a req-850f28ed-bdae-4b3a-8c65-5e0d79851a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fbe786d-befa-4ca2-a407-2f0236d91426", "tag": "f6387068-e330-4c79-a56a-cf69db784b16"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:35:09.597444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-2bfb4a35-e0a1-4abd-bf1c-6547f681573a req-850f28ed-bdae-4b3a-8c65-5e0d79851a79 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:09.597933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-2bfb4a35-e0a1-4abd-bf1c-6547f681573a req-850f28ed-bdae-4b3a-8c65-5e0d79851a79 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:09.598509 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-2bfb4a35-e0a1-4abd-bf1c-6547f681573a req-850f28ed-bdae-4b3a-8c65-5e0d79851a79 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:09.611165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-2bfb4a35-e0a1-4abd-bf1c-6547f681573a req-850f28ed-bdae-4b3a-8c65-5e0d79851a79 service nova] Creating event network-changed:f6387068-e330-4c79-a56a-cf69db784b16 for instance 6fbe786d-befa-4ca2-a407-2f0236d91426 on hv-cinder-85427 Sep 13 20:35:09.617859 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-2bfb4a35-e0a1-4abd-bf1c-6547f681573a req-850f28ed-bdae-4b3a-8c65-5e0d79851a79 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037880 Sep 13 20:35:09.618833 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1388/2697] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:35:09.665636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-733295bd-59ec-4727-9466-3315b4258e4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:09.666247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-733295bd-59ec-4727-9466-3315b4258e4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:09.672949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-733295bd-59ec-4727-9466-3315b4258e4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:09.673446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-733295bd-59ec-4727-9466-3315b4258e4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:09.673868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-733295bd-59ec-4727-9466-3315b4258e4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:09.674630 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-733295bd-59ec-4727-9466-3315b4258e4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:09.675080 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-733295bd-59ec-4727-9466-3315b4258e4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:09.675535 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-733295bd-59ec-4727-9466-3315b4258e4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:09.874458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-733295bd-59ec-4727-9466-3315b4258e4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:09.883254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-733295bd-59ec-4727-9466-3315b4258e4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1267 microversion: 2.1 time: 0.221794 Sep 13 20:35:09.883803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1310/2698] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:09 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:10.913015 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ce2b5628-6a1d-47f5-84f3-db76662e4cae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:10.914020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ce2b5628-6a1d-47f5-84f3-db76662e4cae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:10.924810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ce2b5628-6a1d-47f5-84f3-db76662e4cae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:10.925624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ce2b5628-6a1d-47f5-84f3-db76662e4cae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:10.926332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ce2b5628-6a1d-47f5-84f3-db76662e4cae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:10.927459 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ce2b5628-6a1d-47f5-84f3-db76662e4cae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:10.928196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ce2b5628-6a1d-47f5-84f3-db76662e4cae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:10.928888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ce2b5628-6a1d-47f5-84f3-db76662e4cae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:11.063513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ce2b5628-6a1d-47f5-84f3-db76662e4cae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:11.071913 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ce2b5628-6a1d-47f5-84f3-db76662e4cae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1267 microversion: 2.1 time: 0.167742 Sep 13 20:35:11.073710 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1389/2699] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:10 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:12.100629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bfcbbe6c-cbc7-4591-8c62-ec27216d1ac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:12.101556 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bfcbbe6c-cbc7-4591-8c62-ec27216d1ac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:12.109779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bfcbbe6c-cbc7-4591-8c62-ec27216d1ac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:12.110262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bfcbbe6c-cbc7-4591-8c62-ec27216d1ac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:12.110729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bfcbbe6c-cbc7-4591-8c62-ec27216d1ac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:12.111417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bfcbbe6c-cbc7-4591-8c62-ec27216d1ac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:12.111867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bfcbbe6c-cbc7-4591-8c62-ec27216d1ac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:12.112268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bfcbbe6c-cbc7-4591-8c62-ec27216d1ac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:12.246754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-bfcbbe6c-cbc7-4591-8c62-ec27216d1ac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:12.254931 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bfcbbe6c-cbc7-4591-8c62-ec27216d1ac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1267 microversion: 2.1 time: 0.160903 Sep 13 20:35:12.255461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1311/2700] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:12 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:13.280120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-12914d7c-efaa-44a2-88d8-81ebf5da3272 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:13.280826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-12914d7c-efaa-44a2-88d8-81ebf5da3272 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:13.287643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12914d7c-efaa-44a2-88d8-81ebf5da3272 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:13.288125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12914d7c-efaa-44a2-88d8-81ebf5da3272 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:13.288552 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12914d7c-efaa-44a2-88d8-81ebf5da3272 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:13.289239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12914d7c-efaa-44a2-88d8-81ebf5da3272 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:13.289667 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12914d7c-efaa-44a2-88d8-81ebf5da3272 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:13.290085 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12914d7c-efaa-44a2-88d8-81ebf5da3272 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:13.423747 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-12914d7c-efaa-44a2-88d8-81ebf5da3272 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:13.435445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-12914d7c-efaa-44a2-88d8-81ebf5da3272 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1267 microversion: 2.1 time: 0.160088 Sep 13 20:35:13.436233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1390/2701] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:13 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:14.462994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8f37878b-7c63-49c1-85e2-f4cccd5cbee5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:14.464064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8f37878b-7c63-49c1-85e2-f4cccd5cbee5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:14.466997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:14.476974 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f37878b-7c63-49c1-85e2-f4cccd5cbee5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:14.477774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f37878b-7c63-49c1-85e2-f4cccd5cbee5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:14.478541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f37878b-7c63-49c1-85e2-f4cccd5cbee5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:14.479695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f37878b-7c63-49c1-85e2-f4cccd5cbee5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:14.480441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f37878b-7c63-49c1-85e2-f4cccd5cbee5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:14.481169 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f37878b-7c63-49c1-85e2-f4cccd5cbee5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:14.624936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8f37878b-7c63-49c1-85e2-f4cccd5cbee5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:14.633143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8f37878b-7c63-49c1-85e2-f4cccd5cbee5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1267 microversion: 2.1 time: 0.176800 Sep 13 20:35:14.633706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1312/2702] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:14 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:15.660419 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bbab66ae-6e1c-4cbe-8c7e-83589e286794 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:15.661320 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bbab66ae-6e1c-4cbe-8c7e-83589e286794 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:15.665671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=4 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:15.672731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bbab66ae-6e1c-4cbe-8c7e-83589e286794 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:15.673251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bbab66ae-6e1c-4cbe-8c7e-83589e286794 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:15.673671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bbab66ae-6e1c-4cbe-8c7e-83589e286794 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:15.674350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bbab66ae-6e1c-4cbe-8c7e-83589e286794 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:15.674815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bbab66ae-6e1c-4cbe-8c7e-83589e286794 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:15.675223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bbab66ae-6e1c-4cbe-8c7e-83589e286794 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:15.811415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bbab66ae-6e1c-4cbe-8c7e-83589e286794 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:15.819751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bbab66ae-6e1c-4cbe-8c7e-83589e286794 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1267 microversion: 2.1 time: 0.165950 Sep 13 20:35:15.820365 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1391/2703] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:15 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:16.843028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e77270a6-660c-4cff-ae63-374d971e5ba0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:16.843635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e77270a6-660c-4cff-ae63-374d971e5ba0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:16.845965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=10 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:16.851830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e77270a6-660c-4cff-ae63-374d971e5ba0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:16.852307 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e77270a6-660c-4cff-ae63-374d971e5ba0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:16.852740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e77270a6-660c-4cff-ae63-374d971e5ba0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:16.853425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e77270a6-660c-4cff-ae63-374d971e5ba0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:16.853874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e77270a6-660c-4cff-ae63-374d971e5ba0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:16.854302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e77270a6-660c-4cff-ae63-374d971e5ba0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:16.993236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e77270a6-660c-4cff-ae63-374d971e5ba0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:17.001707 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e77270a6-660c-4cff-ae63-374d971e5ba0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1267 microversion: 2.1 time: 0.162662 Sep 13 20:35:17.002250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1313/2704] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:16 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:18.036283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1b3881cf-f1d4-4db5-a84a-57e7acf59e27 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:18.037140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1b3881cf-f1d4-4db5-a84a-57e7acf59e27 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:18.047143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b3881cf-f1d4-4db5-a84a-57e7acf59e27 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:18.047625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b3881cf-f1d4-4db5-a84a-57e7acf59e27 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:18.048056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b3881cf-f1d4-4db5-a84a-57e7acf59e27 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:18.048744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b3881cf-f1d4-4db5-a84a-57e7acf59e27 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:18.049190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b3881cf-f1d4-4db5-a84a-57e7acf59e27 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:18.049611 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1b3881cf-f1d4-4db5-a84a-57e7acf59e27 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:18.187569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1b3881cf-f1d4-4db5-a84a-57e7acf59e27 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:18.196007 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1b3881cf-f1d4-4db5-a84a-57e7acf59e27 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1267 microversion: 2.1 time: 0.166674 Sep 13 20:35:18.196575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1392/2705] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:18 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:19.219276 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-0f5c7e2f-8747-43bd-b4b0-4cfce1c71a34 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:19.219874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-0f5c7e2f-8747-43bd-b4b0-4cfce1c71a34 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:19.226413 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f5c7e2f-8747-43bd-b4b0-4cfce1c71a34 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:19.226932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f5c7e2f-8747-43bd-b4b0-4cfce1c71a34 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:19.227353 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f5c7e2f-8747-43bd-b4b0-4cfce1c71a34 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:19.228029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f5c7e2f-8747-43bd-b4b0-4cfce1c71a34 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:19.228474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f5c7e2f-8747-43bd-b4b0-4cfce1c71a34 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:19.228895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-0f5c7e2f-8747-43bd-b4b0-4cfce1c71a34 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:19.368728 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-0f5c7e2f-8747-43bd-b4b0-4cfce1c71a34 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:19.377075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-0f5c7e2f-8747-43bd-b4b0-4cfce1c71a34 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1267 microversion: 2.1 time: 0.161808 Sep 13 20:35:19.377649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1314/2706] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:19 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:20.408225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-cf71f9df-e095-42c6-bb76-e76eb54462ef tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:20.409165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-cf71f9df-e095-42c6-bb76-e76eb54462ef tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:20.420036 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cf71f9df-e095-42c6-bb76-e76eb54462ef tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:20.420723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cf71f9df-e095-42c6-bb76-e76eb54462ef tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:20.421148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cf71f9df-e095-42c6-bb76-e76eb54462ef tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:20.421818 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cf71f9df-e095-42c6-bb76-e76eb54462ef tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:20.422259 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cf71f9df-e095-42c6-bb76-e76eb54462ef tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:20.422706 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-cf71f9df-e095-42c6-bb76-e76eb54462ef tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:20.571102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-cf71f9df-e095-42c6-bb76-e76eb54462ef tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:20.579067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-cf71f9df-e095-42c6-bb76-e76eb54462ef tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1267 microversion: 2.1 time: 0.177402 Sep 13 20:35:20.579631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1393/2707] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:20 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:20.821002 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-58959a39-a46d-4781-8567-fb88046b7b67 req-9d57ecd1-fb85-4e22-90ae-7dfa213b8cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbe786d-befa-4ca2-a407-2f0236d91426", "name": "network-vif-plugged", "status": "completed", "tag": "f6387068-e330-4c79-a56a-cf69db784b16"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:35:20.830910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-58959a39-a46d-4781-8567-fb88046b7b67 req-9d57ecd1-fb85-4e22-90ae-7dfa213b8cd6 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:20.831382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-58959a39-a46d-4781-8567-fb88046b7b67 req-9d57ecd1-fb85-4e22-90ae-7dfa213b8cd6 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:20.831804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-58959a39-a46d-4781-8567-fb88046b7b67 req-9d57ecd1-fb85-4e22-90ae-7dfa213b8cd6 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:20.842740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-58959a39-a46d-4781-8567-fb88046b7b67 req-9d57ecd1-fb85-4e22-90ae-7dfa213b8cd6 service nova] Creating event network-vif-plugged:f6387068-e330-4c79-a56a-cf69db784b16 for instance 6fbe786d-befa-4ca2-a407-2f0236d91426 on hv-cinder-85427 Sep 13 20:35:20.847796 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-58959a39-a46d-4781-8567-fb88046b7b67 req-9d57ecd1-fb85-4e22-90ae-7dfa213b8cd6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090901 Sep 13 20:35:20.848358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1315/2708] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:35:21.601290 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-87c38335-f643-4256-a4e2-74b20f2a1cf4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:21.601962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-87c38335-f643-4256-a4e2-74b20f2a1cf4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:21.608846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-87c38335-f643-4256-a4e2-74b20f2a1cf4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:21.609387 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-87c38335-f643-4256-a4e2-74b20f2a1cf4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:21.609821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-87c38335-f643-4256-a4e2-74b20f2a1cf4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:21.610586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-87c38335-f643-4256-a4e2-74b20f2a1cf4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:21.611035 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-87c38335-f643-4256-a4e2-74b20f2a1cf4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:21.611462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-87c38335-f643-4256-a4e2-74b20f2a1cf4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:21.746352 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-87c38335-f643-4256-a4e2-74b20f2a1cf4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:21.758228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-87c38335-f643-4256-a4e2-74b20f2a1cf4 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1267 microversion: 2.1 time: 0.160783 Sep 13 20:35:21.759153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1394/2709] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:21 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:22.787506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-976c8ce3-3cf6-4d8e-a8f5-9fa3aa2808ac tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:22.788651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-976c8ce3-3cf6-4d8e-a8f5-9fa3aa2808ac tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:22.799123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-976c8ce3-3cf6-4d8e-a8f5-9fa3aa2808ac tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:22.799912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-976c8ce3-3cf6-4d8e-a8f5-9fa3aa2808ac tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:22.800627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-976c8ce3-3cf6-4d8e-a8f5-9fa3aa2808ac tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:22.801750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-976c8ce3-3cf6-4d8e-a8f5-9fa3aa2808ac tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:22.802537 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-976c8ce3-3cf6-4d8e-a8f5-9fa3aa2808ac tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:22.803238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-976c8ce3-3cf6-4d8e-a8f5-9fa3aa2808ac tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:22.938073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-976c8ce3-3cf6-4d8e-a8f5-9fa3aa2808ac tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:22.948756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-976c8ce3-3cf6-4d8e-a8f5-9fa3aa2808ac tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1455 microversion: 2.1 time: 0.168999 Sep 13 20:35:22.949554 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1316/2710] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:22 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1455 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:22.971485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8093520e-de23-4782-b01c-e27d138ad692 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:22.972098 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8093520e-de23-4782-b01c-e27d138ad692 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:22.979143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8093520e-de23-4782-b01c-e27d138ad692 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:22.979624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8093520e-de23-4782-b01c-e27d138ad692 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:22.980057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8093520e-de23-4782-b01c-e27d138ad692 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:22.980748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8093520e-de23-4782-b01c-e27d138ad692 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:22.981191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8093520e-de23-4782-b01c-e27d138ad692 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:22.981612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8093520e-de23-4782-b01c-e27d138ad692 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:23.121749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8093520e-de23-4782-b01c-e27d138ad692 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:23.130005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8093520e-de23-4782-b01c-e27d138ad692 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1455 microversion: 2.1 time: 0.162474 Sep 13 20:35:23.130662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1395/2711] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:22 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:25.059180 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-a7693d29-74cc-4354-a4bb-033998452bf4 req-242a583b-c04d-44b6-aaa9-6301bcd1e979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fbe786d-befa-4ca2-a407-2f0236d91426", "tag": "f6387068-e330-4c79-a56a-cf69db784b16"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:35:25.069533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-a7693d29-74cc-4354-a4bb-033998452bf4 req-242a583b-c04d-44b6-aaa9-6301bcd1e979 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:25.070004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-a7693d29-74cc-4354-a4bb-033998452bf4 req-242a583b-c04d-44b6-aaa9-6301bcd1e979 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:25.070476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-a7693d29-74cc-4354-a4bb-033998452bf4 req-242a583b-c04d-44b6-aaa9-6301bcd1e979 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:25.081417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-a7693d29-74cc-4354-a4bb-033998452bf4 req-242a583b-c04d-44b6-aaa9-6301bcd1e979 service nova] Creating event network-changed:f6387068-e330-4c79-a56a-cf69db784b16 for instance 6fbe786d-befa-4ca2-a407-2f0236d91426 on hv-cinder-85427 Sep 13 20:35:25.087035 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-a7693d29-74cc-4354-a4bb-033998452bf4 req-242a583b-c04d-44b6-aaa9-6301bcd1e979 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031447 Sep 13 20:35:25.087887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1317/2712] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:35:26.372473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a2c89381-6953-48c0-8135-ed51bc82b54a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:26.372962 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a2c89381-6953-48c0-8135-ed51bc82b54a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:26.379898 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2c89381-6953-48c0-8135-ed51bc82b54a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:26.380377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2c89381-6953-48c0-8135-ed51bc82b54a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:26.380810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2c89381-6953-48c0-8135-ed51bc82b54a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:26.381490 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2c89381-6953-48c0-8135-ed51bc82b54a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:26.381944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2c89381-6953-48c0-8135-ed51bc82b54a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:26.382358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a2c89381-6953-48c0-8135-ed51bc82b54a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:26.395896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-a2c89381-6953-48c0-8135-ed51bc82b54a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] HTTP exception thrown: Instance b6c34670-16a4-4b3b-9a8d-1d77974d355e could not be found. Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a2c89381-6953-48c0-8135-ed51bc82b54a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Request method failure captured: Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: DELETE /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e HTTP/1.1 Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOE8Mqk-IFhs0_Cf8CByqrzJ7U1fYDMUoNoXMaWM3G8zlpMzNH3OAeKkbk_zSN_QIujQ03FlgID1zQOvGdarkXTVNZ7oCTeu15uB51_9nWL3Sr1SmORESaFOLuKjHMvA9pXOdKxvp5483kAQRYJ7zrFgLLZiDq48UsFb01eNaeaPz3c Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: b3fa762826924accaa8012d7ceaf17eb Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:35:26.397440 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:35:26.398798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b3fa762826924accaa8012d7ceaf17eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b3fa762826924accaa8012d7ceaf17eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3fa762826924accaa8012d7ceaf17eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3fa762826924accaa8012d7ceaf17eb"}]}] Sep 13 20:35:26.398798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:35:26.398798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: b3fa762826924accaa8012d7ceaf17eb Sep 13 20:35:26.398798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:35:26.398798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeTestJSON-62978129-project Sep 13 20:35:26.398798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:35:26.398798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:35:26.398798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 87c4f9c4b9334b66ac89e01a278436bc Sep 13 20:35:26.398798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeTestJSON-62978129-project Sep 13 20:35:26.398798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:35:26.398798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance b6c34670-16a4-4b3b-9a8d-1d77974d355e could not be found. Sep 13 20:35:26.398798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': 'b6c34670-16a4-4b3b-9a8d-1d77974d355e'} Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c34670-16a4-4b3b-9a8d-1d77974d355e could not be found. Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:35:26.399443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c34670-16a4-4b3b-9a8d-1d77974d355e could not be found. Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c34670-16a4-4b3b-9a8d-1d77974d355e could not be found. Sep 13 20:35:26.400507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:35:26.401545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a2c89381-6953-48c0-8135-ed51bc82b54a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Returning 404 to user: Instance b6c34670-16a4-4b3b-9a8d-1d77974d355e could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:35:26.401545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a2c89381-6953-48c0-8135-ed51bc82b54a tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 404 len: 111 microversion: 2.1 time: 0.030246 Sep 13 20:35:26.401545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1396/2713] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:35:26 2022] DELETE /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:35:26.411542 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-270f89b1-5bc9-4d47-8ab3-da1af86a0d26 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:26.412298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-270f89b1-5bc9-4d47-8ab3-da1af86a0d26 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] [instance: b6c34670-16a4-4b3b-9a8d-1d77974d355e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:26.421769 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-270f89b1-5bc9-4d47-8ab3-da1af86a0d26 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:26.422247 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-270f89b1-5bc9-4d47-8ab3-da1af86a0d26 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:26.422710 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-270f89b1-5bc9-4d47-8ab3-da1af86a0d26 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:26.423385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-270f89b1-5bc9-4d47-8ab3-da1af86a0d26 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:26.423827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-270f89b1-5bc9-4d47-8ab3-da1af86a0d26 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:26.424241 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-270f89b1-5bc9-4d47-8ab3-da1af86a0d26 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:26.437576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-270f89b1-5bc9-4d47-8ab3-da1af86a0d26 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] HTTP exception thrown: Instance b6c34670-16a4-4b3b-9a8d-1d77974d355e could not be found. Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-270f89b1-5bc9-4d47-8ab3-da1af86a0d26 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Request method failure captured: Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e HTTP/1.1 Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOE8Mqk-IFhs0_Cf8CByqrzJ7U1fYDMUoNoXMaWM3G8zlpMzNH3OAeKkbk_zSN_QIujQ03FlgID1zQOvGdarkXTVNZ7oCTeu15uB51_9nWL3Sr1SmORESaFOLuKjHMvA9pXOdKxvp5483kAQRYJ7zrFgLLZiDq48UsFb01eNaeaPz3c Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: b3fa762826924accaa8012d7ceaf17eb Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:35:26.439220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:35:26.440456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b3fa762826924accaa8012d7ceaf17eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b3fa762826924accaa8012d7ceaf17eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3fa762826924accaa8012d7ceaf17eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3fa762826924accaa8012d7ceaf17eb"}]}] Sep 13 20:35:26.440456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:35:26.440456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: b3fa762826924accaa8012d7ceaf17eb Sep 13 20:35:26.440456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-AttachVolumeTestJSON-62978129 Sep 13 20:35:26.440456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-AttachVolumeTestJSON-62978129-project Sep 13 20:35:26.440456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:35:26.440456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:35:26.440456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 87c4f9c4b9334b66ac89e01a278436bc Sep 13 20:35:26.440456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-AttachVolumeTestJSON-62978129-project Sep 13 20:35:26.440456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:35:26.440456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance b6c34670-16a4-4b3b-9a8d-1d77974d355e could not be found. Sep 13 20:35:26.440456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': 'b6c34670-16a4-4b3b-9a8d-1d77974d355e'} Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c34670-16a4-4b3b-9a8d-1d77974d355e could not be found. Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:35:26.441197 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c34670-16a4-4b3b-9a8d-1d77974d355e could not be found. Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c34670-16a4-4b3b-9a8d-1d77974d355e could not be found. Sep 13 20:35:26.442218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:35:26.443582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-270f89b1-5bc9-4d47-8ab3-da1af86a0d26 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] Returning 404 to user: Instance b6c34670-16a4-4b3b-9a8d-1d77974d355e could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:35:26.443582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-270f89b1-5bc9-4d47-8ab3-da1af86a0d26 tempest-AttachVolumeTestJSON-62978129 tempest-AttachVolumeTestJSON-62978129-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e" status: 404 len: 111 microversion: 2.1 time: 0.036800 Sep 13 20:35:26.443582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1318/2714] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:26 2022] GET /compute/v2.1/servers/b6c34670-16a4-4b3b-9a8d-1d77974d355e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:35:34.985410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c16f0b20-5b40-4f24-9571-fffc450a87fa tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: .version_select at 0x7f984634fd30>, body: {"keypair": {"name": "tempest-keypair-538772226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDprEtkzhjlEXzUFssBn5uzmtbuYvjYMbu+Nx6lqcfveiVxX9w9t/AEdoFzNxIo6m5hqUPhWs2riYA6wKUfL//3+Ssy0UEQPXg7FqudEv13YC30+GWRYn9kzyICGnjz1Og=="}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:35:34.991549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=29 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:35.005298 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-c16f0b20-5b40-4f24-9571-fffc450a87fa tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for project be0640c4e0584998a646e45565347687. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:35:35.009576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-c16f0b20-5b40-4f24-9571-fffc450a87fa tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for user 6c42757a041b4831abd7a7ba66cbe933 and project be0640c4e0584998a646e45565347687. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:35:35.033945 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c16f0b20-5b40-4f24-9571-fffc450a87fa tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183977 Sep 13 20:35:35.034780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1397/2715] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 13 20:35:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:35:36.338646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-24427196", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "faf29249-4b45-466b-9b8e-60480aedc097"}], "security_groups": [{"name": "tempest-securitygroup--1101993134"}], "key_name": "tempest-keypair-538772226", "user_data": "}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:35:36.347858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:36.429505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=50 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:36.458825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] validate_networks() for [('faf29249-4b45-466b-9b8e-60480aedc097', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:35:36.845887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:35:36.846312 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:35:36.846822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:35:36.847227 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:35:36.847635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:35:36.856765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:36.857242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:36.857680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:36.858424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:36.858877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:36.859512 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:36.876692 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for project be0640c4e0584998a646e45565347687. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:35:36.881060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for user 6c42757a041b4831abd7a7ba66cbe933 and project be0640c4e0584998a646e45565347687. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:35:36.893123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:35:36.895522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:35:36.950748 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-baf1553f-0f3e-44f4-8f93-f6f0d88451fe tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.616729 Sep 13 20:35:36.951782 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1319/2716] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:35:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:35:36.963113 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c2e07130-7811-4ac4-9467-27ae4b718195 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:36.963851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c2e07130-7811-4ac4-9467-27ae4b718195 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:36.966411 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=52 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:37.025343 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c2e07130-7811-4ac4-9467-27ae4b718195 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:37.032390 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c2e07130-7811-4ac4-9467-27ae4b718195 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1239 microversion: 2.1 time: 0.073250 Sep 13 20:35:37.033252 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1398/2717] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:36 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:38.057165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9356349f-122f-4eca-b3fa-c62604bbd395 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:38.057831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9356349f-122f-4eca-b3fa-c62604bbd395 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:38.083211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9356349f-122f-4eca-b3fa-c62604bbd395 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:38.083709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9356349f-122f-4eca-b3fa-c62604bbd395 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:38.084171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9356349f-122f-4eca-b3fa-c62604bbd395 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:38.085068 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9356349f-122f-4eca-b3fa-c62604bbd395 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:38.085682 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9356349f-122f-4eca-b3fa-c62604bbd395 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:38.086359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9356349f-122f-4eca-b3fa-c62604bbd395 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:38.178118 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9356349f-122f-4eca-b3fa-c62604bbd395 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:38.188186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9356349f-122f-4eca-b3fa-c62604bbd395 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1309 microversion: 2.1 time: 0.136616 Sep 13 20:35:38.190744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1320/2718] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:38 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1309 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:35:39.213349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b320061b-bcf4-4a43-9e68-a5f6df46d3f8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:39.214068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b320061b-bcf4-4a43-9e68-a5f6df46d3f8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:39.221195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b320061b-bcf4-4a43-9e68-a5f6df46d3f8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:39.221681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b320061b-bcf4-4a43-9e68-a5f6df46d3f8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:39.222115 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b320061b-bcf4-4a43-9e68-a5f6df46d3f8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:39.222834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b320061b-bcf4-4a43-9e68-a5f6df46d3f8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:39.223313 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b320061b-bcf4-4a43-9e68-a5f6df46d3f8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:39.223801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b320061b-bcf4-4a43-9e68-a5f6df46d3f8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:39.359134 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-b320061b-bcf4-4a43-9e68-a5f6df46d3f8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:39.366797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b320061b-bcf4-4a43-9e68-a5f6df46d3f8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1365 microversion: 2.1 time: 0.157396 Sep 13 20:35:39.367344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1399/2719] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:39 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:39.538786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-8cfd67ff-99f0-4709-aff5-e5c310d3f34f req-2481221b-8ae1-475e-acf2-05d8c5e0b761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e811c557-1b94-4700-aa3a-3fdceb873fb4", "tag": "eaf59eeb-029e-40ea-ac71-bb1cd30ac3d2"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:35:39.550456 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-8cfd67ff-99f0-4709-aff5-e5c310d3f34f req-2481221b-8ae1-475e-acf2-05d8c5e0b761 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:39.550944 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-8cfd67ff-99f0-4709-aff5-e5c310d3f34f req-2481221b-8ae1-475e-acf2-05d8c5e0b761 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:39.551371 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-8cfd67ff-99f0-4709-aff5-e5c310d3f34f req-2481221b-8ae1-475e-acf2-05d8c5e0b761 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:39.563012 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-8cfd67ff-99f0-4709-aff5-e5c310d3f34f req-2481221b-8ae1-475e-acf2-05d8c5e0b761 service nova] Creating event network-changed:eaf59eeb-029e-40ea-ac71-bb1cd30ac3d2 for instance e811c557-1b94-4700-aa3a-3fdceb873fb4 on hv-cinder-85427 Sep 13 20:35:39.568491 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-8cfd67ff-99f0-4709-aff5-e5c310d3f34f req-2481221b-8ae1-475e-acf2-05d8c5e0b761 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033543 Sep 13 20:35:39.569741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1321/2720] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:35:40.389269 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-16ba3ece-6e10-43d5-b7b0-0d10a2b803b0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:40.389869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-16ba3ece-6e10-43d5-b7b0-0d10a2b803b0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:40.397063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16ba3ece-6e10-43d5-b7b0-0d10a2b803b0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:40.397540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16ba3ece-6e10-43d5-b7b0-0d10a2b803b0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:40.397999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16ba3ece-6e10-43d5-b7b0-0d10a2b803b0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:40.398725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16ba3ece-6e10-43d5-b7b0-0d10a2b803b0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:40.399176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16ba3ece-6e10-43d5-b7b0-0d10a2b803b0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:40.399600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-16ba3ece-6e10-43d5-b7b0-0d10a2b803b0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:40.531400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-16ba3ece-6e10-43d5-b7b0-0d10a2b803b0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:40.539326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-16ba3ece-6e10-43d5-b7b0-0d10a2b803b0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1365 microversion: 2.1 time: 0.153975 Sep 13 20:35:40.539874 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1400/2721] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:40 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:41.566968 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f6409232-ac30-4b59-a93d-8b8a1dd4be68 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:41.568012 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f6409232-ac30-4b59-a93d-8b8a1dd4be68 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:41.574497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6409232-ac30-4b59-a93d-8b8a1dd4be68 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:41.574988 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6409232-ac30-4b59-a93d-8b8a1dd4be68 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:41.575424 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6409232-ac30-4b59-a93d-8b8a1dd4be68 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:41.576117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6409232-ac30-4b59-a93d-8b8a1dd4be68 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:41.576569 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6409232-ac30-4b59-a93d-8b8a1dd4be68 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:41.577000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f6409232-ac30-4b59-a93d-8b8a1dd4be68 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:41.712320 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f6409232-ac30-4b59-a93d-8b8a1dd4be68 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:41.720544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f6409232-ac30-4b59-a93d-8b8a1dd4be68 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1365 microversion: 2.1 time: 0.159306 Sep 13 20:35:41.721109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1322/2722] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:41 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:42.743456 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7becfe85-20e1-439a-a5b4-1cd045e09934 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:42.744081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7becfe85-20e1-439a-a5b4-1cd045e09934 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:42.750993 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7becfe85-20e1-439a-a5b4-1cd045e09934 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:42.751460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7becfe85-20e1-439a-a5b4-1cd045e09934 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:42.751941 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7becfe85-20e1-439a-a5b4-1cd045e09934 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:42.752619 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7becfe85-20e1-439a-a5b4-1cd045e09934 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:42.753059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7becfe85-20e1-439a-a5b4-1cd045e09934 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:42.753474 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7becfe85-20e1-439a-a5b4-1cd045e09934 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:42.887168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-7becfe85-20e1-439a-a5b4-1cd045e09934 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:42.895589 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7becfe85-20e1-439a-a5b4-1cd045e09934 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1365 microversion: 2.1 time: 0.155982 Sep 13 20:35:42.910396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1401/2723] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:42 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:43.921431 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6cf99c49-8e50-4c1c-82a7-8fcaed81b181 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:43.922327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6cf99c49-8e50-4c1c-82a7-8fcaed81b181 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:43.930266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cf99c49-8e50-4c1c-82a7-8fcaed81b181 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:43.930905 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cf99c49-8e50-4c1c-82a7-8fcaed81b181 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:43.931451 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cf99c49-8e50-4c1c-82a7-8fcaed81b181 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:43.932310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cf99c49-8e50-4c1c-82a7-8fcaed81b181 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:43.932896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cf99c49-8e50-4c1c-82a7-8fcaed81b181 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:43.933425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6cf99c49-8e50-4c1c-82a7-8fcaed81b181 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:44.066658 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6cf99c49-8e50-4c1c-82a7-8fcaed81b181 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:44.074854 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6cf99c49-8e50-4c1c-82a7-8fcaed81b181 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1365 microversion: 2.1 time: 0.158782 Sep 13 20:35:44.075402 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1323/2724] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:43 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:44.871272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-3bf23dc4-6213-4ef4-b63a-a2aacc6e366f req-bbb8ab73-0f42-47c7-ad17-443fe62f5a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e811c557-1b94-4700-aa3a-3fdceb873fb4", "name": "network-vif-plugged", "status": "completed", "tag": "eaf59eeb-029e-40ea-ac71-bb1cd30ac3d2"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:35:44.881669 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-3bf23dc4-6213-4ef4-b63a-a2aacc6e366f req-bbb8ab73-0f42-47c7-ad17-443fe62f5a85 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:44.882149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-3bf23dc4-6213-4ef4-b63a-a2aacc6e366f req-bbb8ab73-0f42-47c7-ad17-443fe62f5a85 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:44.882614 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-3bf23dc4-6213-4ef4-b63a-a2aacc6e366f req-bbb8ab73-0f42-47c7-ad17-443fe62f5a85 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:44.894532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-3bf23dc4-6213-4ef4-b63a-a2aacc6e366f req-bbb8ab73-0f42-47c7-ad17-443fe62f5a85 service nova] Creating event network-vif-plugged:eaf59eeb-029e-40ea-ac71-bb1cd30ac3d2 for instance e811c557-1b94-4700-aa3a-3fdceb873fb4 on hv-cinder-85427 Sep 13 20:35:44.899649 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-3bf23dc4-6213-4ef4-b63a-a2aacc6e366f req-bbb8ab73-0f42-47c7-ad17-443fe62f5a85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032142 Sep 13 20:35:44.900224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1402/2725] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:35:45.097438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4f8e464e-696d-4bc6-b594-99de592ef50e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:45.098949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4f8e464e-696d-4bc6-b594-99de592ef50e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:45.107025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f8e464e-696d-4bc6-b594-99de592ef50e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:45.107517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f8e464e-696d-4bc6-b594-99de592ef50e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:45.108029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f8e464e-696d-4bc6-b594-99de592ef50e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:45.109030 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f8e464e-696d-4bc6-b594-99de592ef50e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:45.109636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f8e464e-696d-4bc6-b594-99de592ef50e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:45.110242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4f8e464e-696d-4bc6-b594-99de592ef50e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:45.244901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4f8e464e-696d-4bc6-b594-99de592ef50e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:45.253809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4f8e464e-696d-4bc6-b594-99de592ef50e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1365 microversion: 2.1 time: 0.160519 Sep 13 20:35:45.254394 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1324/2726] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:45 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:46.282455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-825bc9ff-584b-4e5f-8551-2a258b2e2380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:46.283688 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-825bc9ff-584b-4e5f-8551-2a258b2e2380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:46.294026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-825bc9ff-584b-4e5f-8551-2a258b2e2380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:46.294868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-825bc9ff-584b-4e5f-8551-2a258b2e2380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:46.295593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-825bc9ff-584b-4e5f-8551-2a258b2e2380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:46.296707 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-825bc9ff-584b-4e5f-8551-2a258b2e2380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:46.297444 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-825bc9ff-584b-4e5f-8551-2a258b2e2380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:46.298299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-825bc9ff-584b-4e5f-8551-2a258b2e2380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:46.432523 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-825bc9ff-584b-4e5f-8551-2a258b2e2380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:46.443969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-825bc9ff-584b-4e5f-8551-2a258b2e2380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1365 microversion: 2.1 time: 0.169111 Sep 13 20:35:46.444692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1403/2727] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:46 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:47.472278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c68a83e9-fac3-4dcc-b61e-d81fce4109fb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:47.473058 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-c68a83e9-fac3-4dcc-b61e-d81fce4109fb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:47.476025 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:47.476975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=6 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:47.484609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c68a83e9-fac3-4dcc-b61e-d81fce4109fb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:47.485208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c68a83e9-fac3-4dcc-b61e-d81fce4109fb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:47.485747 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c68a83e9-fac3-4dcc-b61e-d81fce4109fb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:47.486668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c68a83e9-fac3-4dcc-b61e-d81fce4109fb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:47.487235 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c68a83e9-fac3-4dcc-b61e-d81fce4109fb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:47.487765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-c68a83e9-fac3-4dcc-b61e-d81fce4109fb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:47.631651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-c68a83e9-fac3-4dcc-b61e-d81fce4109fb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:35:47.644498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c68a83e9-fac3-4dcc-b61e-d81fce4109fb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1556 microversion: 2.1 time: 0.177954 Sep 13 20:35:47.645369 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1325/2728] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:35:47 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:35:47.667301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-11990c0a-ec0e-4424-836b-f3a2bec360e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:35:47.667819 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-11990c0a-ec0e-4424-836b-f3a2bec360e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:35:47.669881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=6 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:35:47.675774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11990c0a-ec0e-4424-836b-f3a2bec360e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:47.676247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11990c0a-ec0e-4424-836b-f3a2bec360e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:47.676659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11990c0a-ec0e-4424-836b-f3a2bec360e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:47.677329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11990c0a-ec0e-4424-836b-f3a2bec360e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:47.677769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11990c0a-ec0e-4424-836b-f3a2bec360e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:47.678162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11990c0a-ec0e-4424-836b-f3a2bec360e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:47.754801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-11990c0a-ec0e-4424-836b-f3a2bec360e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091268 Sep 13 20:35:47.755415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1404/2729] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 13 20:35:47 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:35:48.752736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-f098c330-8004-4f24-9312-dbbdda6eac84 req-3f52d203-3b5d-497e-8b8d-9104c859558c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e811c557-1b94-4700-aa3a-3fdceb873fb4", "tag": "eaf59eeb-029e-40ea-ac71-bb1cd30ac3d2"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:35:48.763061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-f098c330-8004-4f24-9312-dbbdda6eac84 req-3f52d203-3b5d-497e-8b8d-9104c859558c service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:35:48.763061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-f098c330-8004-4f24-9312-dbbdda6eac84 req-3f52d203-3b5d-497e-8b8d-9104c859558c service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:35:48.763061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-f098c330-8004-4f24-9312-dbbdda6eac84 req-3f52d203-3b5d-497e-8b8d-9104c859558c service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:35:48.774277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-f098c330-8004-4f24-9312-dbbdda6eac84 req-3f52d203-3b5d-497e-8b8d-9104c859558c service nova] Creating event network-changed:eaf59eeb-029e-40ea-ac71-bb1cd30ac3d2 for instance e811c557-1b94-4700-aa3a-3fdceb873fb4 on hv-cinder-85427 Sep 13 20:35:48.779608 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-f098c330-8004-4f24-9312-dbbdda6eac84 req-3f52d203-3b5d-497e-8b8d-9104c859558c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088640 Sep 13 20:35:48.780294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1326/2730] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:36:24.506073 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:36:24.507436 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=30 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:36:24.513805 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b73e2b38-ad34-4227-9398-4b05c9b7c4fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:36:24.514645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b73e2b38-ad34-4227-9398-4b05c9b7c4fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:24.526284 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b73e2b38-ad34-4227-9398-4b05c9b7c4fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:24.527137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b73e2b38-ad34-4227-9398-4b05c9b7c4fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:24.528174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b73e2b38-ad34-4227-9398-4b05c9b7c4fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:24.529040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b73e2b38-ad34-4227-9398-4b05c9b7c4fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:24.529783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b73e2b38-ad34-4227-9398-4b05c9b7c4fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:24.530575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b73e2b38-ad34-4227-9398-4b05c9b7c4fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:24.556484 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b73e2b38-ad34-4227-9398-4b05c9b7c4fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4/ips" status: 200 len: 150 microversion: 2.1 time: 0.052980 Sep 13 20:36:24.557297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1405/2731] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 13 20:36:24 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:36:25.951577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5571fd77-a2ae-4984-9cf2-7c640567734a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bacba97-0b86-4563-a73f-4bfc569f816a"}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:36:25.954083 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5571fd77-a2ae-4984-9cf2-7c640567734a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:25.956256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:36:25.956925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=36 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:36:25.964057 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5571fd77-a2ae-4984-9cf2-7c640567734a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:25.964541 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5571fd77-a2ae-4984-9cf2-7c640567734a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:25.965000 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5571fd77-a2ae-4984-9cf2-7c640567734a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:25.965785 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5571fd77-a2ae-4984-9cf2-7c640567734a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:25.966269 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5571fd77-a2ae-4984-9cf2-7c640567734a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:25.966832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5571fd77-a2ae-4984-9cf2-7c640567734a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:26.233770 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5571fd77-a2ae-4984-9cf2-7c640567734a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286542 Sep 13 20:36:26.234666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1327/2732] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 13 20:36:25 2022] POST /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:36:32.781841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-da115639-0515-473b-a494-2baabb214515 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: .version_select at 0x7f98466509d0>, body: {"keypair": {"name": "tempest-keypair-2115808278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYssaXqa3WPBiC8o841cU9iYgc6ymZdoX7db9z/6rlzgFlEmyFS/VmlGTXenJ0Xx3xsWsGxpN3BtysdVM7JWKqGIz2QZFn6dXnpTn4RjVK2C0r+QJTuGYp/3nUobnIRAg=="}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:36:32.799815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-da115639-0515-473b-a494-2baabb214515 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for project be0640c4e0584998a646e45565347687. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:36:32.804230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-da115639-0515-473b-a494-2baabb214515 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for user 6c42757a041b4831abd7a7ba66cbe933 and project be0640c4e0584998a646e45565347687. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:36:32.830867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-da115639-0515-473b-a494-2baabb214515 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053155 Sep 13 20:36:32.831455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1406/2733] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 13 20:36:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:36:34.083154 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-554191680", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "faf29249-4b45-466b-9b8e-60480aedc097"}], "security_groups": [{"name": "tempest-securitygroup--1489806493"}], "key_name": "tempest-keypair-2115808278", "user_data": "}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:36:34.191922 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] validate_networks() for [('faf29249-4b45-466b-9b8e-60480aedc097', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:36:34.842309 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:36:34.842763 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:36:34.843338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:36:34.843752 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:36:34.844162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:36:34.853723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:34.854205 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:34.854679 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:34.855403 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:34.855853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:34.856277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:34.873440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for project be0640c4e0584998a646e45565347687. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:36:34.877691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for user 6c42757a041b4831abd7a7ba66cbe933 and project be0640c4e0584998a646e45565347687. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:36:34.890335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:36:34.892773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:36:34.941310 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4214bcdb-0114-4f41-9e65-47c2f4e842f3 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.863538 Sep 13 20:36:34.942447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1328/2734] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:36:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:36:34.953732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a51d9fdf-467c-4dea-b28d-eaec5363e811 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:36:34.954389 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a51d9fdf-467c-4dea-b28d-eaec5363e811 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:34.956502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=4 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:36:35.010808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a51d9fdf-467c-4dea-b28d-eaec5363e811 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:36:35.017851 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a51d9fdf-467c-4dea-b28d-eaec5363e811 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1241 microversion: 2.1 time: 0.067974 Sep 13 20:36:35.018926 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1407/2735] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:36:34 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:36:36.041582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-468cea97-cef3-408c-b24b-a781815809b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:36:36.042194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-468cea97-cef3-408c-b24b-a781815809b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:36.050043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-468cea97-cef3-408c-b24b-a781815809b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:36.050892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-468cea97-cef3-408c-b24b-a781815809b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:36.051539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-468cea97-cef3-408c-b24b-a781815809b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:36.052468 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-468cea97-cef3-408c-b24b-a781815809b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:36.053122 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-468cea97-cef3-408c-b24b-a781815809b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:36.053771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-468cea97-cef3-408c-b24b-a781815809b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:36.126845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-468cea97-cef3-408c-b24b-a781815809b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:36:36.134744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-468cea97-cef3-408c-b24b-a781815809b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1311 microversion: 2.1 time: 0.097605 Sep 13 20:36:36.135947 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1329/2736] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:36:36 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:36:37.158358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-c742214a-ef02-4c46-bb81-34beee59bee6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:36:37.158992 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-c742214a-ef02-4c46-bb81-34beee59bee6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:37.165455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c742214a-ef02-4c46-bb81-34beee59bee6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:37.165967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c742214a-ef02-4c46-bb81-34beee59bee6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:37.166395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c742214a-ef02-4c46-bb81-34beee59bee6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:37.167119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c742214a-ef02-4c46-bb81-34beee59bee6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:37.167542 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c742214a-ef02-4c46-bb81-34beee59bee6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:37.167975 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-c742214a-ef02-4c46-bb81-34beee59bee6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:37.312568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-c742214a-ef02-4c46-bb81-34beee59bee6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:36:37.320670 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c742214a-ef02-4c46-bb81-34beee59bee6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1367 microversion: 2.1 time: 0.166414 Sep 13 20:36:37.321329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1408/2737] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:36:37 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:36:37.441348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-47e3e45a-6ed2-4a1e-980a-65c455a7db65 req-4ed8225e-1b90-480b-8bc7-437ada883d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f473d0db-2df5-4cab-be22-87f507a90c42", "tag": "b8208a0c-8a44-4c4c-9abb-4306bc486dbb"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:36:37.452201 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-47e3e45a-6ed2-4a1e-980a-65c455a7db65 req-4ed8225e-1b90-480b-8bc7-437ada883d14 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:37.453453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-47e3e45a-6ed2-4a1e-980a-65c455a7db65 req-4ed8225e-1b90-480b-8bc7-437ada883d14 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:37.453973 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-47e3e45a-6ed2-4a1e-980a-65c455a7db65 req-4ed8225e-1b90-480b-8bc7-437ada883d14 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:37.465355 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-47e3e45a-6ed2-4a1e-980a-65c455a7db65 req-4ed8225e-1b90-480b-8bc7-437ada883d14 service nova] Creating event network-changed:b8208a0c-8a44-4c4c-9abb-4306bc486dbb for instance f473d0db-2df5-4cab-be22-87f507a90c42 on hv-cinder-85427 Sep 13 20:36:37.470534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-47e3e45a-6ed2-4a1e-980a-65c455a7db65 req-4ed8225e-1b90-480b-8bc7-437ada883d14 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032981 Sep 13 20:36:37.471369 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1330/2738] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:36:38.343254 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-efd5851d-e6f3-4ce0-9a28-8905d3bec4fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:36:38.343944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-efd5851d-e6f3-4ce0-9a28-8905d3bec4fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:38.350682 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efd5851d-e6f3-4ce0-9a28-8905d3bec4fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:38.351161 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efd5851d-e6f3-4ce0-9a28-8905d3bec4fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:38.351586 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efd5851d-e6f3-4ce0-9a28-8905d3bec4fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:38.352265 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efd5851d-e6f3-4ce0-9a28-8905d3bec4fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:38.352740 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efd5851d-e6f3-4ce0-9a28-8905d3bec4fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:38.353149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-efd5851d-e6f3-4ce0-9a28-8905d3bec4fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:38.489545 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-efd5851d-e6f3-4ce0-9a28-8905d3bec4fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:36:38.497658 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-efd5851d-e6f3-4ce0-9a28-8905d3bec4fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1367 microversion: 2.1 time: 0.158274 Sep 13 20:36:38.498230 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1409/2739] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:36:38 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:36:39.526319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ee825153-0980-40ea-8497-7ce4ce34760d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:36:39.528504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ee825153-0980-40ea-8497-7ce4ce34760d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:39.536258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee825153-0980-40ea-8497-7ce4ce34760d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:39.536780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee825153-0980-40ea-8497-7ce4ce34760d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:39.537224 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee825153-0980-40ea-8497-7ce4ce34760d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:39.538043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee825153-0980-40ea-8497-7ce4ce34760d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:39.538701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee825153-0980-40ea-8497-7ce4ce34760d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:39.539163 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ee825153-0980-40ea-8497-7ce4ce34760d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:39.677582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ee825153-0980-40ea-8497-7ce4ce34760d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:36:39.689314 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ee825153-0980-40ea-8497-7ce4ce34760d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1367 microversion: 2.1 time: 0.170594 Sep 13 20:36:39.690113 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1331/2740] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:36:39 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:36:40.720741 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-36359204-edd9-4d5d-b278-a14db882de25 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:36:40.721587 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-36359204-edd9-4d5d-b278-a14db882de25 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:40.730413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36359204-edd9-4d5d-b278-a14db882de25 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:40.731102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36359204-edd9-4d5d-b278-a14db882de25 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:40.731673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36359204-edd9-4d5d-b278-a14db882de25 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:40.732588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36359204-edd9-4d5d-b278-a14db882de25 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:40.733182 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36359204-edd9-4d5d-b278-a14db882de25 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:40.733751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-36359204-edd9-4d5d-b278-a14db882de25 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:40.873520 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-36359204-edd9-4d5d-b278-a14db882de25 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:36:40.882072 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-36359204-edd9-4d5d-b278-a14db882de25 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1367 microversion: 2.1 time: 0.167593 Sep 13 20:36:40.882707 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1410/2741] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:36:40 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:36:41.906967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-05445696-c23f-48fa-bd59-1b7ecab3094a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:36:41.907659 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-05445696-c23f-48fa-bd59-1b7ecab3094a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:41.916549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05445696-c23f-48fa-bd59-1b7ecab3094a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:41.917194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05445696-c23f-48fa-bd59-1b7ecab3094a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:41.917778 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05445696-c23f-48fa-bd59-1b7ecab3094a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:41.918741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05445696-c23f-48fa-bd59-1b7ecab3094a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:41.919344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05445696-c23f-48fa-bd59-1b7ecab3094a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:41.919913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-05445696-c23f-48fa-bd59-1b7ecab3094a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:42.054619 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-05445696-c23f-48fa-bd59-1b7ecab3094a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:36:42.062680 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-05445696-c23f-48fa-bd59-1b7ecab3094a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1367 microversion: 2.1 time: 0.161096 Sep 13 20:36:42.063253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1332/2742] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:36:41 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:36:43.085900 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e39c4b0c-670d-41de-af65-af44cff62d18 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:36:43.086641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e39c4b0c-670d-41de-af65-af44cff62d18 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:43.093228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e39c4b0c-670d-41de-af65-af44cff62d18 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:43.093768 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e39c4b0c-670d-41de-af65-af44cff62d18 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:43.094184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e39c4b0c-670d-41de-af65-af44cff62d18 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:43.094905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e39c4b0c-670d-41de-af65-af44cff62d18 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:43.095353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e39c4b0c-670d-41de-af65-af44cff62d18 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:43.095769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e39c4b0c-670d-41de-af65-af44cff62d18 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:43.230604 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e39c4b0c-670d-41de-af65-af44cff62d18 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:36:43.238705 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e39c4b0c-670d-41de-af65-af44cff62d18 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1367 microversion: 2.1 time: 0.156693 Sep 13 20:36:43.239268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1411/2743] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:36:43 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:36:43.306337 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-d990b021-f6be-475e-ac8e-6bd14803d865 req-562c30a1-ba3a-4ea0-bc81-cb4eeaaebf47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f473d0db-2df5-4cab-be22-87f507a90c42", "name": "network-vif-plugged", "status": "completed", "tag": "b8208a0c-8a44-4c4c-9abb-4306bc486dbb"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:36:43.316729 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-d990b021-f6be-475e-ac8e-6bd14803d865 req-562c30a1-ba3a-4ea0-bc81-cb4eeaaebf47 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:43.317210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-d990b021-f6be-475e-ac8e-6bd14803d865 req-562c30a1-ba3a-4ea0-bc81-cb4eeaaebf47 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:43.317652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-d990b021-f6be-475e-ac8e-6bd14803d865 req-562c30a1-ba3a-4ea0-bc81-cb4eeaaebf47 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:43.332303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-d990b021-f6be-475e-ac8e-6bd14803d865 req-562c30a1-ba3a-4ea0-bc81-cb4eeaaebf47 service nova] Creating event network-vif-plugged:b8208a0c-8a44-4c4c-9abb-4306bc486dbb for instance f473d0db-2df5-4cab-be22-87f507a90c42 on hv-cinder-85427 Sep 13 20:36:43.337549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-d990b021-f6be-475e-ac8e-6bd14803d865 req-562c30a1-ba3a-4ea0-bc81-cb4eeaaebf47 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035505 Sep 13 20:36:43.338203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1333/2744] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:36:44.261455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-90a46344-b910-421b-b119-d811db76c221 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:36:44.262044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-90a46344-b910-421b-b119-d811db76c221 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:44.268997 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90a46344-b910-421b-b119-d811db76c221 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:44.269472 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90a46344-b910-421b-b119-d811db76c221 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:44.269923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90a46344-b910-421b-b119-d811db76c221 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:44.270642 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90a46344-b910-421b-b119-d811db76c221 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:44.271061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90a46344-b910-421b-b119-d811db76c221 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:44.271473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-90a46344-b910-421b-b119-d811db76c221 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:44.408064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-90a46344-b910-421b-b119-d811db76c221 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:36:44.416283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-90a46344-b910-421b-b119-d811db76c221 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1367 microversion: 2.1 time: 0.158809 Sep 13 20:36:44.416846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1412/2745] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:36:44 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:36:45.440230 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:36:45.441882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=6 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:36:45.449506 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-04c4e6c6-468c-4baf-af99-d327a05399e8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:36:45.450723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-04c4e6c6-468c-4baf-af99-d327a05399e8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:45.462308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04c4e6c6-468c-4baf-af99-d327a05399e8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:45.463220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04c4e6c6-468c-4baf-af99-d327a05399e8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:45.463943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04c4e6c6-468c-4baf-af99-d327a05399e8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:45.465071 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04c4e6c6-468c-4baf-af99-d327a05399e8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:45.465822 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04c4e6c6-468c-4baf-af99-d327a05399e8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:45.466583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04c4e6c6-468c-4baf-af99-d327a05399e8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:45.606627 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-04c4e6c6-468c-4baf-af99-d327a05399e8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:36:45.614829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-04c4e6c6-468c-4baf-af99-d327a05399e8 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1557 microversion: 2.1 time: 0.177252 Sep 13 20:36:45.615395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1334/2746] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:36:45 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1557 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:36:45.638505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9837078a-1783-460d-bb30-3809216fec4f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:36:45.639040 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9837078a-1783-460d-bb30-3809216fec4f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:36:45.640943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=6 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:36:45.647080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9837078a-1783-460d-bb30-3809216fec4f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:45.647560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9837078a-1783-460d-bb30-3809216fec4f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:45.647995 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9837078a-1783-460d-bb30-3809216fec4f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:45.648681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9837078a-1783-460d-bb30-3809216fec4f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:45.649123 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9837078a-1783-460d-bb30-3809216fec4f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:45.649531 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9837078a-1783-460d-bb30-3809216fec4f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:45.739185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9837078a-1783-460d-bb30-3809216fec4f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104590 Sep 13 20:36:45.739761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1413/2747] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 13 20:36:45 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:36:46.691739 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-a70754b6-fbc3-49bd-a71d-96a8e6ad9db6 req-515938e8-8231-4524-898d-f4d535381240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f473d0db-2df5-4cab-be22-87f507a90c42", "tag": "b8208a0c-8a44-4c4c-9abb-4306bc486dbb"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:36:46.697358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:36:46.697526 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:36:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 13 20:36:46.707284 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-a70754b6-fbc3-49bd-a71d-96a8e6ad9db6 req-515938e8-8231-4524-898d-f4d535381240 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:36:46.707758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-a70754b6-fbc3-49bd-a71d-96a8e6ad9db6 req-515938e8-8231-4524-898d-f4d535381240 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:36:46.708186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-a70754b6-fbc3-49bd-a71d-96a8e6ad9db6 req-515938e8-8231-4524-898d-f4d535381240 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:36:46.719217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-a70754b6-fbc3-49bd-a71d-96a8e6ad9db6 req-515938e8-8231-4524-898d-f4d535381240 service nova] Creating event network-changed:b8208a0c-8a44-4c4c-9abb-4306bc486dbb for instance f473d0db-2df5-4cab-be22-87f507a90c42 on hv-cinder-85427 Sep 13 20:36:46.724465 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-a70754b6-fbc3-49bd-a71d-96a8e6ad9db6 req-515938e8-8231-4524-898d-f4d535381240 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036838 Sep 13 20:36:46.725244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1335/2748] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:37:22.326275 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:37:22.327576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=34 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:37:22.333715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-264d630a-0302-4ebc-89ed-44ca57c2cd74 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:22.334593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-264d630a-0302-4ebc-89ed-44ca57c2cd74 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:22.346420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-264d630a-0302-4ebc-89ed-44ca57c2cd74 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:22.347225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-264d630a-0302-4ebc-89ed-44ca57c2cd74 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:22.347928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-264d630a-0302-4ebc-89ed-44ca57c2cd74 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:22.349038 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-264d630a-0302-4ebc-89ed-44ca57c2cd74 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:22.349766 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-264d630a-0302-4ebc-89ed-44ca57c2cd74 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:22.350543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-264d630a-0302-4ebc-89ed-44ca57c2cd74 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:22.376888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-264d630a-0302-4ebc-89ed-44ca57c2cd74 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Going to try to terminate instance {{(pid=120844) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:37:22.459108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-264d630a-0302-4ebc-89ed-44ca57c2cd74 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 204 len: 0 microversion: 2.1 time: 0.134929 Sep 13 20:37:22.459763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1414/2749] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:37:22 2022] DELETE /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:37:22.466043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:37:22.466790 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:37:22.470804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-ea0daa6a-5af3-45a9-a282-c18345a6b5fa tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:22.471490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-ea0daa6a-5af3-45a9-a282-c18345a6b5fa tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:22.480997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ea0daa6a-5af3-45a9-a282-c18345a6b5fa tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:22.481444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ea0daa6a-5af3-45a9-a282-c18345a6b5fa tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:22.481875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ea0daa6a-5af3-45a9-a282-c18345a6b5fa tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:22.482583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ea0daa6a-5af3-45a9-a282-c18345a6b5fa tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:22.483026 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ea0daa6a-5af3-45a9-a282-c18345a6b5fa tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:22.483443 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-ea0daa6a-5af3-45a9-a282-c18345a6b5fa tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:22.621965 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-ea0daa6a-5af3-45a9-a282-c18345a6b5fa tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:22.630076 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-ea0daa6a-5af3-45a9-a282-c18345a6b5fa tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1579 microversion: 2.1 time: 0.165575 Sep 13 20:37:22.630659 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1336/2750] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:22 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:22.913041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3416f9dc-e97d-4e75-b626-dc56a3d9c5be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:22.913549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3416f9dc-e97d-4e75-b626-dc56a3d9c5be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:22.920069 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3416f9dc-e97d-4e75-b626-dc56a3d9c5be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:22.920547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3416f9dc-e97d-4e75-b626-dc56a3d9c5be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:22.920973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3416f9dc-e97d-4e75-b626-dc56a3d9c5be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:22.921657 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3416f9dc-e97d-4e75-b626-dc56a3d9c5be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:22.922106 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3416f9dc-e97d-4e75-b626-dc56a3d9c5be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:22.922561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3416f9dc-e97d-4e75-b626-dc56a3d9c5be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:22.946184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3416f9dc-e97d-4e75-b626-dc56a3d9c5be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42/ips" status: 200 len: 150 microversion: 2.1 time: 0.040794 Sep 13 20:37:22.946767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1415/2751] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 13 20:37:22 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:37:22.963559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bc29e47b-7564-45c2-bcff-ea32a2ef0ed0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bacba97-0b86-4563-a73f-4bfc569f816a"}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:22.965896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-bc29e47b-7564-45c2-bcff-ea32a2ef0ed0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:22.972888 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc29e47b-7564-45c2-bcff-ea32a2ef0ed0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:22.973376 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc29e47b-7564-45c2-bcff-ea32a2ef0ed0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:22.973810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc29e47b-7564-45c2-bcff-ea32a2ef0ed0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:22.974601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc29e47b-7564-45c2-bcff-ea32a2ef0ed0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:22.975058 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc29e47b-7564-45c2-bcff-ea32a2ef0ed0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:22.975563 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-bc29e47b-7564-45c2-bcff-ea32a2ef0ed0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:23.056878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-bc29e47b-7564-45c2-bcff-ea32a2ef0ed0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Invalid volume: volume 8bacba97-0b86-4563-a73f-4bfc569f816a is already attached to instances: e811c557-1b94-4700-aa3a-3fdceb873fb4 Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bc29e47b-7564-45c2-bcff-ea32a2ef0ed0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: POST /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42/os-volume_attachments HTTP/1.1 Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 74 Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:37:23.058949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:37:23.060214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:37:23.060214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:37:23.060214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:37:23.060214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:37:23.060214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:37:23.060214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:37:23.060214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:37:23.060214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:37:23.060214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:37:23.060214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Sep 13 20:37:23.060214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {"volumeAttachment": {"volumeId": "8bacba97-0b86-4563-a73f-4bfc569f816a"}} Sep 13 20:37:23.060214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Invalid volume: volume 8bacba97-0b86-4563-a73f-4bfc569f816a is already attached to instances: e811c557-1b94-4700-aa3a-3fdceb873fb4 Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'server_id': 'f473d0db-2df5-4cab-be22-87f507a90c42', 'body': {'volumeAttachment': {'volumeId': '8bacba97-0b86-4563-a73f-4bfc569f816a'}}} Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8bacba97-0b86-4563-a73f-4bfc569f816a is already attached to instances: e811c557-1b94-4700-aa3a-3fdceb873fb4 Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:37:23.061042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8bacba97-0b86-4563-a73f-4bfc569f816a is already attached to instances: e811c557-1b94-4700-aa3a-3fdceb873fb4 Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:23.062134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:23.063209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:23.063209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:37:23.063209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:37:23.063209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8bacba97-0b86-4563-a73f-4bfc569f816a is already attached to instances: e811c557-1b94-4700-aa3a-3fdceb873fb4 Sep 13 20:37:23.063209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:37:23.063209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-bc29e47b-7564-45c2-bcff-ea32a2ef0ed0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 400 to user: Invalid volume: volume 8bacba97-0b86-4563-a73f-4bfc569f816a is already attached to instances: e811c557-1b94-4700-aa3a-3fdceb873fb4 {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:37:23.063209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bc29e47b-7564-45c2-bcff-ea32a2ef0ed0 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101820 Sep 13 20:37:23.063209 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1337/2752] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 13 20:37:22 2022] POST /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:37:23.069998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-153ab7a8-b7b9-40ea-a14e-2faf93e9e273 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:23.070521 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-153ab7a8-b7b9-40ea-a14e-2faf93e9e273 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:23.076973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-153ab7a8-b7b9-40ea-a14e-2faf93e9e273 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:23.077454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-153ab7a8-b7b9-40ea-a14e-2faf93e9e273 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:23.077883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-153ab7a8-b7b9-40ea-a14e-2faf93e9e273 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:23.078608 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-153ab7a8-b7b9-40ea-a14e-2faf93e9e273 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:23.079055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-153ab7a8-b7b9-40ea-a14e-2faf93e9e273 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:23.079469 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-153ab7a8-b7b9-40ea-a14e-2faf93e9e273 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:23.107876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-153ab7a8-b7b9-40ea-a14e-2faf93e9e273 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Going to try to terminate instance {{(pid=120844) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:37:23.188476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-153ab7a8-b7b9-40ea-a14e-2faf93e9e273 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 204 len: 0 microversion: 2.1 time: 0.122671 Sep 13 20:37:23.188969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1416/2753] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:37:23 2022] DELETE /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:37:23.197599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7b2419ab-6e2a-4431-98e8-211589e1e834 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:23.198207 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7b2419ab-6e2a-4431-98e8-211589e1e834 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:23.204509 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b2419ab-6e2a-4431-98e8-211589e1e834 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:23.204980 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b2419ab-6e2a-4431-98e8-211589e1e834 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:23.205406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b2419ab-6e2a-4431-98e8-211589e1e834 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:23.206086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b2419ab-6e2a-4431-98e8-211589e1e834 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:23.206576 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b2419ab-6e2a-4431-98e8-211589e1e834 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:23.206991 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7b2419ab-6e2a-4431-98e8-211589e1e834 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:23.344896 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7b2419ab-6e2a-4431-98e8-211589e1e834 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:23.352858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7b2419ab-6e2a-4431-98e8-211589e1e834 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1682 microversion: 2.1 time: 0.159227 Sep 13 20:37:23.353385 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1338/2754] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:23 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:23.658689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8d5a414e-be94-406f-b610-dee72a7410d1 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:23.659827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-8d5a414e-be94-406f-b610-dee72a7410d1 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:23.667966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d5a414e-be94-406f-b610-dee72a7410d1 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:23.668445 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d5a414e-be94-406f-b610-dee72a7410d1 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:23.668876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d5a414e-be94-406f-b610-dee72a7410d1 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:23.669556 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d5a414e-be94-406f-b610-dee72a7410d1 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:23.670005 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d5a414e-be94-406f-b610-dee72a7410d1 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:23.670420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-8d5a414e-be94-406f-b610-dee72a7410d1 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:23.804969 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-8d5a414e-be94-406f-b610-dee72a7410d1 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:23.817925 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8d5a414e-be94-406f-b610-dee72a7410d1 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1579 microversion: 2.1 time: 0.166496 Sep 13 20:37:23.818776 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1417/2755] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:23 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:24.381649 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e8158019-2408-48d3-919c-8b8cc22430fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:24.382678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e8158019-2408-48d3-919c-8b8cc22430fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:24.389809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8158019-2408-48d3-919c-8b8cc22430fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:24.390286 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8158019-2408-48d3-919c-8b8cc22430fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:24.390758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8158019-2408-48d3-919c-8b8cc22430fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:24.391432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8158019-2408-48d3-919c-8b8cc22430fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:24.391869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8158019-2408-48d3-919c-8b8cc22430fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:24.392288 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e8158019-2408-48d3-919c-8b8cc22430fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:24.532409 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e8158019-2408-48d3-919c-8b8cc22430fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:24.540617 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e8158019-2408-48d3-919c-8b8cc22430fc tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1682 microversion: 2.1 time: 0.165664 Sep 13 20:37:24.541428 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1339/2756] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:24 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:24.844719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9aa42ccf-62ae-4438-9bfd-53ea6ac9d495 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:24.845620 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9aa42ccf-62ae-4438-9bfd-53ea6ac9d495 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:24.855171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9aa42ccf-62ae-4438-9bfd-53ea6ac9d495 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:24.855864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9aa42ccf-62ae-4438-9bfd-53ea6ac9d495 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:24.856480 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9aa42ccf-62ae-4438-9bfd-53ea6ac9d495 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:24.857455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9aa42ccf-62ae-4438-9bfd-53ea6ac9d495 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:24.858096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9aa42ccf-62ae-4438-9bfd-53ea6ac9d495 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:24.858745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9aa42ccf-62ae-4438-9bfd-53ea6ac9d495 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:24.992216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9aa42ccf-62ae-4438-9bfd-53ea6ac9d495 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:25.000463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9aa42ccf-62ae-4438-9bfd-53ea6ac9d495 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1579 microversion: 2.1 time: 0.161331 Sep 13 20:37:25.001033 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1418/2757] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:24 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:25.564319 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-681e88b0-f5b2-4dc8-b450-ffd12d8f9106 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:25.564912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-681e88b0-f5b2-4dc8-b450-ffd12d8f9106 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:25.572246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-681e88b0-f5b2-4dc8-b450-ffd12d8f9106 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:25.572981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-681e88b0-f5b2-4dc8-b450-ffd12d8f9106 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:25.573161 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-681e88b0-f5b2-4dc8-b450-ffd12d8f9106 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:25.573865 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-681e88b0-f5b2-4dc8-b450-ffd12d8f9106 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:25.574306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-681e88b0-f5b2-4dc8-b450-ffd12d8f9106 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:25.574761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-681e88b0-f5b2-4dc8-b450-ffd12d8f9106 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:25.887768 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-681e88b0-f5b2-4dc8-b450-ffd12d8f9106 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:25.895986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-681e88b0-f5b2-4dc8-b450-ffd12d8f9106 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1682 microversion: 2.1 time: 0.335773 Sep 13 20:37:25.896673 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1340/2758] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:25 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1682 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:26.024224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6cb9bc50-d950-408f-aa9d-a67fac088454 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:26.025159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6cb9bc50-d950-408f-aa9d-a67fac088454 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:26.031987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cb9bc50-d950-408f-aa9d-a67fac088454 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:26.032547 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cb9bc50-d950-408f-aa9d-a67fac088454 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:26.033044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cb9bc50-d950-408f-aa9d-a67fac088454 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:26.033779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cb9bc50-d950-408f-aa9d-a67fac088454 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:26.034462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cb9bc50-d950-408f-aa9d-a67fac088454 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:26.034871 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6cb9bc50-d950-408f-aa9d-a67fac088454 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:26.104970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6cb9bc50-d950-408f-aa9d-a67fac088454 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:26.114987 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6cb9bc50-d950-408f-aa9d-a67fac088454 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1511 microversion: 2.1 time: 0.094704 Sep 13 20:37:26.115594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1419/2759] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:26 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1511 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:26.597140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-0d5ba419-70d2-45ce-bf2d-db6c410a1fb0 req-4cfb3855-9a84-4fa8-91e8-6bdeae0e31af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f473d0db-2df5-4cab-be22-87f507a90c42", "name": "network-vif-deleted", "tag": "b8208a0c-8a44-4c4c-9abb-4306bc486dbb"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:26.625393 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0d5ba419-70d2-45ce-bf2d-db6c410a1fb0 req-4cfb3855-9a84-4fa8-91e8-6bdeae0e31af service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:26.625877 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0d5ba419-70d2-45ce-bf2d-db6c410a1fb0 req-4cfb3855-9a84-4fa8-91e8-6bdeae0e31af service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:26.626306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-0d5ba419-70d2-45ce-bf2d-db6c410a1fb0 req-4cfb3855-9a84-4fa8-91e8-6bdeae0e31af service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:26.653992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-0d5ba419-70d2-45ce-bf2d-db6c410a1fb0 req-4cfb3855-9a84-4fa8-91e8-6bdeae0e31af service nova] Creating event network-vif-deleted:b8208a0c-8a44-4c4c-9abb-4306bc486dbb for instance f473d0db-2df5-4cab-be22-87f507a90c42 on hv-cinder-85427 Sep 13 20:37:26.665001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-0d5ba419-70d2-45ce-bf2d-db6c410a1fb0 req-4cfb3855-9a84-4fa8-91e8-6bdeae0e31af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071376 Sep 13 20:37:26.666305 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1341/2760] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:37:26.919693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:26.920641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:26.927623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:26.928329 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:26.928943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:26.929878 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:26.930689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:26.931304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:26.971637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:26.972344 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:26.972961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:26.973612 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lazy-loading 'fault' on Instance uuid f473d0db-2df5-4cab-be22-87f507a90c42 {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:37:27.016152 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:27.024507 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-1d5e0c78-d318-44db-8d13-5e56af086de9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 200 len: 1331 microversion: 2.1 time: 0.108650 Sep 13 20:37:27.026268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1420/2761] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:26 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:27.140249 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:27.141606 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:27.154354 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:27.155473 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:27.156128 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:27.157193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:27.157899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:27.158587 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:27.216191 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:27.216740 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:27.217192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:27.218706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.objects.instance [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lazy-loading 'fault' on Instance uuid 6fbe786d-befa-4ca2-a407-2f0236d91426 {{(pid=120845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:37:27.293726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-03582dbc-8805-4840-88fc-1784272e070d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:27.294227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-03582dbc-8805-4840-88fc-1784272e070d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:27.301499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:27.312465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03582dbc-8805-4840-88fc-1784272e070d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:27.313299 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03582dbc-8805-4840-88fc-1784272e070d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:27.313784 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03582dbc-8805-4840-88fc-1784272e070d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:27.314735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03582dbc-8805-4840-88fc-1784272e070d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:27.315750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03582dbc-8805-4840-88fc-1784272e070d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:27.316349 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-03582dbc-8805-4840-88fc-1784272e070d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:27.317411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e0a78644-2804-4f32-9a9c-ef72757c1eae tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 200 len: 1231 microversion: 2.1 time: 0.182225 Sep 13 20:37:27.319812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1342/2762] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:27 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 1231 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:27.346081 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-03582dbc-8805-4840-88fc-1784272e070d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] HTTP exception thrown: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-03582dbc-8805-4840-88fc-1784272e070d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Request method failure captured: Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: DELETE /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 HTTP/1.1 Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIODidLRoRmcjg7W6PrVDX3azn8wN_DgqcJ1XeErPIodK6DRBoSHefF9pi_H8_pumHuSJq83GYzd--3H2QSDYEHtV_dhV-TkRchCLv9McxRRshkC0rH-qkkhNj5UsAfgHIAdNzvGDHfcPdP2cCsaYCie94FHs76UkRw0szdCgh5CRomw Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: fdc8b1b561f247ed84babfad941e55f6 Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:37:27.348056 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:37:27.349302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdc8b1b561f247ed84babfad941e55f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdc8b1b561f247ed84babfad941e55f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdc8b1b561f247ed84babfad941e55f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdc8b1b561f247ed84babfad941e55f6"}]}] Sep 13 20:37:27.349302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:37:27.349302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: fdc8b1b561f247ed84babfad941e55f6 Sep 13 20:37:27.349302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:37:27.349302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeShelveTestJSON-1922037285-project Sep 13 20:37:27.349302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:37:27.349302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:37:27.349302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: b07b8b251aaa456c9916c41f9a0b77e3 Sep 13 20:37:27.349302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1922037285-project Sep 13 20:37:27.349302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:37:27.349302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:37:27.349302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '86eb3378-3f47-453b-a57e-31bf51583061'} Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:37:27.349964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:37:27.351239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:27.352339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-03582dbc-8805-4840-88fc-1784272e070d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Returning 404 to user: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:37:27.352339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-03582dbc-8805-4840-88fc-1784272e070d tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "DELETE /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 404 len: 111 microversion: 2.20 time: 0.060392 Sep 13 20:37:27.352339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1421/2763] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 13 20:37:27 2022] DELETE /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 20:37:27.358669 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fa717d87-09b5-4849-ba8b-bf30cc14c6cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:27.359287 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fa717d87-09b5-4849-ba8b-bf30cc14c6cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 86eb3378-3f47-453b-a57e-31bf51583061] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:27.365826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa717d87-09b5-4849-ba8b-bf30cc14c6cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:27.366317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa717d87-09b5-4849-ba8b-bf30cc14c6cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:27.366914 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa717d87-09b5-4849-ba8b-bf30cc14c6cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:27.367933 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa717d87-09b5-4849-ba8b-bf30cc14c6cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:27.368406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa717d87-09b5-4849-ba8b-bf30cc14c6cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:27.368830 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa717d87-09b5-4849-ba8b-bf30cc14c6cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:27.388062 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-fa717d87-09b5-4849-ba8b-bf30cc14c6cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] HTTP exception thrown: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fa717d87-09b5-4849-ba8b-bf30cc14c6cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Request method failure captured: Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 HTTP/1.1 Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIODidLRoRmcjg7W6PrVDX3azn8wN_DgqcJ1XeErPIodK6DRBoSHefF9pi_H8_pumHuSJq83GYzd--3H2QSDYEHtV_dhV-TkRchCLv9McxRRshkC0rH-qkkhNj5UsAfgHIAdNzvGDHfcPdP2cCsaYCie94FHs76UkRw0szdCgh5CRomw Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: fdc8b1b561f247ed84babfad941e55f6 Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:37:27.390139 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:37:27.391660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdc8b1b561f247ed84babfad941e55f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdc8b1b561f247ed84babfad941e55f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdc8b1b561f247ed84babfad941e55f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdc8b1b561f247ed84babfad941e55f6"}]}] Sep 13 20:37:27.391660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:37:27.391660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: fdc8b1b561f247ed84babfad941e55f6 Sep 13 20:37:27.391660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:37:27.391660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-AttachVolumeShelveTestJSON-1922037285-project Sep 13 20:37:27.391660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:37:27.391660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:37:27.391660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: b07b8b251aaa456c9916c41f9a0b77e3 Sep 13 20:37:27.391660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1922037285-project Sep 13 20:37:27.391660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:37:27.391660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:37:27.391660 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '86eb3378-3f47-453b-a57e-31bf51583061'} Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:37:27.392446 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. Sep 13 20:37:27.393721 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:37:27.395716 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fa717d87-09b5-4849-ba8b-bf30cc14c6cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Returning 404 to user: Instance 86eb3378-3f47-453b-a57e-31bf51583061 could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:37:27.396572 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fa717d87-09b5-4849-ba8b-bf30cc14c6cd tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061" status: 404 len: 111 microversion: 2.20 time: 0.042302 Sep 13 20:37:27.397132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1343/2764] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:37:27 2022] GET /compute/v2.1/servers/86eb3378-3f47-453b-a57e-31bf51583061 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:37:28.052468 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-05fa43c6-ae7d-449a-9ace-0bec243081ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:28.053467 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-05fa43c6-ae7d-449a-9ace-0bec243081ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:28.060843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-05fa43c6-ae7d-449a-9ace-0bec243081ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:28.061377 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-05fa43c6-ae7d-449a-9ace-0bec243081ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:28.061868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-05fa43c6-ae7d-449a-9ace-0bec243081ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:28.062678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-05fa43c6-ae7d-449a-9ace-0bec243081ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:28.063181 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-05fa43c6-ae7d-449a-9ace-0bec243081ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:28.063654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-05fa43c6-ae7d-449a-9ace-0bec243081ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:28.079175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-05fa43c6-ae7d-449a-9ace-0bec243081ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-05fa43c6-ae7d-449a-9ace-0bec243081ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 HTTP/1.1 Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:37:28.080863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:37:28.082204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:37:28.082204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:37:28.082204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:37:28.082204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:37:28.082204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:37:28.082204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:37:28.082204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:37:28.082204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:37:28.082204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:37:28.082204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:37:28.082204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:37:28.082204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': 'f473d0db-2df5-4cab-be22-87f507a90c42'} Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:37:28.083020 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:37:28.084354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.085678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-05fa43c6-ae7d-449a-9ace-0bec243081ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 404 to user: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:37:28.085678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-05fa43c6-ae7d-449a-9ace-0bec243081ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 404 len: 111 microversion: 2.1 time: 0.036410 Sep 13 20:37:28.085678 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1422/2765] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:28 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:37:28.091757 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-14b33fba-3e26-4c9d-957c-316b848468a9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '.version_select at 0x7f98465e0e50>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:28.118045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-14b33fba-3e26-4c9d-957c-316b848468a9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115808278" status: 202 len: 0 microversion: 2.1 time: 0.029893 Sep 13 20:37:28.118640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1344/2766] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 13 20:37:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115808278 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:37:28.343815 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-12ef05ce-e84b-4616-8107-823e19f47d72 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:28.344455 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-12ef05ce-e84b-4616-8107-823e19f47d72 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:28.351205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12ef05ce-e84b-4616-8107-823e19f47d72 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:28.351699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12ef05ce-e84b-4616-8107-823e19f47d72 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:28.352121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12ef05ce-e84b-4616-8107-823e19f47d72 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:28.352806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12ef05ce-e84b-4616-8107-823e19f47d72 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:28.353249 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12ef05ce-e84b-4616-8107-823e19f47d72 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:28.353683 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-12ef05ce-e84b-4616-8107-823e19f47d72 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:28.369894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-12ef05ce-e84b-4616-8107-823e19f47d72 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] HTTP exception thrown: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-12ef05ce-e84b-4616-8107-823e19f47d72 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Request method failure captured: Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 HTTP/1.1 Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOlfurhb6C5h7VciDa1Wurp46NflGUT3i1Go58ec7QqHXXOJEfHj2rDNzUhT5qJoU1P-AwIp31uOunAUuqXB-PCBA3lgteqdV64tujqR_K_4wJru__NYwIPbg8MwIMYY7xH9iGRNfER3r8egKpWTsDXY5ZwcieuLHu_r5qgYqIBjYKg Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: 7878c5e6e1e143199681f42b5518cc1a Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-TestVolumeBootPattern-845022340 Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:37:28.371392 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:37:28.372821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7878c5e6e1e143199681f42b5518cc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7878c5e6e1e143199681f42b5518cc1a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7878c5e6e1e143199681f42b5518cc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7878c5e6e1e143199681f42b5518cc1a"}]}] Sep 13 20:37:28.372821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-TestVolumeBootPattern-845022340 Sep 13 20:37:28.372821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: 7878c5e6e1e143199681f42b5518cc1a Sep 13 20:37:28.372821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-TestVolumeBootPattern-845022340 Sep 13 20:37:28.372821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-TestVolumeBootPattern-845022340-project Sep 13 20:37:28.372821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:37:28.372821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:37:28.372821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: d20ba942c80848d7819aede8c0df1e7f Sep 13 20:37:28.372821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-TestVolumeBootPattern-845022340-project Sep 13 20:37:28.372821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:37:28.372821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:37:28.372821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '6fbe786d-befa-4ca2-a407-2f0236d91426'} Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:37:28.373591 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:37:28.374935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.376089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-12ef05ce-e84b-4616-8107-823e19f47d72 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Returning 404 to user: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:37:28.376089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-12ef05ce-e84b-4616-8107-823e19f47d72 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 404 len: 111 microversion: 2.1 time: 0.033010 Sep 13 20:37:28.376089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1423/2767] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:28 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:37:28.471082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-429121628", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1825705146", "security_groups": [{"name": "tempest-secgroup-smoke-1143406358"}], "block_device_mapping_v2": [{"uuid": "4f624eb4-0103-4241-9021-6b9eed2c2160", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd499434-1878-432b-bf48-fb9c3dc32248"}]}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:28.561555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f0d25a14-cf72-4ccd-807e-144c79119fdf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:28.562089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f0d25a14-cf72-4ccd-807e-144c79119fdf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:28.569924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0d25a14-cf72-4ccd-807e-144c79119fdf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:28.570439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0d25a14-cf72-4ccd-807e-144c79119fdf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:28.570944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0d25a14-cf72-4ccd-807e-144c79119fdf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:28.571643 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0d25a14-cf72-4ccd-807e-144c79119fdf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:28.572285 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0d25a14-cf72-4ccd-807e-144c79119fdf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:28.572964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f0d25a14-cf72-4ccd-807e-144c79119fdf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:28.587456 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-f0d25a14-cf72-4ccd-807e-144c79119fdf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] HTTP exception thrown: Instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 could not be found. Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f0d25a14-cf72-4ccd-807e-144c79119fdf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Request method failure captured: Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: DELETE /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 HTTP/1.1 Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIODidLRoRmcjg7W6PrVDX3azn8wN_DgqcJ1XeErPIodK6DRBoSHefF9pi_H8_pumHuSJq83GYzd--3H2QSDYEHtV_dhV-TkRchCLv9McxRRshkC0rH-qkkhNj5UsAfgHIAdNzvGDHfcPdP2cCsaYCie94FHs76UkRw0szdCgh5CRomw Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: fdc8b1b561f247ed84babfad941e55f6 Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:37:28.589016 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:37:28.590278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdc8b1b561f247ed84babfad941e55f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdc8b1b561f247ed84babfad941e55f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdc8b1b561f247ed84babfad941e55f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdc8b1b561f247ed84babfad941e55f6"}]}] Sep 13 20:37:28.590278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:37:28.590278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: fdc8b1b561f247ed84babfad941e55f6 Sep 13 20:37:28.590278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:37:28.590278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeShelveTestJSON-1922037285-project Sep 13 20:37:28.590278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:37:28.590278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:37:28.590278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: b07b8b251aaa456c9916c41f9a0b77e3 Sep 13 20:37:28.590278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1922037285-project Sep 13 20:37:28.590278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:37:28.590278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 could not be found. Sep 13 20:37:28.590278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '8d0decb4-2f46-4f2f-860f-e8ca277f7080'} Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 could not be found. Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:37:28.590964 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 could not be found. Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 could not be found. Sep 13 20:37:28.592032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.593137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f0d25a14-cf72-4ccd-807e-144c79119fdf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Returning 404 to user: Instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:37:28.593137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f0d25a14-cf72-4ccd-807e-144c79119fdf tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 404 len: 111 microversion: 2.20 time: 0.032797 Sep 13 20:37:28.593137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1424/2768] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 13 20:37:28 2022] DELETE /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:37:28.599004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2feafa0f-79dc-435f-9652-dd8be0eb08ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:28.599603 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2feafa0f-79dc-435f-9652-dd8be0eb08ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] [instance: 8d0decb4-2f46-4f2f-860f-e8ca277f7080] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:28.605506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2feafa0f-79dc-435f-9652-dd8be0eb08ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:28.605980 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2feafa0f-79dc-435f-9652-dd8be0eb08ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:28.606403 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2feafa0f-79dc-435f-9652-dd8be0eb08ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:28.607266 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2feafa0f-79dc-435f-9652-dd8be0eb08ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:28.607682 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2feafa0f-79dc-435f-9652-dd8be0eb08ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:28.608070 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2feafa0f-79dc-435f-9652-dd8be0eb08ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:28.615152 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.network.neutron [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] validate_networks() for [('fd499434-1878-432b-bf48-fb9c3dc32248', None, None, None, None, None)] {{(pid=120845) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:37:28.622660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-2feafa0f-79dc-435f-9652-dd8be0eb08ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] HTTP exception thrown: Instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 could not be found. Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2feafa0f-79dc-435f-9652-dd8be0eb08ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Request method failure captured: Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 HTTP/1.1 Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIODidLRoRmcjg7W6PrVDX3azn8wN_DgqcJ1XeErPIodK6DRBoSHefF9pi_H8_pumHuSJq83GYzd--3H2QSDYEHtV_dhV-TkRchCLv9McxRRshkC0rH-qkkhNj5UsAfgHIAdNzvGDHfcPdP2cCsaYCie94FHs76UkRw0szdCgh5CRomw Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: fdc8b1b561f247ed84babfad941e55f6 Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:37:28.624116 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:37:28.625414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdc8b1b561f247ed84babfad941e55f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdc8b1b561f247ed84babfad941e55f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdc8b1b561f247ed84babfad941e55f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdc8b1b561f247ed84babfad941e55f6"}]}] Sep 13 20:37:28.625414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:37:28.625414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: fdc8b1b561f247ed84babfad941e55f6 Sep 13 20:37:28.625414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1922037285 Sep 13 20:37:28.625414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeShelveTestJSON-1922037285-project Sep 13 20:37:28.625414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:37:28.625414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:37:28.625414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: b07b8b251aaa456c9916c41f9a0b77e3 Sep 13 20:37:28.625414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1922037285-project Sep 13 20:37:28.625414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:37:28.625414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 could not be found. Sep 13 20:37:28.625414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '8d0decb4-2f46-4f2f-860f-e8ca277f7080'} Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 could not be found. Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:37:28.626079 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 could not be found. Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 could not be found. Sep 13 20:37:28.627148 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:28.628088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2feafa0f-79dc-435f-9652-dd8be0eb08ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] Returning 404 to user: Instance 8d0decb4-2f46-4f2f-860f-e8ca277f7080 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:37:28.628088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2feafa0f-79dc-435f-9652-dd8be0eb08ae tempest-AttachVolumeShelveTestJSON-1922037285 tempest-AttachVolumeShelveTestJSON-1922037285-project] 10.222.0.52 "GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080" status: 404 len: 111 microversion: 2.20 time: 0.030291 Sep 13 20:37:28.628088 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1425/2769] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 13 20:37:28 2022] GET /compute/v2.1/servers/8d0decb4-2f46-4f2f-860f-e8ca277f7080 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 20:37:28.948003 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-bfeb83f6-de83-4c87-b724-c36908ce6c9e req-f158fde1-e698-454e-bc5c-d5681c04f9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbe786d-befa-4ca2-a407-2f0236d91426", "name": "network-vif-deleted", "tag": "f6387068-e330-4c79-a56a-cf69db784b16"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:28.958248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-bfeb83f6-de83-4c87-b724-c36908ce6c9e req-f158fde1-e698-454e-bc5c-d5681c04f9e8 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:28.958728 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-bfeb83f6-de83-4c87-b724-c36908ce6c9e req-f158fde1-e698-454e-bc5c-d5681c04f9e8 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:28.959179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-bfeb83f6-de83-4c87-b724-c36908ce6c9e req-f158fde1-e698-454e-bc5c-d5681c04f9e8 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:28.971640 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-bfeb83f6-de83-4c87-b724-c36908ce6c9e req-f158fde1-e698-454e-bc5c-d5681c04f9e8 service nova] Creating event network-vif-deleted:f6387068-e330-4c79-a56a-cf69db784b16 for instance 6fbe786d-befa-4ca2-a407-2f0236d91426 on hv-cinder-85427 Sep 13 20:37:28.978039 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-bfeb83f6-de83-4c87-b724-c36908ce6c9e req-f158fde1-e698-454e-bc5c-d5681c04f9e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034380 Sep 13 20:37:28.978971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1426/2770] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:37:29.237055 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-452f4313-8970-4ff5-a047-72e6b32735b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:29.238398 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-452f4313-8970-4ff5-a047-72e6b32735b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:29.246700 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-452f4313-8970-4ff5-a047-72e6b32735b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:29.247519 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-452f4313-8970-4ff5-a047-72e6b32735b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:29.248236 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-452f4313-8970-4ff5-a047-72e6b32735b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:29.249119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-452f4313-8970-4ff5-a047-72e6b32735b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:29.249761 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-452f4313-8970-4ff5-a047-72e6b32735b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:29.250356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-452f4313-8970-4ff5-a047-72e6b32735b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:29.352779 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-452f4313-8970-4ff5-a047-72e6b32735b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lazy-loading 'services' on Instance uuid e811c557-1b94-4700-aa3a-3fdceb873fb4 {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:37:29.394257 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Flavor limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:37:29.394756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Image limits 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:37:29.395194 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Flavor pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:37:29.395600 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Image pref 0:0:0 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:37:29.396030 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.virt.hardware [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:37:29.405164 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:29.405646 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:29.406078 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:29.406841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:29.407289 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:29.407710 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:29.430693 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Getting quotas for project 7878c5e6e1e143199681f42b5518cc1a. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:37:29.432709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-452f4313-8970-4ff5-a047-72e6b32735b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4/os-volume_attachments/8bacba97-0b86-4563-a73f-4bfc569f816a" status: 202 len: 0 microversion: 2.1 time: 0.199876 Sep 13 20:37:29.433569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1427/2771] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 13 20:37:29 2022] DELETE /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4/os-volume_attachments/8bacba97-0b86-4563-a73f-4bfc569f816a => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 20:37:29.439483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Getting quotas for user d20ba942c80848d7819aede8c0df1e7f and project 7878c5e6e1e143199681f42b5518cc1a. Resources: {'ram', 'cores', 'instances'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:37:29.443420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-fce63ae5-e495-4f96-9025-566a55f232b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:29.446078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-fce63ae5-e495-4f96-9025-566a55f232b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:29.453117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fce63ae5-e495-4f96-9025-566a55f232b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:29.454184 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fce63ae5-e495-4f96-9025-566a55f232b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:29.454656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fce63ae5-e495-4f96-9025-566a55f232b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:29.455454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fce63ae5-e495-4f96-9025-566a55f232b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:29.456052 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fce63ae5-e495-4f96-9025-566a55f232b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:29.456508 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-fce63ae5-e495-4f96-9025-566a55f232b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:29.495935 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-fce63ae5-e495-4f96-9025-566a55f232b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056980 Sep 13 20:37:29.500829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1428/2772] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:37:29 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:37:29.512280 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Going to run 1 instances... {{(pid=120845) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:37:29.514525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f624eb4-0103-4241-9021-6b9eed2c2160',volume_size=None,volume_type=None)] {{(pid=120845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:37:29.656585 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fa36069d-e2a7-4498-a560-d020ab748218 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.189541 Sep 13 20:37:29.657330 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1345/2773] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:37:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:37:29.669209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-28ef9f60-9143-492b-ac3f-e8a0cdb9d5c5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:29.669822 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-28ef9f60-9143-492b-ac3f-e8a0cdb9d5c5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:29.740694 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-28ef9f60-9143-492b-ac3f-e8a0cdb9d5c5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:29.749681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-28ef9f60-9143-492b-ac3f-e8a0cdb9d5c5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1094 microversion: 2.1 time: 0.084600 Sep 13 20:37:29.750268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1429/2774] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:29 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:30.508065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-80d70528-e901-41f0-ad73-e7889fa781bf tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:30.511093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-80d70528-e901-41f0-ad73-e7889fa781bf tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:30.518222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80d70528-e901-41f0-ad73-e7889fa781bf tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:30.518750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80d70528-e901-41f0-ad73-e7889fa781bf tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:30.519198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80d70528-e901-41f0-ad73-e7889fa781bf tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:30.519895 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80d70528-e901-41f0-ad73-e7889fa781bf tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:30.520341 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80d70528-e901-41f0-ad73-e7889fa781bf tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:30.520762 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-80d70528-e901-41f0-ad73-e7889fa781bf tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:30.551361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-80d70528-e901-41f0-ad73-e7889fa781bf tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047445 Sep 13 20:37:30.557616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1346/2775] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:37:30 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 20:37:30.620405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d7fa840f-f665-456f-86f2-89fd39576304 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:30.620950 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d7fa840f-f665-456f-86f2-89fd39576304 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:30.628515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7fa840f-f665-456f-86f2-89fd39576304 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:30.629009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7fa840f-f665-456f-86f2-89fd39576304 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:30.629610 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7fa840f-f665-456f-86f2-89fd39576304 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:30.630755 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7fa840f-f665-456f-86f2-89fd39576304 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:30.631203 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7fa840f-f665-456f-86f2-89fd39576304 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:30.631627 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d7fa840f-f665-456f-86f2-89fd39576304 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:30.657026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d7fa840f-f665-456f-86f2-89fd39576304 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Going to try to terminate instance {{(pid=120844) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:37:30.686577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:37:30.752708 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d7fa840f-f665-456f-86f2-89fd39576304 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 204 len: 0 microversion: 2.1 time: 0.135812 Sep 13 20:37:30.755496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1430/2776] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:37:30 2022] DELETE /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:37:30.763811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3e3a4f6a-995a-42c4-a205-10e42c5df0ca tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:30.764788 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3e3a4f6a-995a-42c4-a205-10e42c5df0ca tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:30.776258 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e3a4f6a-995a-42c4-a205-10e42c5df0ca tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:30.777203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e3a4f6a-995a-42c4-a205-10e42c5df0ca tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:30.777831 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e3a4f6a-995a-42c4-a205-10e42c5df0ca tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:30.778741 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e3a4f6a-995a-42c4-a205-10e42c5df0ca tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:30.780294 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-47829317-35ec-492a-b59b-bcda45e3a90a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:30.781012 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e3a4f6a-995a-42c4-a205-10e42c5df0ca tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:30.782192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3e3a4f6a-995a-42c4-a205-10e42c5df0ca tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:30.783876 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-47829317-35ec-492a-b59b-bcda45e3a90a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:30.806032 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-47829317-35ec-492a-b59b-bcda45e3a90a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:30.806644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-47829317-35ec-492a-b59b-bcda45e3a90a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:30.807108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-47829317-35ec-492a-b59b-bcda45e3a90a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:30.807835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-47829317-35ec-492a-b59b-bcda45e3a90a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:30.808291 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-47829317-35ec-492a-b59b-bcda45e3a90a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:30.808715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-47829317-35ec-492a-b59b-bcda45e3a90a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:30.918361 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-47829317-35ec-492a-b59b-bcda45e3a90a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:30.935449 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-47829317-35ec-492a-b59b-bcda45e3a90a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1200 microversion: 2.1 time: 0.164821 Sep 13 20:37:30.939188 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1431/2777] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:30 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1200 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:31.011583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3e3a4f6a-995a-42c4-a205-10e42c5df0ca tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:31.026823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3e3a4f6a-995a-42c4-a205-10e42c5df0ca tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1680 microversion: 2.1 time: 0.266874 Sep 13 20:37:31.027508 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1347/2778] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:30 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1680 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:31.961493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2150e12c-d020-4d1c-b226-8128ad9eab32 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:31.962473 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2150e12c-d020-4d1c-b226-8128ad9eab32 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:31.970897 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2150e12c-d020-4d1c-b226-8128ad9eab32 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:31.971478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2150e12c-d020-4d1c-b226-8128ad9eab32 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:31.971966 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2150e12c-d020-4d1c-b226-8128ad9eab32 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:31.972963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2150e12c-d020-4d1c-b226-8128ad9eab32 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:31.973529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2150e12c-d020-4d1c-b226-8128ad9eab32 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:31.974193 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2150e12c-d020-4d1c-b226-8128ad9eab32 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:32.052155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3c4cef72-bfb7-4492-93bc-12262c8bfe5b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:32.053629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3c4cef72-bfb7-4492-93bc-12262c8bfe5b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:32.060551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c4cef72-bfb7-4492-93bc-12262c8bfe5b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:32.061639 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c4cef72-bfb7-4492-93bc-12262c8bfe5b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:32.062488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c4cef72-bfb7-4492-93bc-12262c8bfe5b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:32.063336 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c4cef72-bfb7-4492-93bc-12262c8bfe5b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:32.064053 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c4cef72-bfb7-4492-93bc-12262c8bfe5b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:32.064256 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3c4cef72-bfb7-4492-93bc-12262c8bfe5b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:32.075561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2150e12c-d020-4d1c-b226-8128ad9eab32 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:32.087949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2150e12c-d020-4d1c-b226-8128ad9eab32 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1210 microversion: 2.1 time: 0.128664 Sep 13 20:37:32.089154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1432/2779] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:31 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1210 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:32.448516 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3c4cef72-bfb7-4492-93bc-12262c8bfe5b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:32.462193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3c4cef72-bfb7-4492-93bc-12262c8bfe5b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1680 microversion: 2.1 time: 0.415549 Sep 13 20:37:32.463297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1348/2780] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:32 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1680 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:33.113112 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-704e8668-d88b-407d-8301-5f3cb6ab7fee tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:33.114635 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-704e8668-d88b-407d-8301-5f3cb6ab7fee tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:33.122333 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-704e8668-d88b-407d-8301-5f3cb6ab7fee tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:33.122823 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-704e8668-d88b-407d-8301-5f3cb6ab7fee tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:33.123245 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-704e8668-d88b-407d-8301-5f3cb6ab7fee tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:33.124656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-704e8668-d88b-407d-8301-5f3cb6ab7fee tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:33.126006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-704e8668-d88b-407d-8301-5f3cb6ab7fee tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:33.126006 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-704e8668-d88b-407d-8301-5f3cb6ab7fee tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:33.296086 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-704e8668-d88b-407d-8301-5f3cb6ab7fee tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:33.317347 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-704e8668-d88b-407d-8301-5f3cb6ab7fee tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1266 microversion: 2.1 time: 0.206049 Sep 13 20:37:33.321864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1433/2781] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:33 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:33.487715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-712f3703-cf71-45af-b03d-fee73db8ea52 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:33.488324 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-712f3703-cf71-45af-b03d-fee73db8ea52 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:33.494388 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-712f3703-cf71-45af-b03d-fee73db8ea52 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:33.495547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-712f3703-cf71-45af-b03d-fee73db8ea52 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:33.495970 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-712f3703-cf71-45af-b03d-fee73db8ea52 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:33.496742 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-712f3703-cf71-45af-b03d-fee73db8ea52 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:33.497171 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-712f3703-cf71-45af-b03d-fee73db8ea52 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:33.497642 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-712f3703-cf71-45af-b03d-fee73db8ea52 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:33.636072 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-712f3703-cf71-45af-b03d-fee73db8ea52 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:33.650981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-712f3703-cf71-45af-b03d-fee73db8ea52 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 200 len: 1612 microversion: 2.1 time: 0.167826 Sep 13 20:37:33.651943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1349/2782] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:33 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 1612 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:33.863229 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-1e201b97-6a61-465c-a405-e08dd7e5ce51 req-95ac1412-740e-416f-9a3b-d0333b043fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e811c557-1b94-4700-aa3a-3fdceb873fb4", "name": "network-vif-deleted", "tag": "eaf59eeb-029e-40ea-ac71-bb1cd30ac3d2"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:33.876426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-1e201b97-6a61-465c-a405-e08dd7e5ce51 req-95ac1412-740e-416f-9a3b-d0333b043fe7 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:33.877172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-1e201b97-6a61-465c-a405-e08dd7e5ce51 req-95ac1412-740e-416f-9a3b-d0333b043fe7 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:33.877750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-1e201b97-6a61-465c-a405-e08dd7e5ce51 req-95ac1412-740e-416f-9a3b-d0333b043fe7 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:33.908790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-1e201b97-6a61-465c-a405-e08dd7e5ce51 req-95ac1412-740e-416f-9a3b-d0333b043fe7 service nova] Creating event network-vif-deleted:eaf59eeb-029e-40ea-ac71-bb1cd30ac3d2 for instance e811c557-1b94-4700-aa3a-3fdceb873fb4 on hv-cinder-85427 Sep 13 20:37:33.916580 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-1e201b97-6a61-465c-a405-e08dd7e5ce51 req-95ac1412-740e-416f-9a3b-d0333b043fe7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056694 Sep 13 20:37:33.917924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1434/2783] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:37:34.341335 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-489068a4-71f9-41d6-b125-75a4e17b932d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:34.341936 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-489068a4-71f9-41d6-b125-75a4e17b932d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:34.356042 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-489068a4-71f9-41d6-b125-75a4e17b932d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:34.357754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-489068a4-71f9-41d6-b125-75a4e17b932d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:34.358418 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-489068a4-71f9-41d6-b125-75a4e17b932d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:34.359306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-489068a4-71f9-41d6-b125-75a4e17b932d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:34.359908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-489068a4-71f9-41d6-b125-75a4e17b932d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:34.360477 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-489068a4-71f9-41d6-b125-75a4e17b932d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:34.652566 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-489068a4-71f9-41d6-b125-75a4e17b932d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:34.660913 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-489068a4-71f9-41d6-b125-75a4e17b932d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1266 microversion: 2.1 time: 0.323498 Sep 13 20:37:34.661455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1350/2784] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:34 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:34.675661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d168e296-8337-4996-a3b5-7ba4f6ac7c56 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:34.677248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d168e296-8337-4996-a3b5-7ba4f6ac7c56 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:34.684701 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d168e296-8337-4996-a3b5-7ba4f6ac7c56 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:34.685405 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d168e296-8337-4996-a3b5-7ba4f6ac7c56 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:34.685845 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d168e296-8337-4996-a3b5-7ba4f6ac7c56 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:34.686596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d168e296-8337-4996-a3b5-7ba4f6ac7c56 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:34.687059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d168e296-8337-4996-a3b5-7ba4f6ac7c56 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:34.687532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d168e296-8337-4996-a3b5-7ba4f6ac7c56 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:34.702288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-d168e296-8337-4996-a3b5-7ba4f6ac7c56 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d168e296-8337-4996-a3b5-7ba4f6ac7c56 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 HTTP/1.1 Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:37:34.704248 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:37:34.705680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:37:34.705680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:37:34.705680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:37:34.705680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:37:34.705680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:37:34.705680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:37:34.705680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:37:34.705680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:37:34.705680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:37:34.705680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:37:34.705680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:37:34.705680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': 'e811c557-1b94-4700-aa3a-3fdceb873fb4'} Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:37:34.706593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:37:34.707828 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:37:34.709827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d168e296-8337-4996-a3b5-7ba4f6ac7c56 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 404 to user: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:37:34.711022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d168e296-8337-4996-a3b5-7ba4f6ac7c56 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 404 len: 111 microversion: 2.1 time: 0.040045 Sep 13 20:37:34.711743 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1435/2785] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:34 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:37:34.721067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-c6721bbe-a441-4a00-8b7d-b87d87ebeb2e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '.version_select at 0x7f9849cb0700>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:34.744455 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-c6721bbe-a441-4a00-8b7d-b87d87ebeb2e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-538772226" status: 202 len: 0 microversion: 2.1 time: 0.027981 Sep 13 20:37:34.749039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1351/2786] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Sep 13 20:37:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-538772226 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:37:35.590077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4b2bb12f-83a3-43a4-87bb-f4827a2b1b12 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: .version_select at 0x7f9849d83940>, body: {"keypair": {"name": "tempest-keypair-1384927219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBikr/JxUyVwRLuse+S+EYvcH29E9oIqtOkdKz8otyzRPIvY9rR2l3QrY5ToWE5Xq6DEUmME8V4LGwrhgvYALMaQH8p7nObBbyaSgDTPXhgcsxYnlEdO4G/ra//+mMxudg=="}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:35.605465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-4b2bb12f-83a3-43a4-87bb-f4827a2b1b12 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for project be0640c4e0584998a646e45565347687. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:37:35.609453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-4b2bb12f-83a3-43a4-87bb-f4827a2b1b12 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for user 6c42757a041b4831abd7a7ba66cbe933 and project be0640c4e0584998a646e45565347687. Resources: {'key_pairs'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:37:35.633808 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4b2bb12f-83a3-43a4-87bb-f4827a2b1b12 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047560 Sep 13 20:37:35.634466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1436/2787] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 13 20:37:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:37:35.685142 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f8069cec-cfc5-461f-981d-7ca3e88276b3 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:35.685737 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f8069cec-cfc5-461f-981d-7ca3e88276b3 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:35.692949 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8069cec-cfc5-461f-981d-7ca3e88276b3 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:35.693473 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8069cec-cfc5-461f-981d-7ca3e88276b3 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:35.693911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8069cec-cfc5-461f-981d-7ca3e88276b3 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:35.694749 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8069cec-cfc5-461f-981d-7ca3e88276b3 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:35.695444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8069cec-cfc5-461f-981d-7ca3e88276b3 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:35.696070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f8069cec-cfc5-461f-981d-7ca3e88276b3 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:35.846040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f8069cec-cfc5-461f-981d-7ca3e88276b3 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:35.856532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f8069cec-cfc5-461f-981d-7ca3e88276b3 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1266 microversion: 2.1 time: 0.175127 Sep 13 20:37:35.857454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1352/2788] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:35 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:35.953933 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-49840100-0ad0-485b-a322-4623c7374b0d req-d1b594b5-5f91-4efb-b4a5-cbdc9eb1759a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619fedd9-8a78-45a6-ac95-7a35d24d2037", "tag": "3ce031f5-d2d6-4329-8e27-ece36fe16d49"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:35.966821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-49840100-0ad0-485b-a322-4623c7374b0d req-d1b594b5-5f91-4efb-b4a5-cbdc9eb1759a service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:35.967297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-49840100-0ad0-485b-a322-4623c7374b0d req-d1b594b5-5f91-4efb-b4a5-cbdc9eb1759a service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:35.967715 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-49840100-0ad0-485b-a322-4623c7374b0d req-d1b594b5-5f91-4efb-b4a5-cbdc9eb1759a service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:35.986485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-49840100-0ad0-485b-a322-4623c7374b0d req-d1b594b5-5f91-4efb-b4a5-cbdc9eb1759a service nova] Creating event network-changed:3ce031f5-d2d6-4329-8e27-ece36fe16d49 for instance 619fedd9-8a78-45a6-ac95-7a35d24d2037 on hv-cinder-85427 Sep 13 20:37:35.986485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-49840100-0ad0-485b-a322-4623c7374b0d req-d1b594b5-5f91-4efb-b4a5-cbdc9eb1759a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036061 Sep 13 20:37:35.986795 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1437/2789] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:37:36.881975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1402fec4-4cdc-4244-a00f-9b880e6f8cdc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:36.882927 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1402fec4-4cdc-4244-a00f-9b880e6f8cdc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:36.891404 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1402fec4-4cdc-4244-a00f-9b880e6f8cdc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:36.891911 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1402fec4-4cdc-4244-a00f-9b880e6f8cdc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:36.892339 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1402fec4-4cdc-4244-a00f-9b880e6f8cdc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:36.893030 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1402fec4-4cdc-4244-a00f-9b880e6f8cdc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:36.899151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1402fec4-4cdc-4244-a00f-9b880e6f8cdc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:36.899151 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1402fec4-4cdc-4244-a00f-9b880e6f8cdc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:36.992204 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1739101300", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "faf29249-4b45-466b-9b8e-60480aedc097"}], "security_groups": [{"name": "tempest-securitygroup--2040158441"}], "key_name": "tempest-keypair-1384927219", "user_data": "}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:37.030082 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1402fec4-4cdc-4244-a00f-9b880e6f8cdc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:37.038218 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1402fec4-4cdc-4244-a00f-9b880e6f8cdc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1266 microversion: 2.1 time: 0.161830 Sep 13 20:37:37.038879 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1353/2790] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:36 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:37.121896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.network.neutron [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] validate_networks() for [('faf29249-4b45-466b-9b8e-60480aedc097', None, None, None, None, None)] {{(pid=120844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:37:37.630550 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Flavor limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:37:37.630968 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Image limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:37:37.631438 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Flavor pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:37:37.631842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Image pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:37:37.632326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:37:37.641247 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:37.641798 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:37.642297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:37.643054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:37.643513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:37.643923 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:37.661255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for project be0640c4e0584998a646e45565347687. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:37:37.665179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for user 6c42757a041b4831abd7a7ba66cbe933 and project be0640c4e0584998a646e45565347687. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:37:37.676207 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Going to run 1 instances... {{(pid=120844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:37:37.678645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:37:37.728271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-07357c61-7dc5-4d0e-8ff6-95130662bdc4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.741461 Sep 13 20:37:37.729283 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1438/2791] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:37:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 20:37:37.741191 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a56e6136-2d8c-4e36-b5fc-536a350b46e4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:37.742005 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a56e6136-2d8c-4e36-b5fc-536a350b46e4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:37.799990 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a56e6136-2d8c-4e36-b5fc-536a350b46e4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:37.807195 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a56e6136-2d8c-4e36-b5fc-536a350b46e4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1242 microversion: 2.1 time: 0.070835 Sep 13 20:37:37.807758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1354/2792] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:37 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:37:38.063453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-6972bc5f-1372-475e-9c71-559f41ad1437 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:38.064066 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-6972bc5f-1372-475e-9c71-559f41ad1437 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:38.067583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:37:38.072666 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6972bc5f-1372-475e-9c71-559f41ad1437 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:38.073149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6972bc5f-1372-475e-9c71-559f41ad1437 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:38.073582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6972bc5f-1372-475e-9c71-559f41ad1437 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:38.074270 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6972bc5f-1372-475e-9c71-559f41ad1437 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:38.074749 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6972bc5f-1372-475e-9c71-559f41ad1437 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:38.075164 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-6972bc5f-1372-475e-9c71-559f41ad1437 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:38.210862 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-6972bc5f-1372-475e-9c71-559f41ad1437 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:38.218792 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-6972bc5f-1372-475e-9c71-559f41ad1437 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1266 microversion: 2.1 time: 0.159808 Sep 13 20:37:38.219366 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1439/2793] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:38 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:38.830081 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f561cdd3-060b-4771-8db5-8449d9d4065e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:38.830730 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f561cdd3-060b-4771-8db5-8449d9d4065e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:38.837701 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f561cdd3-060b-4771-8db5-8449d9d4065e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:38.838184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f561cdd3-060b-4771-8db5-8449d9d4065e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:38.838670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f561cdd3-060b-4771-8db5-8449d9d4065e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:38.839359 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f561cdd3-060b-4771-8db5-8449d9d4065e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:38.839810 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f561cdd3-060b-4771-8db5-8449d9d4065e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:38.840233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f561cdd3-060b-4771-8db5-8449d9d4065e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:38.902857 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f561cdd3-060b-4771-8db5-8449d9d4065e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:38.910614 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f561cdd3-060b-4771-8db5-8449d9d4065e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1246 microversion: 2.1 time: 0.084378 Sep 13 20:37:38.911184 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1355/2794] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:38 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:39.245441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e49a7a71-9066-48b7-97d3-53d8316d6b28 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:39.246979 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e49a7a71-9066-48b7-97d3-53d8316d6b28 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:39.258354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e49a7a71-9066-48b7-97d3-53d8316d6b28 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:39.258870 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e49a7a71-9066-48b7-97d3-53d8316d6b28 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:39.259289 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e49a7a71-9066-48b7-97d3-53d8316d6b28 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:39.260001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e49a7a71-9066-48b7-97d3-53d8316d6b28 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:39.260450 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e49a7a71-9066-48b7-97d3-53d8316d6b28 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:39.260867 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e49a7a71-9066-48b7-97d3-53d8316d6b28 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:39.411644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e49a7a71-9066-48b7-97d3-53d8316d6b28 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:39.419834 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e49a7a71-9066-48b7-97d3-53d8316d6b28 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1266 microversion: 2.1 time: 0.180893 Sep 13 20:37:39.420407 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1440/2795] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:39 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:39.937111 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a93ab9f0-c7a2-4275-8148-97c70e08d3a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:39.937681 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a93ab9f0-c7a2-4275-8148-97c70e08d3a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:39.940939 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:37:39.947715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a93ab9f0-c7a2-4275-8148-97c70e08d3a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:39.948191 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a93ab9f0-c7a2-4275-8148-97c70e08d3a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:39.948623 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a93ab9f0-c7a2-4275-8148-97c70e08d3a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:39.949308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a93ab9f0-c7a2-4275-8148-97c70e08d3a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:39.949758 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a93ab9f0-c7a2-4275-8148-97c70e08d3a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:39.950177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a93ab9f0-c7a2-4275-8148-97c70e08d3a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:40.021244 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a93ab9f0-c7a2-4275-8148-97c70e08d3a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:40.029559 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a93ab9f0-c7a2-4275-8148-97c70e08d3a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1246 microversion: 2.1 time: 0.098473 Sep 13 20:37:40.030117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1356/2796] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:39 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:40.446927 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-91f99d97-8deb-4b9c-a199-90da5f9e32bc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:40.447487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-91f99d97-8deb-4b9c-a199-90da5f9e32bc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:40.457388 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91f99d97-8deb-4b9c-a199-90da5f9e32bc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:40.457856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91f99d97-8deb-4b9c-a199-90da5f9e32bc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:40.458279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91f99d97-8deb-4b9c-a199-90da5f9e32bc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:40.458990 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91f99d97-8deb-4b9c-a199-90da5f9e32bc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:40.459430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91f99d97-8deb-4b9c-a199-90da5f9e32bc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:40.459837 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91f99d97-8deb-4b9c-a199-90da5f9e32bc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:40.597380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-91f99d97-8deb-4b9c-a199-90da5f9e32bc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:40.605617 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-91f99d97-8deb-4b9c-a199-90da5f9e32bc tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1266 microversion: 2.1 time: 0.165678 Sep 13 20:37:40.606227 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1441/2797] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:40 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:41.055772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-04938e9b-038f-4483-aa2d-30b6fa3e70b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:41.056346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-04938e9b-038f-4483-aa2d-30b6fa3e70b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:41.063162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04938e9b-038f-4483-aa2d-30b6fa3e70b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:41.063654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04938e9b-038f-4483-aa2d-30b6fa3e70b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:41.064099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04938e9b-038f-4483-aa2d-30b6fa3e70b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:41.064784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04938e9b-038f-4483-aa2d-30b6fa3e70b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:41.065594 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04938e9b-038f-4483-aa2d-30b6fa3e70b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:41.066013 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-04938e9b-038f-4483-aa2d-30b6fa3e70b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:41.070065 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=100 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:37:41.130966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-04938e9b-038f-4483-aa2d-30b6fa3e70b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:41.138959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-04938e9b-038f-4483-aa2d-30b6fa3e70b9 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1238 microversion: 2.1 time: 0.089107 Sep 13 20:37:41.139534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1357/2798] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:41 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:41.629726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e54bfbbd-20b5-4524-8162-5268bea9572f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:41.630328 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e54bfbbd-20b5-4524-8162-5268bea9572f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:41.636718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e54bfbbd-20b5-4524-8162-5268bea9572f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:41.637183 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e54bfbbd-20b5-4524-8162-5268bea9572f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:41.637602 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e54bfbbd-20b5-4524-8162-5268bea9572f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:41.638271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e54bfbbd-20b5-4524-8162-5268bea9572f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:41.638734 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e54bfbbd-20b5-4524-8162-5268bea9572f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:41.639145 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e54bfbbd-20b5-4524-8162-5268bea9572f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:41.776117 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e54bfbbd-20b5-4524-8162-5268bea9572f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:41.784476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e54bfbbd-20b5-4524-8162-5268bea9572f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1266 microversion: 2.1 time: 0.158559 Sep 13 20:37:41.785060 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1442/2799] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:41 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:42.163252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-dbfde9a9-74d2-412f-b343-c59b856132df tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:42.163979 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-dbfde9a9-74d2-412f-b343-c59b856132df tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:42.171131 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbfde9a9-74d2-412f-b343-c59b856132df tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:42.171764 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbfde9a9-74d2-412f-b343-c59b856132df tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:42.172311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbfde9a9-74d2-412f-b343-c59b856132df tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:42.173208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbfde9a9-74d2-412f-b343-c59b856132df tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:42.173756 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbfde9a9-74d2-412f-b343-c59b856132df tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:42.174279 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-dbfde9a9-74d2-412f-b343-c59b856132df tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:42.251525 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-dbfde9a9-74d2-412f-b343-c59b856132df tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:42.261096 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-dbfde9a9-74d2-412f-b343-c59b856132df tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1300 microversion: 2.1 time: 0.102242 Sep 13 20:37:42.271607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1358/2800] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:42 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:42.807868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bcb007ec-b251-4d31-860d-d8e3bd35db3f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:42.808456 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bcb007ec-b251-4d31-860d-d8e3bd35db3f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:42.815637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcb007ec-b251-4d31-860d-d8e3bd35db3f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:42.816094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcb007ec-b251-4d31-860d-d8e3bd35db3f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:42.816524 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcb007ec-b251-4d31-860d-d8e3bd35db3f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:42.817218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcb007ec-b251-4d31-860d-d8e3bd35db3f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:42.817685 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcb007ec-b251-4d31-860d-d8e3bd35db3f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:42.818107 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bcb007ec-b251-4d31-860d-d8e3bd35db3f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:42.953391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-bcb007ec-b251-4d31-860d-d8e3bd35db3f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:42.961594 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bcb007ec-b251-4d31-860d-d8e3bd35db3f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1266 microversion: 2.1 time: 0.157797 Sep 13 20:37:42.962175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1443/2801] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:42 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:43.124888 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-6ba413e9-72fe-4035-a425-0685dcea0e4d req-2ced7da5-1de0-4e77-98f9-2c405ec4f3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01596cca-0fed-47d9-a54e-95d95b62a45e", "tag": "41945305-b721-4f1d-9a76-017a38f8a38d"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:43.135754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-6ba413e9-72fe-4035-a425-0685dcea0e4d req-2ced7da5-1de0-4e77-98f9-2c405ec4f3b6 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:43.136238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-6ba413e9-72fe-4035-a425-0685dcea0e4d req-2ced7da5-1de0-4e77-98f9-2c405ec4f3b6 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:43.136666 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-6ba413e9-72fe-4035-a425-0685dcea0e4d req-2ced7da5-1de0-4e77-98f9-2c405ec4f3b6 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:43.148975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-6ba413e9-72fe-4035-a425-0685dcea0e4d req-2ced7da5-1de0-4e77-98f9-2c405ec4f3b6 service nova] Creating event network-changed:41945305-b721-4f1d-9a76-017a38f8a38d for instance 01596cca-0fed-47d9-a54e-95d95b62a45e on hv-cinder-85427 Sep 13 20:37:43.154580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-6ba413e9-72fe-4035-a425-0685dcea0e4d req-2ced7da5-1de0-4e77-98f9-2c405ec4f3b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035082 Sep 13 20:37:43.155210 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1359/2802] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:37:43.284881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d73b2fd6-49ec-4727-8497-3fff5947b8fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:43.285937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d73b2fd6-49ec-4727-8497-3fff5947b8fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:43.292213 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d73b2fd6-49ec-4727-8497-3fff5947b8fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:43.292665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d73b2fd6-49ec-4727-8497-3fff5947b8fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:43.293123 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d73b2fd6-49ec-4727-8497-3fff5947b8fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:43.293806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d73b2fd6-49ec-4727-8497-3fff5947b8fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:43.294244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d73b2fd6-49ec-4727-8497-3fff5947b8fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:43.294692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d73b2fd6-49ec-4727-8497-3fff5947b8fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:43.438924 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d73b2fd6-49ec-4727-8497-3fff5947b8fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:43.454355 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d73b2fd6-49ec-4727-8497-3fff5947b8fd tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1368 microversion: 2.1 time: 0.170156 Sep 13 20:37:43.455052 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1444/2803] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:43 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:43.985039 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8f0f7dd1-d28b-4bfa-91e3-b45c247f6a4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:43.985775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8f0f7dd1-d28b-4bfa-91e3-b45c247f6a4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:43.992240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f0f7dd1-d28b-4bfa-91e3-b45c247f6a4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:43.992780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f0f7dd1-d28b-4bfa-91e3-b45c247f6a4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:43.993217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f0f7dd1-d28b-4bfa-91e3-b45c247f6a4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:43.993909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f0f7dd1-d28b-4bfa-91e3-b45c247f6a4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:43.994384 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f0f7dd1-d28b-4bfa-91e3-b45c247f6a4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:43.994814 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8f0f7dd1-d28b-4bfa-91e3-b45c247f6a4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:44.132294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-8f0f7dd1-d28b-4bfa-91e3-b45c247f6a4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:44.144771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8f0f7dd1-d28b-4bfa-91e3-b45c247f6a4a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1266 microversion: 2.1 time: 0.164235 Sep 13 20:37:44.145607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1360/2804] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:43 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:44.477432 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-ad6a3ef8-3641-4c38-a34c-df5b4ff6083d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:44.477994 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-ad6a3ef8-3641-4c38-a34c-df5b4ff6083d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:44.484960 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad6a3ef8-3641-4c38-a34c-df5b4ff6083d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:44.485426 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad6a3ef8-3641-4c38-a34c-df5b4ff6083d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:44.485854 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad6a3ef8-3641-4c38-a34c-df5b4ff6083d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:44.486791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad6a3ef8-3641-4c38-a34c-df5b4ff6083d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:44.487012 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad6a3ef8-3641-4c38-a34c-df5b4ff6083d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:44.487430 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-ad6a3ef8-3641-4c38-a34c-df5b4ff6083d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:44.621272 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-ad6a3ef8-3641-4c38-a34c-df5b4ff6083d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:44.629077 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-ad6a3ef8-3641-4c38-a34c-df5b4ff6083d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1368 microversion: 2.1 time: 0.155699 Sep 13 20:37:44.629624 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1445/2805] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:44 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:45.169051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-07cc93a1-0afb-4676-b2b0-1b77c074bcc9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:45.169651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-07cc93a1-0afb-4676-b2b0-1b77c074bcc9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:45.177361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07cc93a1-0afb-4676-b2b0-1b77c074bcc9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:45.177966 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07cc93a1-0afb-4676-b2b0-1b77c074bcc9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:45.178505 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07cc93a1-0afb-4676-b2b0-1b77c074bcc9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:45.179273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07cc93a1-0afb-4676-b2b0-1b77c074bcc9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:45.179840 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07cc93a1-0afb-4676-b2b0-1b77c074bcc9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:45.180349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-07cc93a1-0afb-4676-b2b0-1b77c074bcc9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:45.349490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-07cc93a1-0afb-4676-b2b0-1b77c074bcc9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:45.359141 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-07cc93a1-0afb-4676-b2b0-1b77c074bcc9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1266 microversion: 2.1 time: 0.194036 Sep 13 20:37:45.370982 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1361/2806] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:45 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:45.610806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-e2f54bed-f74a-4b53-bfe4-0a957833fcc0 req-0ee32039-81ea-4737-baa6-a00344d37df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619fedd9-8a78-45a6-ac95-7a35d24d2037", "name": "network-vif-plugged", "status": "completed", "tag": "3ce031f5-d2d6-4329-8e27-ece36fe16d49"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:45.626312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-e2f54bed-f74a-4b53-bfe4-0a957833fcc0 req-0ee32039-81ea-4737-baa6-a00344d37df9 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:45.627560 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-e2f54bed-f74a-4b53-bfe4-0a957833fcc0 req-0ee32039-81ea-4737-baa6-a00344d37df9 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:45.629127 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-e2f54bed-f74a-4b53-bfe4-0a957833fcc0 req-0ee32039-81ea-4737-baa6-a00344d37df9 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:45.646727 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-e2f54bed-f74a-4b53-bfe4-0a957833fcc0 req-0ee32039-81ea-4737-baa6-a00344d37df9 service nova] Creating event network-vif-plugged:3ce031f5-d2d6-4329-8e27-ece36fe16d49 for instance 619fedd9-8a78-45a6-ac95-7a35d24d2037 on hv-cinder-85427 Sep 13 20:37:45.652932 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-f586ecbb-9930-4216-8fea-4e1f7b133a0a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:45.653798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-f586ecbb-9930-4216-8fea-4e1f7b133a0a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:45.654154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-e2f54bed-f74a-4b53-bfe4-0a957833fcc0 req-0ee32039-81ea-4737-baa6-a00344d37df9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049843 Sep 13 20:37:45.655500 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1446/2807] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:37:45.660899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f586ecbb-9930-4216-8fea-4e1f7b133a0a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:45.661458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f586ecbb-9930-4216-8fea-4e1f7b133a0a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:45.661901 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f586ecbb-9930-4216-8fea-4e1f7b133a0a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:45.662907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f586ecbb-9930-4216-8fea-4e1f7b133a0a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:45.663499 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f586ecbb-9930-4216-8fea-4e1f7b133a0a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:45.664060 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-f586ecbb-9930-4216-8fea-4e1f7b133a0a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:45.813892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-f586ecbb-9930-4216-8fea-4e1f7b133a0a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:45.824743 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-f586ecbb-9930-4216-8fea-4e1f7b133a0a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1368 microversion: 2.1 time: 0.176774 Sep 13 20:37:45.825564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1362/2808] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:45 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:37:46.384127 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a13130ab-6b12-489f-8071-2444da5e9707 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:46.384971 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a13130ab-6b12-489f-8071-2444da5e9707 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:46.392137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a13130ab-6b12-489f-8071-2444da5e9707 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:46.392628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a13130ab-6b12-489f-8071-2444da5e9707 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:46.393064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a13130ab-6b12-489f-8071-2444da5e9707 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:46.393791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a13130ab-6b12-489f-8071-2444da5e9707 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:46.394241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a13130ab-6b12-489f-8071-2444da5e9707 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:46.394696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a13130ab-6b12-489f-8071-2444da5e9707 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:46.527461 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-a13130ab-6b12-489f-8071-2444da5e9707 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:46.535518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a13130ab-6b12-489f-8071-2444da5e9707 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1266 microversion: 2.1 time: 0.155650 Sep 13 20:37:46.536166 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1447/2809] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:46 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:37:46.847609 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-06dee57e-1315-4364-8c83-f78aafbbcc99 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:46.848223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-06dee57e-1315-4364-8c83-f78aafbbcc99 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:46.854661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06dee57e-1315-4364-8c83-f78aafbbcc99 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:46.855143 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06dee57e-1315-4364-8c83-f78aafbbcc99 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:46.855577 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06dee57e-1315-4364-8c83-f78aafbbcc99 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:46.856267 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06dee57e-1315-4364-8c83-f78aafbbcc99 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:46.856717 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06dee57e-1315-4364-8c83-f78aafbbcc99 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:46.857137 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-06dee57e-1315-4364-8c83-f78aafbbcc99 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:46.995220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-06dee57e-1315-4364-8c83-f78aafbbcc99 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:47.002975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-06dee57e-1315-4364-8c83-f78aafbbcc99 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1368 microversion: 2.1 time: 0.159194 Sep 13 20:37:47.003605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1363/2810] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:46 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:47.558984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-22bc828a-45ac-4f2c-8f3d-7a36b302bbf6 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:47.560275 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-22bc828a-45ac-4f2c-8f3d-7a36b302bbf6 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:47.567479 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-22bc828a-45ac-4f2c-8f3d-7a36b302bbf6 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:47.568170 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-22bc828a-45ac-4f2c-8f3d-7a36b302bbf6 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:47.568596 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-22bc828a-45ac-4f2c-8f3d-7a36b302bbf6 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:47.569439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-22bc828a-45ac-4f2c-8f3d-7a36b302bbf6 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:47.570028 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-22bc828a-45ac-4f2c-8f3d-7a36b302bbf6 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:47.570748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-22bc828a-45ac-4f2c-8f3d-7a36b302bbf6 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:47.655162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:37:47.674123 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-4681188b-6f6e-40e3-809d-2f296c80d5cf req-e467cf2d-909a-4b4e-854e-4345d903d40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01596cca-0fed-47d9-a54e-95d95b62a45e", "name": "network-vif-plugged", "status": "completed", "tag": "41945305-b721-4f1d-9a76-017a38f8a38d"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:47.681400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=12 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:37:47.686827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-4681188b-6f6e-40e3-809d-2f296c80d5cf req-e467cf2d-909a-4b4e-854e-4345d903d40e service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:47.687457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-4681188b-6f6e-40e3-809d-2f296c80d5cf req-e467cf2d-909a-4b4e-854e-4345d903d40e service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:47.688070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-4681188b-6f6e-40e3-809d-2f296c80d5cf req-e467cf2d-909a-4b4e-854e-4345d903d40e service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:47.700067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-4681188b-6f6e-40e3-809d-2f296c80d5cf req-e467cf2d-909a-4b4e-854e-4345d903d40e service nova] Creating event network-vif-plugged:41945305-b721-4f1d-9a76-017a38f8a38d for instance 01596cca-0fed-47d9-a54e-95d95b62a45e on hv-cinder-85427 Sep 13 20:37:47.705117 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-4681188b-6f6e-40e3-809d-2f296c80d5cf req-e467cf2d-909a-4b4e-854e-4345d903d40e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034761 Sep 13 20:37:47.705858 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1364/2811] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:37:47.715470 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-22bc828a-45ac-4f2c-8f3d-7a36b302bbf6 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:47.723780 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-22bc828a-45ac-4f2c-8f3d-7a36b302bbf6 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1453 microversion: 2.1 time: 0.168862 Sep 13 20:37:47.724368 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1448/2812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:47 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:47.746390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3f4271c5-fa93-47c6-91e5-f112d2012b26 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:47.747191 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3f4271c5-fa93-47c6-91e5-f112d2012b26 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:47.753360 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f4271c5-fa93-47c6-91e5-f112d2012b26 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:47.753834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f4271c5-fa93-47c6-91e5-f112d2012b26 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:47.754262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f4271c5-fa93-47c6-91e5-f112d2012b26 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:47.754972 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f4271c5-fa93-47c6-91e5-f112d2012b26 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:47.755412 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f4271c5-fa93-47c6-91e5-f112d2012b26 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:47.755825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3f4271c5-fa93-47c6-91e5-f112d2012b26 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:47.804527 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=8 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:37:47.936160 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3f4271c5-fa93-47c6-91e5-f112d2012b26 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:47.944523 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3f4271c5-fa93-47c6-91e5-f112d2012b26 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1453 microversion: 2.1 time: 0.202296 Sep 13 20:37:47.958784 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1365/2813] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:47 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:48.042059 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9b2e64bd-074b-4e7d-888e-861e08d17143 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:48.042883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9b2e64bd-074b-4e7d-888e-861e08d17143 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:48.053417 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b2e64bd-074b-4e7d-888e-861e08d17143 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:48.061271 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b2e64bd-074b-4e7d-888e-861e08d17143 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:48.061716 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b2e64bd-074b-4e7d-888e-861e08d17143 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:48.062471 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b2e64bd-074b-4e7d-888e-861e08d17143 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:48.062917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b2e64bd-074b-4e7d-888e-861e08d17143 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:48.063501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9b2e64bd-074b-4e7d-888e-861e08d17143 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:48.295021 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9b2e64bd-074b-4e7d-888e-861e08d17143 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:48.303175 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9b2e64bd-074b-4e7d-888e-861e08d17143 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1368 microversion: 2.1 time: 0.269350 Sep 13 20:37:48.303756 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1449/2814] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:48 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1368 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:49.326253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3ef764bf-27fa-43e4-8fc8-76c204e998d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:49.326915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3ef764bf-27fa-43e4-8fc8-76c204e998d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:49.334246 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ef764bf-27fa-43e4-8fc8-76c204e998d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:49.334834 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ef764bf-27fa-43e4-8fc8-76c204e998d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:49.335272 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ef764bf-27fa-43e4-8fc8-76c204e998d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:49.335998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ef764bf-27fa-43e4-8fc8-76c204e998d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:49.336821 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ef764bf-27fa-43e4-8fc8-76c204e998d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:49.337315 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3ef764bf-27fa-43e4-8fc8-76c204e998d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:49.493273 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-3ef764bf-27fa-43e4-8fc8-76c204e998d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:49.501498 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3ef764bf-27fa-43e4-8fc8-76c204e998d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1368 microversion: 2.1 time: 0.179206 Sep 13 20:37:49.506441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1366/2815] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:49 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:49.937097 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-4c57ebc3-dd0f-4625-b1d9-c736ae86b947 req-5ec34129-91a4-4e5f-a070-712cd250bab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619fedd9-8a78-45a6-ac95-7a35d24d2037", "tag": "3ce031f5-d2d6-4329-8e27-ece36fe16d49"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:49.947512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-4c57ebc3-dd0f-4625-b1d9-c736ae86b947 req-5ec34129-91a4-4e5f-a070-712cd250bab3 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:49.947986 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-4c57ebc3-dd0f-4625-b1d9-c736ae86b947 req-5ec34129-91a4-4e5f-a070-712cd250bab3 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:49.948425 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-4c57ebc3-dd0f-4625-b1d9-c736ae86b947 req-5ec34129-91a4-4e5f-a070-712cd250bab3 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:49.959762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-4c57ebc3-dd0f-4625-b1d9-c736ae86b947 req-5ec34129-91a4-4e5f-a070-712cd250bab3 service nova] Creating event network-changed:3ce031f5-d2d6-4329-8e27-ece36fe16d49 for instance 619fedd9-8a78-45a6-ac95-7a35d24d2037 on hv-cinder-85427 Sep 13 20:37:49.965068 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-4c57ebc3-dd0f-4625-b1d9-c736ae86b947 req-5ec34129-91a4-4e5f-a070-712cd250bab3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031681 Sep 13 20:37:49.965858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1450/2816] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:37:50.525295 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a8d0c77d-71c9-41a7-bffe-46b996536b2b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:50.525907 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a8d0c77d-71c9-41a7-bffe-46b996536b2b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:50.532374 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8d0c77d-71c9-41a7-bffe-46b996536b2b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:50.532886 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8d0c77d-71c9-41a7-bffe-46b996536b2b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:50.533324 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8d0c77d-71c9-41a7-bffe-46b996536b2b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:50.534008 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8d0c77d-71c9-41a7-bffe-46b996536b2b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:50.534483 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8d0c77d-71c9-41a7-bffe-46b996536b2b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:50.534902 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a8d0c77d-71c9-41a7-bffe-46b996536b2b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:50.668253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a8d0c77d-71c9-41a7-bffe-46b996536b2b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:37:50.676056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a8d0c77d-71c9-41a7-bffe-46b996536b2b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1559 microversion: 2.1 time: 0.154759 Sep 13 20:37:50.676607 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1367/2817] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:37:50 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:37:50.699495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-55b92615-269f-46ad-8fbe-b2772267228e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:37:50.700064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-55b92615-269f-46ad-8fbe-b2772267228e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:37:50.706222 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55b92615-269f-46ad-8fbe-b2772267228e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:50.706764 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55b92615-269f-46ad-8fbe-b2772267228e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:50.707226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55b92615-269f-46ad-8fbe-b2772267228e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:50.707905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55b92615-269f-46ad-8fbe-b2772267228e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:50.708335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55b92615-269f-46ad-8fbe-b2772267228e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:50.708742 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-55b92615-269f-46ad-8fbe-b2772267228e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:50.726142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:37:50.802131 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-55b92615-269f-46ad-8fbe-b2772267228e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107301 Sep 13 20:37:50.802766 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1451/2818] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 13 20:37:50 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:37:51.979771 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-e8f46f5b-f2f3-476a-9bd8-7a330174d2d3 req-fa01b726-1ccb-4034-bb22-f2fab15df433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01596cca-0fed-47d9-a54e-95d95b62a45e", "tag": "41945305-b721-4f1d-9a76-017a38f8a38d"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:37:51.990672 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-e8f46f5b-f2f3-476a-9bd8-7a330174d2d3 req-fa01b726-1ccb-4034-bb22-f2fab15df433 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:37:51.991427 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-e8f46f5b-f2f3-476a-9bd8-7a330174d2d3 req-fa01b726-1ccb-4034-bb22-f2fab15df433 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:37:51.991937 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-e8f46f5b-f2f3-476a-9bd8-7a330174d2d3 req-fa01b726-1ccb-4034-bb22-f2fab15df433 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:37:52.004113 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-e8f46f5b-f2f3-476a-9bd8-7a330174d2d3 req-fa01b726-1ccb-4034-bb22-f2fab15df433 service nova] Creating event network-changed:41945305-b721-4f1d-9a76-017a38f8a38d for instance 01596cca-0fed-47d9-a54e-95d95b62a45e on hv-cinder-85427 Sep 13 20:37:52.010480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-e8f46f5b-f2f3-476a-9bd8-7a330174d2d3 req-fa01b726-1ccb-4034-bb22-f2fab15df433 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034194 Sep 13 20:37:52.012900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1368/2819] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:38:11.664452 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=24 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:38:11.668778 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-982153289", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452"}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:38:11.721255 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.network.neutron [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] validate_networks() for None {{(pid=120844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:38:11.999888 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Flavor limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:38:12.000335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Image limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:38:12.000800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Flavor pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:38:12.001196 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Image pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:38:12.001578 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:38:12.011102 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:12.011576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:12.012000 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:12.012702 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:12.013130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:12.013543 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:12.030679 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Getting quotas for project 2bd38a578e1e4764a41c5fcb32ca3cfc. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:38:12.035120 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Getting quotas for user 27860df658d8416fb862d0eacff1169b and project 2bd38a578e1e4764a41c5fcb32ca3cfc. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:38:12.047258 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Going to run 1 instances... {{(pid=120844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:38:12.049515 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:38:12.097225 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-0ef55247-9143-48a2-8dbe-4c2d0dc89e5c tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.434138 Sep 13 20:38:12.097858 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1452/2820] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:38:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:38:12.109551 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-eb613dd0-0ded-4854-a1c7-ccff17ec02b8 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:12.110345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-eb613dd0-0ded-4854-a1c7-ccff17ec02b8 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:12.114074 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:38:12.114921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=58 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:38:12.179454 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-eb613dd0-0ded-4854-a1c7-ccff17ec02b8 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27860df658d8416fb862d0eacff1169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd38a578e1e4764a41c5fcb32ca3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:12.186517 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-eb613dd0-0ded-4854-a1c7-ccff17ec02b8 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 200 len: 1214 microversion: 2.1 time: 0.081254 Sep 13 20:38:12.187096 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1369/2821] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:12 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:38:13.209951 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-be8f32e3-3990-4ba1-b122-9ec6c9226d7e tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:13.210745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-be8f32e3-3990-4ba1-b122-9ec6c9226d7e tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:13.217938 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be8f32e3-3990-4ba1-b122-9ec6c9226d7e tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:13.218447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be8f32e3-3990-4ba1-b122-9ec6c9226d7e tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:13.218849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be8f32e3-3990-4ba1-b122-9ec6c9226d7e tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:13.219716 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be8f32e3-3990-4ba1-b122-9ec6c9226d7e tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:13.220154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be8f32e3-3990-4ba1-b122-9ec6c9226d7e tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:13.220567 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-be8f32e3-3990-4ba1-b122-9ec6c9226d7e tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:13.286791 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-be8f32e3-3990-4ba1-b122-9ec6c9226d7e tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27860df658d8416fb862d0eacff1169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd38a578e1e4764a41c5fcb32ca3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:13.294883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-be8f32e3-3990-4ba1-b122-9ec6c9226d7e tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 200 len: 1274 microversion: 2.1 time: 0.089951 Sep 13 20:38:13.295513 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1453/2822] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:13 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:38:14.319155 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4c193965-3981-4d71-b8b5-c99d967a1f9f tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:14.320453 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4c193965-3981-4d71-b8b5-c99d967a1f9f tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:14.328395 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c193965-3981-4d71-b8b5-c99d967a1f9f tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:14.328976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c193965-3981-4d71-b8b5-c99d967a1f9f tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:14.329715 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c193965-3981-4d71-b8b5-c99d967a1f9f tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:14.330632 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c193965-3981-4d71-b8b5-c99d967a1f9f tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:14.331266 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c193965-3981-4d71-b8b5-c99d967a1f9f tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:14.331628 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4c193965-3981-4d71-b8b5-c99d967a1f9f tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:14.545899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4c193965-3981-4d71-b8b5-c99d967a1f9f tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27860df658d8416fb862d0eacff1169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd38a578e1e4764a41c5fcb32ca3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:14.555378 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4c193965-3981-4d71-b8b5-c99d967a1f9f tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 200 len: 1314 microversion: 2.1 time: 0.240632 Sep 13 20:38:14.556021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1370/2823] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:14 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:15.068573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-7165c7b9-5f9f-4c24-831c-c3dc5c5db4c5 req-e2adb84d-1740-481c-910c-f78ae7e8cb7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0b66ef-de11-41ab-8d9a-886c6512d1db", "tag": "e18ed549-a8d6-4e4c-9b14-7288e91a6409"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:38:15.080187 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-7165c7b9-5f9f-4c24-831c-c3dc5c5db4c5 req-e2adb84d-1740-481c-910c-f78ae7e8cb7f service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:15.080692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-7165c7b9-5f9f-4c24-831c-c3dc5c5db4c5 req-e2adb84d-1740-481c-910c-f78ae7e8cb7f service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:15.081838 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-7165c7b9-5f9f-4c24-831c-c3dc5c5db4c5 req-e2adb84d-1740-481c-910c-f78ae7e8cb7f service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:15.094338 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-7165c7b9-5f9f-4c24-831c-c3dc5c5db4c5 req-e2adb84d-1740-481c-910c-f78ae7e8cb7f service nova] Creating event network-changed:e18ed549-a8d6-4e4c-9b14-7288e91a6409 for instance 3b0b66ef-de11-41ab-8d9a-886c6512d1db on hv-cinder-85427 Sep 13 20:38:15.100200 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-7165c7b9-5f9f-4c24-831c-c3dc5c5db4c5 req-e2adb84d-1740-481c-910c-f78ae7e8cb7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036167 Sep 13 20:38:15.100810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1454/2824] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:38:15.579168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-365154be-a42a-49aa-b0bf-4d51bd07b8f6 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:15.579773 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-365154be-a42a-49aa-b0bf-4d51bd07b8f6 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:15.586819 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-365154be-a42a-49aa-b0bf-4d51bd07b8f6 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:15.587277 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-365154be-a42a-49aa-b0bf-4d51bd07b8f6 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:15.587706 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-365154be-a42a-49aa-b0bf-4d51bd07b8f6 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:15.588407 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-365154be-a42a-49aa-b0bf-4d51bd07b8f6 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:15.588825 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-365154be-a42a-49aa-b0bf-4d51bd07b8f6 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:15.589242 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-365154be-a42a-49aa-b0bf-4d51bd07b8f6 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:15.720099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-365154be-a42a-49aa-b0bf-4d51bd07b8f6 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27860df658d8416fb862d0eacff1169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd38a578e1e4764a41c5fcb32ca3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:15.728245 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-365154be-a42a-49aa-b0bf-4d51bd07b8f6 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 200 len: 1314 microversion: 2.1 time: 0.153126 Sep 13 20:38:15.728797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1371/2825] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:15 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:16.751346 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-637bf7c1-7d02-4691-9dd4-c8a7be6fdfc7 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:16.752153 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-637bf7c1-7d02-4691-9dd4-c8a7be6fdfc7 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:16.759216 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-637bf7c1-7d02-4691-9dd4-c8a7be6fdfc7 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:16.759690 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-637bf7c1-7d02-4691-9dd4-c8a7be6fdfc7 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:16.760123 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-637bf7c1-7d02-4691-9dd4-c8a7be6fdfc7 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:16.760809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-637bf7c1-7d02-4691-9dd4-c8a7be6fdfc7 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:16.761239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-637bf7c1-7d02-4691-9dd4-c8a7be6fdfc7 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:16.761656 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-637bf7c1-7d02-4691-9dd4-c8a7be6fdfc7 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:16.894579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-637bf7c1-7d02-4691-9dd4-c8a7be6fdfc7 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27860df658d8416fb862d0eacff1169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd38a578e1e4764a41c5fcb32ca3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:16.902345 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-637bf7c1-7d02-4691-9dd4-c8a7be6fdfc7 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 200 len: 1314 microversion: 2.1 time: 0.155344 Sep 13 20:38:16.902942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1455/2826] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:16 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:17.933132 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a541c9d8-84fc-4f62-ac21-bd1cd1c15952 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:17.933695 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a541c9d8-84fc-4f62-ac21-bd1cd1c15952 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:17.941001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a541c9d8-84fc-4f62-ac21-bd1cd1c15952 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:17.941484 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a541c9d8-84fc-4f62-ac21-bd1cd1c15952 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:17.941906 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a541c9d8-84fc-4f62-ac21-bd1cd1c15952 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:17.942629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a541c9d8-84fc-4f62-ac21-bd1cd1c15952 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:17.943079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a541c9d8-84fc-4f62-ac21-bd1cd1c15952 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:17.943503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a541c9d8-84fc-4f62-ac21-bd1cd1c15952 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:18.073368 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a541c9d8-84fc-4f62-ac21-bd1cd1c15952 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27860df658d8416fb862d0eacff1169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd38a578e1e4764a41c5fcb32ca3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:18.081490 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a541c9d8-84fc-4f62-ac21-bd1cd1c15952 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 200 len: 1314 microversion: 2.1 time: 0.152161 Sep 13 20:38:18.082059 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1372/2827] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:17 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:19.108061 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-f2d1374b-cb59-4631-adaa-912a0e5e2662 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:19.109076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-f2d1374b-cb59-4631-adaa-912a0e5e2662 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:19.117464 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2d1374b-cb59-4631-adaa-912a0e5e2662 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:19.117947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2d1374b-cb59-4631-adaa-912a0e5e2662 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:19.118402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2d1374b-cb59-4631-adaa-912a0e5e2662 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:19.119094 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2d1374b-cb59-4631-adaa-912a0e5e2662 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:19.119681 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2d1374b-cb59-4631-adaa-912a0e5e2662 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:19.120018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-f2d1374b-cb59-4631-adaa-912a0e5e2662 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:19.258174 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-f2d1374b-cb59-4631-adaa-912a0e5e2662 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27860df658d8416fb862d0eacff1169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd38a578e1e4764a41c5fcb32ca3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:19.266226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-f2d1374b-cb59-4631-adaa-912a0e5e2662 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 200 len: 1314 microversion: 2.1 time: 0.164779 Sep 13 20:38:19.266809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1456/2828] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:19 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:19.674811 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-2bb810e6-f3a3-4143-b1d2-baf56bc4e553 req-76afab75-d19e-46a0-b62c-3de3549156dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0b66ef-de11-41ab-8d9a-886c6512d1db", "name": "network-vif-plugged", "status": "completed", "tag": "e18ed549-a8d6-4e4c-9b14-7288e91a6409"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:38:19.684955 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-2bb810e6-f3a3-4143-b1d2-baf56bc4e553 req-76afab75-d19e-46a0-b62c-3de3549156dc service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:19.685452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-2bb810e6-f3a3-4143-b1d2-baf56bc4e553 req-76afab75-d19e-46a0-b62c-3de3549156dc service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:19.685869 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-2bb810e6-f3a3-4143-b1d2-baf56bc4e553 req-76afab75-d19e-46a0-b62c-3de3549156dc service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:19.697274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-2bb810e6-f3a3-4143-b1d2-baf56bc4e553 req-76afab75-d19e-46a0-b62c-3de3549156dc service nova] Creating event network-vif-plugged:e18ed549-a8d6-4e4c-9b14-7288e91a6409 for instance 3b0b66ef-de11-41ab-8d9a-886c6512d1db on hv-cinder-85427 Sep 13 20:38:19.702311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-2bb810e6-f3a3-4143-b1d2-baf56bc4e553 req-76afab75-d19e-46a0-b62c-3de3549156dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031397 Sep 13 20:38:19.702978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1373/2829] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:38:20.293354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-490ad6d2-840d-4260-8c6b-fda55aaef0e4 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:20.294054 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-490ad6d2-840d-4260-8c6b-fda55aaef0e4 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:20.304154 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-490ad6d2-840d-4260-8c6b-fda55aaef0e4 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:20.304697 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-490ad6d2-840d-4260-8c6b-fda55aaef0e4 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:20.305223 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-490ad6d2-840d-4260-8c6b-fda55aaef0e4 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:20.306314 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-490ad6d2-840d-4260-8c6b-fda55aaef0e4 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:20.306955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-490ad6d2-840d-4260-8c6b-fda55aaef0e4 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:20.307573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-490ad6d2-840d-4260-8c6b-fda55aaef0e4 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:20.446703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-490ad6d2-840d-4260-8c6b-fda55aaef0e4 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27860df658d8416fb862d0eacff1169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd38a578e1e4764a41c5fcb32ca3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:20.454721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-490ad6d2-840d-4260-8c6b-fda55aaef0e4 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 200 len: 1314 microversion: 2.1 time: 0.167692 Sep 13 20:38:20.455268 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1457/2830] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:20 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:21.479440 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7082f819-a71a-4f28-bb96-1524566eecd9 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:21.480104 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7082f819-a71a-4f28-bb96-1524566eecd9 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:21.486616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7082f819-a71a-4f28-bb96-1524566eecd9 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:21.487091 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7082f819-a71a-4f28-bb96-1524566eecd9 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:21.487513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7082f819-a71a-4f28-bb96-1524566eecd9 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:21.488186 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7082f819-a71a-4f28-bb96-1524566eecd9 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:21.488626 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7082f819-a71a-4f28-bb96-1524566eecd9 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:21.489040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7082f819-a71a-4f28-bb96-1524566eecd9 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:21.628075 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7082f819-a71a-4f28-bb96-1524566eecd9 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27860df658d8416fb862d0eacff1169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd38a578e1e4764a41c5fcb32ca3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:21.636355 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7082f819-a71a-4f28-bb96-1524566eecd9 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 200 len: 1464 microversion: 2.1 time: 0.161676 Sep 13 20:38:21.636923 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1374/2831] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:21 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:21.682848 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-a03b9d49-1057-4a74-89f5-821e0d27ec0a tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:21.683332 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a03b9d49-1057-4a74-89f5-821e0d27ec0a tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:21.690143 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a03b9d49-1057-4a74-89f5-821e0d27ec0a tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:21.690674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a03b9d49-1057-4a74-89f5-821e0d27ec0a tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:21.691099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a03b9d49-1057-4a74-89f5-821e0d27ec0a tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:21.691769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a03b9d49-1057-4a74-89f5-821e0d27ec0a tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:21.692224 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a03b9d49-1057-4a74-89f5-821e0d27ec0a tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:21.692633 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-a03b9d49-1057-4a74-89f5-821e0d27ec0a tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:21.717693 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-a03b9d49-1057-4a74-89f5-821e0d27ec0a tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Going to try to terminate instance {{(pid=120844) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:38:21.797978 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-a03b9d49-1057-4a74-89f5-821e0d27ec0a tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 204 len: 0 microversion: 2.1 time: 0.118698 Sep 13 20:38:21.798503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1458/2832] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:38:21 2022] DELETE /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:38:21.808457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5cbb7f11-4bcf-47a9-a1f7-42ab5473e369 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:21.809067 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5cbb7f11-4bcf-47a9-a1f7-42ab5473e369 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:21.815452 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cbb7f11-4bcf-47a9-a1f7-42ab5473e369 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:21.815920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cbb7f11-4bcf-47a9-a1f7-42ab5473e369 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:21.816344 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cbb7f11-4bcf-47a9-a1f7-42ab5473e369 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:21.817135 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cbb7f11-4bcf-47a9-a1f7-42ab5473e369 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:21.817574 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cbb7f11-4bcf-47a9-a1f7-42ab5473e369 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:21.817990 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5cbb7f11-4bcf-47a9-a1f7-42ab5473e369 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:21.954294 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5cbb7f11-4bcf-47a9-a1f7-42ab5473e369 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27860df658d8416fb862d0eacff1169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd38a578e1e4764a41c5fcb32ca3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:21.962633 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5cbb7f11-4bcf-47a9-a1f7-42ab5473e369 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 200 len: 1470 microversion: 2.1 time: 0.159293 Sep 13 20:38:21.963199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1375/2833] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:21 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:38:22.990961 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9dac77c3-c9b8-4d1c-b12d-501e9137a811 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:22.992091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9dac77c3-c9b8-4d1c-b12d-501e9137a811 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:22.995101 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:38:22.996208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=6 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:38:23.005597 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9dac77c3-c9b8-4d1c-b12d-501e9137a811 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:23.006064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9dac77c3-c9b8-4d1c-b12d-501e9137a811 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:23.006505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9dac77c3-c9b8-4d1c-b12d-501e9137a811 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:23.007176 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9dac77c3-c9b8-4d1c-b12d-501e9137a811 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:23.007623 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9dac77c3-c9b8-4d1c-b12d-501e9137a811 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:23.008026 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9dac77c3-c9b8-4d1c-b12d-501e9137a811 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:23.152103 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-9dac77c3-c9b8-4d1c-b12d-501e9137a811 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27860df658d8416fb862d0eacff1169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd38a578e1e4764a41c5fcb32ca3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:23.160263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9dac77c3-c9b8-4d1c-b12d-501e9137a811 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 200 len: 1470 microversion: 2.1 time: 0.176404 Sep 13 20:38:23.160896 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1459/2834] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:22 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:23.658575 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-b012aaad-fa2f-49de-aee5-20cc3fd8f266 req-902bc89b-977c-4728-9397-875bb01502b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0b66ef-de11-41ab-8d9a-886c6512d1db", "name": "network-vif-deleted", "tag": "e18ed549-a8d6-4e4c-9b14-7288e91a6409"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:38:23.668828 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:38:23.672709 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-b012aaad-fa2f-49de-aee5-20cc3fd8f266 req-902bc89b-977c-4728-9397-875bb01502b8 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:23.673108 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-b012aaad-fa2f-49de-aee5-20cc3fd8f266 req-902bc89b-977c-4728-9397-875bb01502b8 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:23.673532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-b012aaad-fa2f-49de-aee5-20cc3fd8f266 req-902bc89b-977c-4728-9397-875bb01502b8 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:23.690812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-b012aaad-fa2f-49de-aee5-20cc3fd8f266 req-902bc89b-977c-4728-9397-875bb01502b8 service nova] Creating event network-vif-deleted:e18ed549-a8d6-4e4c-9b14-7288e91a6409 for instance 3b0b66ef-de11-41ab-8d9a-886c6512d1db on hv-cinder-85427 Sep 13 20:38:23.696225 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-b012aaad-fa2f-49de-aee5-20cc3fd8f266 req-902bc89b-977c-4728-9397-875bb01502b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041867 Sep 13 20:38:23.696882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1376/2835] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:38:24.183205 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:24.183918 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:24.191114 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:24.191601 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:24.192034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:24.192720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:24.193168 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:24.193726 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:24.225872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:24.226348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:24.226810 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:24.227241 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.objects.instance [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lazy-loading 'fault' on Instance uuid 3b0b66ef-de11-41ab-8d9a-886c6512d1db {{(pid=120844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:38:24.269302 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27860df658d8416fb862d0eacff1169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd38a578e1e4764a41c5fcb32ca3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:24.276660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-00685f39-a6f2-4b59-a636-08537b065151 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 200 len: 1304 microversion: 2.1 time: 0.097483 Sep 13 20:38:24.277251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1460/2836] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:24 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:25.300779 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b78c5bf8-575c-4bea-bf2f-fc1a1630f2b3 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:25.301478 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-b78c5bf8-575c-4bea-bf2f-fc1a1630f2b3 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] [instance: 3b0b66ef-de11-41ab-8d9a-886c6512d1db] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:25.308702 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b78c5bf8-575c-4bea-bf2f-fc1a1630f2b3 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:25.309182 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b78c5bf8-575c-4bea-bf2f-fc1a1630f2b3 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:25.309612 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b78c5bf8-575c-4bea-bf2f-fc1a1630f2b3 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:25.310298 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b78c5bf8-575c-4bea-bf2f-fc1a1630f2b3 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:25.310767 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b78c5bf8-575c-4bea-bf2f-fc1a1630f2b3 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:25.311195 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-b78c5bf8-575c-4bea-bf2f-fc1a1630f2b3 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:25.325259 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-b78c5bf8-575c-4bea-bf2f-fc1a1630f2b3 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] HTTP exception thrown: Instance 3b0b66ef-de11-41ab-8d9a-886c6512d1db could not be found. Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b78c5bf8-575c-4bea-bf2f-fc1a1630f2b3 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Request method failure captured: Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db HTTP/1.1 Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOoyHguWn_v8cTEBM9KYjGJk1U8-p4UeiUwFEhH8YwmSUkMWFSjDOwQPhFrc_igy5A9sBrgSYv2BkqJepuGnsD1noeTZjp2NLPNg7YKrWfVQgA8mVA_dKg2EbsvvjQ7UHk8dV0OCY0y5HZ1zTiEOT-SFPy8DVWZxpYGf6-RVWVGp3F0 Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: 2bd38a578e1e4764a41c5fcb32ca3cfc Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-VolumesNegativeTest-55371308 Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:38:25.326958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:38:25.328392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2bd38a578e1e4764a41c5fcb32ca3cfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2bd38a578e1e4764a41c5fcb32ca3cfc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2bd38a578e1e4764a41c5fcb32ca3cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2bd38a578e1e4764a41c5fcb32ca3cfc"}]}] Sep 13 20:38:25.328392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-VolumesNegativeTest-55371308 Sep 13 20:38:25.328392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: 2bd38a578e1e4764a41c5fcb32ca3cfc Sep 13 20:38:25.328392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-VolumesNegativeTest-55371308 Sep 13 20:38:25.328392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-VolumesNegativeTest-55371308-project Sep 13 20:38:25.328392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:38:25.328392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:38:25.328392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 27860df658d8416fb862d0eacff1169b Sep 13 20:38:25.328392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-VolumesNegativeTest-55371308-project Sep 13 20:38:25.328392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:38:25.328392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 3b0b66ef-de11-41ab-8d9a-886c6512d1db could not be found. Sep 13 20:38:25.328392 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '3b0b66ef-de11-41ab-8d9a-886c6512d1db'} Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0b66ef-de11-41ab-8d9a-886c6512d1db could not be found. Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:38:25.329193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0b66ef-de11-41ab-8d9a-886c6512d1db could not be found. Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0b66ef-de11-41ab-8d9a-886c6512d1db could not be found. Sep 13 20:38:25.330345 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:38:25.331377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-b78c5bf8-575c-4bea-bf2f-fc1a1630f2b3 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] Returning 404 to user: Instance 3b0b66ef-de11-41ab-8d9a-886c6512d1db could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:38:25.331377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-b78c5bf8-575c-4bea-bf2f-fc1a1630f2b3 tempest-VolumesNegativeTest-55371308 tempest-VolumesNegativeTest-55371308-project] 10.222.0.52 "GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db" status: 404 len: 111 microversion: 2.1 time: 0.031944 Sep 13 20:38:25.331377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1377/2837] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:25 2022] GET /compute/v2.1/servers/3b0b66ef-de11-41ab-8d9a-886c6512d1db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:38:27.684093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-51f87de0-0d2b-4ebc-a7fd-79e45e9516c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:27.684625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-51f87de0-0d2b-4ebc-a7fd-79e45e9516c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:27.692008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-51f87de0-0d2b-4ebc-a7fd-79e45e9516c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:27.692486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-51f87de0-0d2b-4ebc-a7fd-79e45e9516c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:27.692909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-51f87de0-0d2b-4ebc-a7fd-79e45e9516c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:27.693699 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-51f87de0-0d2b-4ebc-a7fd-79e45e9516c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:27.694140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-51f87de0-0d2b-4ebc-a7fd-79e45e9516c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:27.694720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-51f87de0-0d2b-4ebc-a7fd-79e45e9516c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:27.720955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-51f87de0-0d2b-4ebc-a7fd-79e45e9516c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/ips" status: 200 len: 150 microversion: 2.1 time: 0.040839 Sep 13 20:38:27.721555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1461/2838] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 13 20:38:27 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:38:29.093934 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a9008c3e-1037-4a9b-8336-4b4e2375854c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b36386b-1f17-4373-95c0-2db9c487fed1"}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:38:29.096428 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a9008c3e-1037-4a9b-8336-4b4e2375854c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:29.104903 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9008c3e-1037-4a9b-8336-4b4e2375854c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:29.105389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9008c3e-1037-4a9b-8336-4b4e2375854c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:29.105827 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9008c3e-1037-4a9b-8336-4b4e2375854c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:29.106550 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9008c3e-1037-4a9b-8336-4b4e2375854c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:29.107004 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9008c3e-1037-4a9b-8336-4b4e2375854c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:29.107432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a9008c3e-1037-4a9b-8336-4b4e2375854c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:29.369868 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a9008c3e-1037-4a9b-8336-4b4e2375854c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279826 Sep 13 20:38:29.370526 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1378/2839] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 13 20:38:29 2022] POST /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:38:35.884737 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-18c4e2b1-17ce-4250-9bc6-b13b49c7c0d5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b36386b-1f17-4373-95c0-2db9c487fed1"}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:38:35.887233 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-18c4e2b1-17ce-4250-9bc6-b13b49c7c0d5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:35.894202 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18c4e2b1-17ce-4250-9bc6-b13b49c7c0d5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:35.894704 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18c4e2b1-17ce-4250-9bc6-b13b49c7c0d5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:35.895162 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18c4e2b1-17ce-4250-9bc6-b13b49c7c0d5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:35.895843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18c4e2b1-17ce-4250-9bc6-b13b49c7c0d5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:35.896288 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18c4e2b1-17ce-4250-9bc6-b13b49c7c0d5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:35.896723 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-18c4e2b1-17ce-4250-9bc6-b13b49c7c0d5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:35.978984 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-18c4e2b1-17ce-4250-9bc6-b13b49c7c0d5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Invalid volume: volume 5b36386b-1f17-4373-95c0-2db9c487fed1 is already attached to instances: 01596cca-0fed-47d9-a54e-95d95b62a45e Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-18c4e2b1-17ce-4250-9bc6-b13b49c7c0d5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: POST /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-volume_attachments HTTP/1.1 Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 74 Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:38:35.980750 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:38:35.982110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:38:35.982110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:38:35.982110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:38:35.982110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:38:35.982110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:38:35.982110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:38:35.982110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:38:35.982110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:38:35.982110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:38:35.982110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Sep 13 20:38:35.982110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {"volumeAttachment": {"volumeId": "5b36386b-1f17-4373-95c0-2db9c487fed1"}} Sep 13 20:38:35.982110 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Invalid volume: volume 5b36386b-1f17-4373-95c0-2db9c487fed1 is already attached to instances: 01596cca-0fed-47d9-a54e-95d95b62a45e Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'server_id': '01596cca-0fed-47d9-a54e-95d95b62a45e', 'body': {'volumeAttachment': {'volumeId': '5b36386b-1f17-4373-95c0-2db9c487fed1'}}} Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5b36386b-1f17-4373-95c0-2db9c487fed1 is already attached to instances: 01596cca-0fed-47d9-a54e-95d95b62a45e Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:38:35.982826 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5b36386b-1f17-4373-95c0-2db9c487fed1 is already attached to instances: 01596cca-0fed-47d9-a54e-95d95b62a45e Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:38:35.983863 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:38:35.984944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:38:35.984944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:38:35.984944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:38:35.984944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5b36386b-1f17-4373-95c0-2db9c487fed1 is already attached to instances: 01596cca-0fed-47d9-a54e-95d95b62a45e Sep 13 20:38:35.984944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:38:35.984944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-18c4e2b1-17ce-4250-9bc6-b13b49c7c0d5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 400 to user: Invalid volume: volume 5b36386b-1f17-4373-95c0-2db9c487fed1 is already attached to instances: 01596cca-0fed-47d9-a54e-95d95b62a45e {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:38:35.984944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-18c4e2b1-17ce-4250-9bc6-b13b49c7c0d5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101578 Sep 13 20:38:35.984944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1462/2840] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 13 20:38:35 2022] POST /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:38:36.049017 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3cb09953-a0dc-4f34-b21e-8e484a891a65 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:36.049583 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-3cb09953-a0dc-4f34-b21e-8e484a891a65 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:36.055992 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3cb09953-a0dc-4f34-b21e-8e484a891a65 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:36.056474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3cb09953-a0dc-4f34-b21e-8e484a891a65 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:36.056910 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3cb09953-a0dc-4f34-b21e-8e484a891a65 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:36.057601 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3cb09953-a0dc-4f34-b21e-8e484a891a65 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:36.058055 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3cb09953-a0dc-4f34-b21e-8e484a891a65 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:36.058513 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-3cb09953-a0dc-4f34-b21e-8e484a891a65 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:36.147121 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.objects.instance [None req-3cb09953-a0dc-4f34-b21e-8e484a891a65 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lazy-loading 'services' on Instance uuid 01596cca-0fed-47d9-a54e-95d95b62a45e {{(pid=120845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:38:36.236491 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3cb09953-a0dc-4f34-b21e-8e484a891a65 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-volume_attachments/5b36386b-1f17-4373-95c0-2db9c487fed1" status: 202 len: 0 microversion: 2.1 time: 0.192306 Sep 13 20:38:36.237334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1379/2841] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 13 20:38:36 2022] DELETE /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-volume_attachments/5b36386b-1f17-4373-95c0-2db9c487fed1 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:38:36.246396 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5b74452e-32ae-4d90-829d-613f0229e53b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:36.248532 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5b74452e-32ae-4d90-829d-613f0229e53b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:36.256042 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b74452e-32ae-4d90-829d-613f0229e53b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:36.256579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b74452e-32ae-4d90-829d-613f0229e53b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:36.257008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b74452e-32ae-4d90-829d-613f0229e53b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:36.257680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b74452e-32ae-4d90-829d-613f0229e53b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:36.258775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b74452e-32ae-4d90-829d-613f0229e53b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:36.259309 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5b74452e-32ae-4d90-829d-613f0229e53b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:36.291782 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5b74452e-32ae-4d90-829d-613f0229e53b tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050026 Sep 13 20:38:36.292337 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1463/2842] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:38:36 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:38:37.309086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-37a04169-0bd5-472c-b55e-28740a662c91 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:37.312746 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-37a04169-0bd5-472c-b55e-28740a662c91 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:37.320035 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37a04169-0bd5-472c-b55e-28740a662c91 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:37.320522 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37a04169-0bd5-472c-b55e-28740a662c91 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:37.320956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37a04169-0bd5-472c-b55e-28740a662c91 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:37.321640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37a04169-0bd5-472c-b55e-28740a662c91 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:37.322089 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37a04169-0bd5-472c-b55e-28740a662c91 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:37.322665 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-37a04169-0bd5-472c-b55e-28740a662c91 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:37.354514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-37a04169-0bd5-472c-b55e-28740a662c91 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052387 Sep 13 20:38:37.355325 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1380/2843] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:38:37 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 20:38:37.425835 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-53f49654-b404-4bde-acbb-2b81e3b85380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:37.426335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-53f49654-b404-4bde-acbb-2b81e3b85380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:37.433437 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53f49654-b404-4bde-acbb-2b81e3b85380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:37.433910 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53f49654-b404-4bde-acbb-2b81e3b85380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:37.434338 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53f49654-b404-4bde-acbb-2b81e3b85380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:37.435048 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53f49654-b404-4bde-acbb-2b81e3b85380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:37.435492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53f49654-b404-4bde-acbb-2b81e3b85380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:37.435903 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-53f49654-b404-4bde-acbb-2b81e3b85380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:37.462955 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-53f49654-b404-4bde-acbb-2b81e3b85380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Going to try to terminate instance {{(pid=120844) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:38:37.549947 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-53f49654-b404-4bde-acbb-2b81e3b85380 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 204 len: 0 microversion: 2.1 time: 0.127392 Sep 13 20:38:37.554115 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1464/2844] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:38:37 2022] DELETE /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:38:37.559383 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-df281106-643b-493e-be6c-e6af222736e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:37.560292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-df281106-643b-493e-be6c-e6af222736e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:37.567318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-df281106-643b-493e-be6c-e6af222736e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:37.567887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-df281106-643b-493e-be6c-e6af222736e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:37.568390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-df281106-643b-493e-be6c-e6af222736e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:37.569162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-df281106-643b-493e-be6c-e6af222736e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:37.569708 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-df281106-643b-493e-be6c-e6af222736e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:37.570217 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-df281106-643b-493e-be6c-e6af222736e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:37.705860 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-df281106-643b-493e-be6c-e6af222736e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:37.713959 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-df281106-643b-493e-be6c-e6af222736e6 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1683 microversion: 2.1 time: 0.158782 Sep 13 20:38:37.714557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1381/2845] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:37 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:38:38.741606 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-3d5244d2-a43d-474c-a0f0-60fefa5343cb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:38.742659 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-3d5244d2-a43d-474c-a0f0-60fefa5343cb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:38.753022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d5244d2-a43d-474c-a0f0-60fefa5343cb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:38.753713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d5244d2-a43d-474c-a0f0-60fefa5343cb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:38.754350 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d5244d2-a43d-474c-a0f0-60fefa5343cb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:38.755486 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d5244d2-a43d-474c-a0f0-60fefa5343cb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:38.756189 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d5244d2-a43d-474c-a0f0-60fefa5343cb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:38.756760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-3d5244d2-a43d-474c-a0f0-60fefa5343cb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:38.902777 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-3d5244d2-a43d-474c-a0f0-60fefa5343cb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:38.910797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-3d5244d2-a43d-474c-a0f0-60fefa5343cb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1683 microversion: 2.1 time: 0.176609 Sep 13 20:38:38.911373 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1465/2846] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:38 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:39.934526 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-25fae711-fe42-4dab-a63b-3d449a3f35db tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:39.935226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-25fae711-fe42-4dab-a63b-3d449a3f35db tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:39.942602 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25fae711-fe42-4dab-a63b-3d449a3f35db tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:39.943084 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25fae711-fe42-4dab-a63b-3d449a3f35db tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:39.943519 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25fae711-fe42-4dab-a63b-3d449a3f35db tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:39.944226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25fae711-fe42-4dab-a63b-3d449a3f35db tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:39.944674 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25fae711-fe42-4dab-a63b-3d449a3f35db tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:39.945090 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-25fae711-fe42-4dab-a63b-3d449a3f35db tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:40.016791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-25fae711-fe42-4dab-a63b-3d449a3f35db tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:40.024994 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-25fae711-fe42-4dab-a63b-3d449a3f35db tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 200 len: 1615 microversion: 2.1 time: 0.094456 Sep 13 20:38:40.038399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1382/2847] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:39 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 1615 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:40.306641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-a634853f-17c5-462c-aada-bfe8d35e9335 req-285a8038-e6bd-432f-abd9-9c75b3a65989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01596cca-0fed-47d9-a54e-95d95b62a45e", "name": "network-vif-deleted", "tag": "41945305-b721-4f1d-9a76-017a38f8a38d"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:38:40.318001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-a634853f-17c5-462c-aada-bfe8d35e9335 req-285a8038-e6bd-432f-abd9-9c75b3a65989 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:40.318521 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-a634853f-17c5-462c-aada-bfe8d35e9335 req-285a8038-e6bd-432f-abd9-9c75b3a65989 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:40.318942 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-a634853f-17c5-462c-aada-bfe8d35e9335 req-285a8038-e6bd-432f-abd9-9c75b3a65989 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:40.332998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-a634853f-17c5-462c-aada-bfe8d35e9335 req-285a8038-e6bd-432f-abd9-9c75b3a65989 service nova] Creating event network-vif-deleted:41945305-b721-4f1d-9a76-017a38f8a38d for instance 01596cca-0fed-47d9-a54e-95d95b62a45e on hv-cinder-85427 Sep 13 20:38:40.338057 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-a634853f-17c5-462c-aada-bfe8d35e9335 req-285a8038-e6bd-432f-abd9-9c75b3a65989 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253740 Sep 13 20:38:40.338915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1466/2848] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:38:41.051432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fe25eb8f-6ebd-4966-a790-0b5c94edfd9a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:41.052048 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fe25eb8f-6ebd-4966-a790-0b5c94edfd9a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:41.059018 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fe25eb8f-6ebd-4966-a790-0b5c94edfd9a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:41.059497 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fe25eb8f-6ebd-4966-a790-0b5c94edfd9a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:41.059930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fe25eb8f-6ebd-4966-a790-0b5c94edfd9a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:41.060622 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fe25eb8f-6ebd-4966-a790-0b5c94edfd9a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:41.061070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fe25eb8f-6ebd-4966-a790-0b5c94edfd9a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:41.061488 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fe25eb8f-6ebd-4966-a790-0b5c94edfd9a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:41.083001 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-fe25eb8f-6ebd-4966-a790-0b5c94edfd9a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fe25eb8f-6ebd-4966-a790-0b5c94edfd9a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e HTTP/1.1 Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:38:41.085967 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:38:41.087482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:38:41.087482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:38:41.087482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:38:41.087482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:38:41.087482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:38:41.087482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:38:41.087482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:38:41.087482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:38:41.087482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:38:41.087482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:38:41.087482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:38:41.087482 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '01596cca-0fed-47d9-a54e-95d95b62a45e'} Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:38:41.089115 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:38:41.090689 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:38:41.091928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fe25eb8f-6ebd-4966-a790-0b5c94edfd9a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 404 to user: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:38:41.091928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fe25eb8f-6ebd-4966-a790-0b5c94edfd9a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 404 len: 111 microversion: 2.1 time: 0.039961 Sep 13 20:38:41.091928 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1383/2849] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:41 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:38:41.097588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-70207370-282a-4563-8e6a-f47b009f550d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '.version_select at 0x7f98466273a0>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:41.122147 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-70207370-282a-4563-8e6a-f47b009f550d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384927219" status: 202 len: 0 microversion: 2.1 time: 0.029062 Sep 13 20:38:41.122864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1467/2850] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 13 20:38:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384927219 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:38:41.743557 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3ba1eab7-8af2-4a47-9702-10cbf6af4371 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: .version_select at 0x7f9849cf3ee0>, body: {"keypair": {"name": "tempest-keypair-1835439114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkpmUiSUiHhaFl/ZFFBRhLMkXZ7l9JSV9hWFaNFveFFQrOrPdxfRBiUJ7759obPdkjOnWqNHyntzbTB0dHJhcy7xZTv/Aj2QN33lwNv8EFdIX6yEF2YDMxH5zcGSFNBZQ=="}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:38:41.759775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-3ba1eab7-8af2-4a47-9702-10cbf6af4371 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for project be0640c4e0584998a646e45565347687. Resources: {'key_pairs'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:38:41.763996 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.quota [None req-3ba1eab7-8af2-4a47-9702-10cbf6af4371 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for user 6c42757a041b4831abd7a7ba66cbe933 and project be0640c4e0584998a646e45565347687. Resources: {'key_pairs'} {{(pid=120845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:38:41.789795 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3ba1eab7-8af2-4a47-9702-10cbf6af4371 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049993 Sep 13 20:38:41.790635 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1384/2851] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 13 20:38:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:38:43.346244 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1758374124", "imageRef": "64298502-90a0-4464-af8c-3da02f301211", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "faf29249-4b45-466b-9b8e-60480aedc097"}], "security_groups": [{"name": "tempest-securitygroup--2073833604"}], "key_name": "tempest-keypair-1835439114", "user_data": "}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:38:43.355208 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:38:43.457725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.network.neutron [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] validate_networks() for [('faf29249-4b45-466b-9b8e-60480aedc097', None, None, None, None, None)] {{(pid=120844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:38:43.829943 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Flavor limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:38:43.830402 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Image limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:38:43.830889 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Flavor pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:38:43.831286 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Image pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:38:43.831687 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:38:43.841089 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:43.841566 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:43.841988 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:43.842732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:43.843234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:43.843650 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:43.850712 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:38:43.864076 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for project be0640c4e0584998a646e45565347687. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:38:43.868278 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Getting quotas for user 6c42757a041b4831abd7a7ba66cbe933 and project be0640c4e0584998a646e45565347687. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:38:43.879476 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Going to run 1 instances... {{(pid=120844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:38:43.881895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64298502-90a0-4464-af8c-3da02f301211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:38:43.931022 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d46ed9d7-c45b-4912-a5d3-2e46b2a9a778 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.590994 Sep 13 20:38:43.931700 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1468/2852] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:38:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:38:43.943900 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7b09e7a8-e95b-48a9-8904-efa6ce622fda tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:43.944507 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7b09e7a8-e95b-48a9-8904-efa6ce622fda tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:43.946494 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:38:44.001377 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-7b09e7a8-e95b-48a9-8904-efa6ce622fda tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:44.008425 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7b09e7a8-e95b-48a9-8904-efa6ce622fda tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 200 len: 1242 microversion: 2.1 time: 0.068889 Sep 13 20:38:44.008995 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1385/2853] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:43 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:45.031443 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-11ced3ec-2b21-4cd2-8095-bda020913c1e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:45.032686 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-11ced3ec-2b21-4cd2-8095-bda020913c1e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:45.039386 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11ced3ec-2b21-4cd2-8095-bda020913c1e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:45.039852 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11ced3ec-2b21-4cd2-8095-bda020913c1e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:45.040276 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11ced3ec-2b21-4cd2-8095-bda020913c1e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:45.041146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11ced3ec-2b21-4cd2-8095-bda020913c1e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:45.041593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11ced3ec-2b21-4cd2-8095-bda020913c1e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:45.042008 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-11ced3ec-2b21-4cd2-8095-bda020913c1e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:45.108844 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-11ced3ec-2b21-4cd2-8095-bda020913c1e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:45.116920 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-11ced3ec-2b21-4cd2-8095-bda020913c1e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 200 len: 1312 microversion: 2.1 time: 0.089999 Sep 13 20:38:45.117493 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1469/2854] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:45 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:46.141466 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-982e5549-562a-4dbd-abba-b49a28dd15ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:46.142200 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-982e5549-562a-4dbd-abba-b49a28dd15ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:46.149547 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-982e5549-562a-4dbd-abba-b49a28dd15ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:46.150107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-982e5549-562a-4dbd-abba-b49a28dd15ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:46.150624 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-982e5549-562a-4dbd-abba-b49a28dd15ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:46.151543 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-982e5549-562a-4dbd-abba-b49a28dd15ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:46.151990 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-982e5549-562a-4dbd-abba-b49a28dd15ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:46.152432 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-982e5549-562a-4dbd-abba-b49a28dd15ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:46.155051 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:38:46.353222 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-982e5549-562a-4dbd-abba-b49a28dd15ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:46.362832 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-982e5549-562a-4dbd-abba-b49a28dd15ce tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 200 len: 1368 microversion: 2.1 time: 0.225053 Sep 13 20:38:46.363417 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1386/2855] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:46 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:46.492905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-1e075512-0b56-45c5-a188-cc85da79c207 req-3a4246ef-f964-48b0-986a-78b9465d0cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d71b7fb-359f-4164-8b61-1d068fe9d4ca", "tag": "23ed9010-9aef-4684-a508-110d36fe6037"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:38:46.504763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-1e075512-0b56-45c5-a188-cc85da79c207 req-3a4246ef-f964-48b0-986a-78b9465d0cab service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:46.505501 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-1e075512-0b56-45c5-a188-cc85da79c207 req-3a4246ef-f964-48b0-986a-78b9465d0cab service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:46.506080 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-1e075512-0b56-45c5-a188-cc85da79c207 req-3a4246ef-f964-48b0-986a-78b9465d0cab service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:46.518130 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-1e075512-0b56-45c5-a188-cc85da79c207 req-3a4246ef-f964-48b0-986a-78b9465d0cab service nova] Creating event network-changed:23ed9010-9aef-4684-a508-110d36fe6037 for instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca on hv-cinder-85427 Sep 13 20:38:46.523169 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-1e075512-0b56-45c5-a188-cc85da79c207 req-3a4246ef-f964-48b0-986a-78b9465d0cab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035177 Sep 13 20:38:46.524281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1470/2856] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:38:47.388521 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6f5535d8-974b-4e8a-bc1c-8c32f3196a48 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:47.389150 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6f5535d8-974b-4e8a-bc1c-8c32f3196a48 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:47.398308 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f5535d8-974b-4e8a-bc1c-8c32f3196a48 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:47.398981 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f5535d8-974b-4e8a-bc1c-8c32f3196a48 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:47.399657 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f5535d8-974b-4e8a-bc1c-8c32f3196a48 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:47.400629 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f5535d8-974b-4e8a-bc1c-8c32f3196a48 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:47.400823 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f5535d8-974b-4e8a-bc1c-8c32f3196a48 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:47.401240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6f5535d8-974b-4e8a-bc1c-8c32f3196a48 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:47.542311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-6f5535d8-974b-4e8a-bc1c-8c32f3196a48 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:47.550134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6f5535d8-974b-4e8a-bc1c-8c32f3196a48 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 200 len: 1368 microversion: 2.1 time: 0.167130 Sep 13 20:38:47.550722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1387/2857] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:47 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:48.573707 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-244359e6-5596-42f2-9269-1ce836e2ced7 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:48.574391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-244359e6-5596-42f2-9269-1ce836e2ced7 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:48.581237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244359e6-5596-42f2-9269-1ce836e2ced7 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:48.581714 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244359e6-5596-42f2-9269-1ce836e2ced7 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:48.582140 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244359e6-5596-42f2-9269-1ce836e2ced7 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:48.582864 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244359e6-5596-42f2-9269-1ce836e2ced7 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:48.583312 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244359e6-5596-42f2-9269-1ce836e2ced7 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:48.583732 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-244359e6-5596-42f2-9269-1ce836e2ced7 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:48.722239 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-244359e6-5596-42f2-9269-1ce836e2ced7 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:48.734959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-244359e6-5596-42f2-9269-1ce836e2ced7 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 200 len: 1368 microversion: 2.1 time: 0.165780 Sep 13 20:38:48.735767 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1471/2858] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:48 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:49.763804 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-844c05da-a28d-4758-b561-d7cdf94127a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:49.764528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-844c05da-a28d-4758-b561-d7cdf94127a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:49.771703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-844c05da-a28d-4758-b561-d7cdf94127a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:49.772264 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-844c05da-a28d-4758-b561-d7cdf94127a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:49.772765 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-844c05da-a28d-4758-b561-d7cdf94127a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:49.773520 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-844c05da-a28d-4758-b561-d7cdf94127a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:49.774032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-844c05da-a28d-4758-b561-d7cdf94127a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:49.774544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-844c05da-a28d-4758-b561-d7cdf94127a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:49.907037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-844c05da-a28d-4758-b561-d7cdf94127a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:49.914636 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-844c05da-a28d-4758-b561-d7cdf94127a5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 200 len: 1368 microversion: 2.1 time: 0.154776 Sep 13 20:38:49.915203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1388/2859] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:49 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:50.941909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-91dbb211-e636-423e-b6c0-b53fcb5a3b3c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:50.942821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-91dbb211-e636-423e-b6c0-b53fcb5a3b3c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:50.953803 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91dbb211-e636-423e-b6c0-b53fcb5a3b3c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:50.954652 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91dbb211-e636-423e-b6c0-b53fcb5a3b3c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:50.955372 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91dbb211-e636-423e-b6c0-b53fcb5a3b3c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:50.956495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91dbb211-e636-423e-b6c0-b53fcb5a3b3c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:50.957237 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91dbb211-e636-423e-b6c0-b53fcb5a3b3c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:50.957937 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-91dbb211-e636-423e-b6c0-b53fcb5a3b3c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:51.097198 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-91dbb211-e636-423e-b6c0-b53fcb5a3b3c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:51.104959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-91dbb211-e636-423e-b6c0-b53fcb5a3b3c tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 200 len: 1368 microversion: 2.1 time: 0.170233 Sep 13 20:38:51.105529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1472/2860] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:50 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:51.857634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-cecc9d07-81ba-4025-bf96-74679f4b17d5 req-0eaedef9-fccd-4ed5-bbbb-2d4624a584f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d71b7fb-359f-4164-8b61-1d068fe9d4ca", "name": "network-vif-plugged", "status": "completed", "tag": "23ed9010-9aef-4684-a508-110d36fe6037"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:38:51.868208 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-cecc9d07-81ba-4025-bf96-74679f4b17d5 req-0eaedef9-fccd-4ed5-bbbb-2d4624a584f9 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:51.868915 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-cecc9d07-81ba-4025-bf96-74679f4b17d5 req-0eaedef9-fccd-4ed5-bbbb-2d4624a584f9 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:51.869126 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-cecc9d07-81ba-4025-bf96-74679f4b17d5 req-0eaedef9-fccd-4ed5-bbbb-2d4624a584f9 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:51.880481 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-cecc9d07-81ba-4025-bf96-74679f4b17d5 req-0eaedef9-fccd-4ed5-bbbb-2d4624a584f9 service nova] Creating event network-vif-plugged:23ed9010-9aef-4684-a508-110d36fe6037 for instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca on hv-cinder-85427 Sep 13 20:38:51.885647 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-cecc9d07-81ba-4025-bf96-74679f4b17d5 req-0eaedef9-fccd-4ed5-bbbb-2d4624a584f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031745 Sep 13 20:38:51.886245 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1389/2861] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:38:52.127576 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-49382ef0-7005-4d93-87c8-b45e40983c2a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:52.128186 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-49382ef0-7005-4d93-87c8-b45e40983c2a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:52.135282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49382ef0-7005-4d93-87c8-b45e40983c2a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:52.135763 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49382ef0-7005-4d93-87c8-b45e40983c2a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:52.136195 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49382ef0-7005-4d93-87c8-b45e40983c2a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:52.136909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49382ef0-7005-4d93-87c8-b45e40983c2a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:52.137358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49382ef0-7005-4d93-87c8-b45e40983c2a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:52.137842 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-49382ef0-7005-4d93-87c8-b45e40983c2a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:52.273191 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-49382ef0-7005-4d93-87c8-b45e40983c2a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:52.281321 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-49382ef0-7005-4d93-87c8-b45e40983c2a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 200 len: 1368 microversion: 2.1 time: 0.157607 Sep 13 20:38:52.281895 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1473/2862] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:52 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:53.310703 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a1c8451e-7d61-4d84-b9cf-816d1d3264d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:53.311908 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a1c8451e-7d61-4d84-b9cf-816d1d3264d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:53.318794 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a1c8451e-7d61-4d84-b9cf-816d1d3264d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:53.319278 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a1c8451e-7d61-4d84-b9cf-816d1d3264d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:53.319713 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a1c8451e-7d61-4d84-b9cf-816d1d3264d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:53.320400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a1c8451e-7d61-4d84-b9cf-816d1d3264d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:53.320880 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a1c8451e-7d61-4d84-b9cf-816d1d3264d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:53.321460 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a1c8451e-7d61-4d84-b9cf-816d1d3264d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:53.459223 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a1c8451e-7d61-4d84-b9cf-816d1d3264d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:38:53.467613 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a1c8451e-7d61-4d84-b9cf-816d1d3264d4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 200 len: 1559 microversion: 2.1 time: 0.165209 Sep 13 20:38:53.468361 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1390/2863] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:38:53 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:38:53.490716 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e0811ed8-b707-458f-a9d8-2c5904a3f056 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:38:53.491209 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e0811ed8-b707-458f-a9d8-2c5904a3f056 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:38:53.497797 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0811ed8-b707-458f-a9d8-2c5904a3f056 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:53.498263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0811ed8-b707-458f-a9d8-2c5904a3f056 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:53.498721 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0811ed8-b707-458f-a9d8-2c5904a3f056 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:53.499423 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0811ed8-b707-458f-a9d8-2c5904a3f056 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:53.499865 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0811ed8-b707-458f-a9d8-2c5904a3f056 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:53.500279 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e0811ed8-b707-458f-a9d8-2c5904a3f056 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:53.580998 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e0811ed8-b707-458f-a9d8-2c5904a3f056 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094192 Sep 13 20:38:53.581600 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1474/2864] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 13 20:38:53 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:38:54.536509 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-e65422ee-9451-4a4c-8487-e909e5365631 req-71ee30e8-a0df-40ed-b6e8-79b2ebdd4f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d71b7fb-359f-4164-8b61-1d068fe9d4ca", "tag": "23ed9010-9aef-4684-a508-110d36fe6037"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:38:54.541747 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=6 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:38:54.548581 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-e65422ee-9451-4a4c-8487-e909e5365631 req-71ee30e8-a0df-40ed-b6e8-79b2ebdd4f0e service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:38:54.549167 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-e65422ee-9451-4a4c-8487-e909e5365631 req-71ee30e8-a0df-40ed-b6e8-79b2ebdd4f0e service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:38:54.549663 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-e65422ee-9451-4a4c-8487-e909e5365631 req-71ee30e8-a0df-40ed-b6e8-79b2ebdd4f0e service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:38:54.561221 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-e65422ee-9451-4a4c-8487-e909e5365631 req-71ee30e8-a0df-40ed-b6e8-79b2ebdd4f0e service nova] Creating event network-changed:23ed9010-9aef-4684-a508-110d36fe6037 for instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca on hv-cinder-85427 Sep 13 20:38:54.566948 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-e65422ee-9451-4a4c-8487-e909e5365631 req-71ee30e8-a0df-40ed-b6e8-79b2ebdd4f0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034132 Sep 13 20:38:54.568107 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1391/2865] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:39:27.004574 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:39:27.005359 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=6 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:39:27.006786 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:39:27.007442 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=31 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:39:27.012380 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1087296946", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1825705146", "security_groups": [{"name": "tempest-secgroup-smoke-1143406358"}], "block_device_mapping_v2": [{"uuid": "004c4cab-977b-4021-9d56-cb20c2ee6304", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd499434-1878-432b-bf48-fb9c3dc32248"}]}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:39:27.137395 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.network.neutron [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] validate_networks() for [('fd499434-1878-432b-bf48-fb9c3dc32248', None, None, None, None, None)] {{(pid=120844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:39:27.511744 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Flavor limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:39:27.512163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Image limits 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:39:27.512642 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Flavor pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:39:27.513050 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Image pref 0:0:0 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:39:27.513463 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.virt.hardware [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:39:27.523071 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:27.523553 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:27.523990 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:27.524735 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:27.525157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:27.525579 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:27.543478 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Getting quotas for project 7878c5e6e1e143199681f42b5518cc1a. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:39:27.547725 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.quota [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Getting quotas for user d20ba942c80848d7819aede8c0df1e7f and project 7878c5e6e1e143199681f42b5518cc1a. Resources: {'ram', 'cores', 'instances'} {{(pid=120844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:39:27.606718 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Going to run 1 instances... {{(pid=120844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:39:27.608887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='004c4cab-977b-4021-9d56-cb20c2ee6304',volume_size=None,volume_type=None)] {{(pid=120844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:39:27.746447 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e9312dab-8045-4f7a-b28d-69fccee4ec9d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742582 Sep 13 20:39:27.747078 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1475/2866] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 13 20:39:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:39:27.758829 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-aa6bf972-83fa-4f4a-949f-c44708f4c654 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:27.759661 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-aa6bf972-83fa-4f4a-949f-c44708f4c654 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:27.763177 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=15 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:39:27.764032 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=27 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:39:27.817976 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-aa6bf972-83fa-4f4a-949f-c44708f4c654 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:27.825220 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-aa6bf972-83fa-4f4a-949f-c44708f4c654 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1095 microversion: 2.1 time: 0.070667 Sep 13 20:39:27.825801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1392/2867] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:27 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:28.848641 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-41647e34-d015-4b5d-aaed-b1780955fac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:28.849356 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-41647e34-d015-4b5d-aaed-b1780955fac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:28.856125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41647e34-d015-4b5d-aaed-b1780955fac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:28.856629 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41647e34-d015-4b5d-aaed-b1780955fac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:28.857041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41647e34-d015-4b5d-aaed-b1780955fac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:28.857739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41647e34-d015-4b5d-aaed-b1780955fac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:28.858296 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41647e34-d015-4b5d-aaed-b1780955fac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:28.858915 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-41647e34-d015-4b5d-aaed-b1780955fac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:28.929905 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-41647e34-d015-4b5d-aaed-b1780955fac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:28.939366 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-41647e34-d015-4b5d-aaed-b1780955fac0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1211 microversion: 2.1 time: 0.093622 Sep 13 20:39:28.939366 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1476/2868] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:28 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:39:29.963125 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5f51fc88-b9cf-4894-b179-a1c7e4db989e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:29.964064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5f51fc88-b9cf-4894-b179-a1c7e4db989e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:29.972238 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f51fc88-b9cf-4894-b179-a1c7e4db989e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:29.972725 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f51fc88-b9cf-4894-b179-a1c7e4db989e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:29.973142 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f51fc88-b9cf-4894-b179-a1c7e4db989e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:29.973842 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f51fc88-b9cf-4894-b179-a1c7e4db989e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:29.974296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f51fc88-b9cf-4894-b179-a1c7e4db989e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:29.974754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5f51fc88-b9cf-4894-b179-a1c7e4db989e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:30.179894 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-5f51fc88-b9cf-4894-b179-a1c7e4db989e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:30.188640 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5f51fc88-b9cf-4894-b179-a1c7e4db989e tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1267 microversion: 2.1 time: 0.229776 Sep 13 20:39:30.189300 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1393/2869] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:29 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:30.291357 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-da1a6494-215e-4a59-8d6d-8619a885c1ed req-cdf0e5c5-c88e-4f5a-a781-87b9710ea664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b57cbd-c51a-4663-84b0-5312369c44fa", "tag": "d82b80f3-88d7-45e8-b2b2-e78f19b09601"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:39:30.302840 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-da1a6494-215e-4a59-8d6d-8619a885c1ed req-cdf0e5c5-c88e-4f5a-a781-87b9710ea664 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:30.303325 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-da1a6494-215e-4a59-8d6d-8619a885c1ed req-cdf0e5c5-c88e-4f5a-a781-87b9710ea664 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:30.303817 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-da1a6494-215e-4a59-8d6d-8619a885c1ed req-cdf0e5c5-c88e-4f5a-a781-87b9710ea664 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:30.317335 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-da1a6494-215e-4a59-8d6d-8619a885c1ed req-cdf0e5c5-c88e-4f5a-a781-87b9710ea664 service nova] Creating event network-changed:d82b80f3-88d7-45e8-b2b2-e78f19b09601 for instance 96b57cbd-c51a-4663-84b0-5312369c44fa on hv-cinder-85427 Sep 13 20:39:30.323173 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-da1a6494-215e-4a59-8d6d-8619a885c1ed req-cdf0e5c5-c88e-4f5a-a781-87b9710ea664 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035612 Sep 13 20:39:30.323790 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1477/2870] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:39:31.211751 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-58e38a66-acc0-4041-ba9a-79ac8cd491b5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:31.212334 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-58e38a66-acc0-4041-ba9a-79ac8cd491b5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:31.219647 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58e38a66-acc0-4041-ba9a-79ac8cd491b5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:31.220187 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58e38a66-acc0-4041-ba9a-79ac8cd491b5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:31.220592 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58e38a66-acc0-4041-ba9a-79ac8cd491b5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:31.221382 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58e38a66-acc0-4041-ba9a-79ac8cd491b5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:31.221833 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58e38a66-acc0-4041-ba9a-79ac8cd491b5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:31.222252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-58e38a66-acc0-4041-ba9a-79ac8cd491b5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:31.433366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-58e38a66-acc0-4041-ba9a-79ac8cd491b5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:31.442203 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-58e38a66-acc0-4041-ba9a-79ac8cd491b5 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1267 microversion: 2.1 time: 0.234031 Sep 13 20:39:31.443093 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1394/2871] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:31 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:32.470326 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-95af2516-2614-4573-bd53-3cb89413480d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:32.471534 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-95af2516-2614-4573-bd53-3cb89413480d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:32.482872 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95af2516-2614-4573-bd53-3cb89413480d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:32.483665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95af2516-2614-4573-bd53-3cb89413480d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:32.484385 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95af2516-2614-4573-bd53-3cb89413480d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:32.485521 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95af2516-2614-4573-bd53-3cb89413480d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:32.486277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95af2516-2614-4573-bd53-3cb89413480d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:32.487029 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-95af2516-2614-4573-bd53-3cb89413480d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:32.624234 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-95af2516-2614-4573-bd53-3cb89413480d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:32.632338 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-95af2516-2614-4573-bd53-3cb89413480d tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1267 microversion: 2.1 time: 0.169248 Sep 13 20:39:32.632881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1478/2872] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:32 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:32.652808 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-6ad261fd-99c7-4abc-8cf9-8d6b3d4077b4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:32.653352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-6ad261fd-99c7-4abc-8cf9-8d6b3d4077b4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:32.659449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6ad261fd-99c7-4abc-8cf9-8d6b3d4077b4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:32.659921 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6ad261fd-99c7-4abc-8cf9-8d6b3d4077b4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:32.660355 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6ad261fd-99c7-4abc-8cf9-8d6b3d4077b4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:32.661036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6ad261fd-99c7-4abc-8cf9-8d6b3d4077b4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:32.661480 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6ad261fd-99c7-4abc-8cf9-8d6b3d4077b4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:32.661899 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-6ad261fd-99c7-4abc-8cf9-8d6b3d4077b4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:32.685406 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-6ad261fd-99c7-4abc-8cf9-8d6b3d4077b4 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/ips" status: 200 len: 150 microversion: 2.1 time: 0.036828 Sep 13 20:39:32.685958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1395/2873] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 13 20:39:32 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:39:33.660067 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e27a3fee-e7b9-47b1-9929-95e2ae0ddd24 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:33.661121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e27a3fee-e7b9-47b1-9929-95e2ae0ddd24 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:33.670453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e27a3fee-e7b9-47b1-9929-95e2ae0ddd24 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:33.671018 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e27a3fee-e7b9-47b1-9929-95e2ae0ddd24 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:33.671495 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e27a3fee-e7b9-47b1-9929-95e2ae0ddd24 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:33.672261 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e27a3fee-e7b9-47b1-9929-95e2ae0ddd24 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:33.672762 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e27a3fee-e7b9-47b1-9929-95e2ae0ddd24 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:33.673232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e27a3fee-e7b9-47b1-9929-95e2ae0ddd24 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:33.821783 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e27a3fee-e7b9-47b1-9929-95e2ae0ddd24 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:33.829568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e27a3fee-e7b9-47b1-9929-95e2ae0ddd24 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1267 microversion: 2.1 time: 0.176656 Sep 13 20:39:33.830127 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1479/2874] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:33 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:34.029190 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-5469efc1-b5a8-4d72-a076-542555d8cf43 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7af6428-16cf-4ac3-9f60-28c32d3ba39c"}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:39:34.031750 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-5469efc1-b5a8-4d72-a076-542555d8cf43 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:34.038954 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5469efc1-b5a8-4d72-a076-542555d8cf43 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:34.039447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5469efc1-b5a8-4d72-a076-542555d8cf43 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:34.039882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5469efc1-b5a8-4d72-a076-542555d8cf43 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:34.040591 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5469efc1-b5a8-4d72-a076-542555d8cf43 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:34.041045 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5469efc1-b5a8-4d72-a076-542555d8cf43 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:34.041467 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-5469efc1-b5a8-4d72-a076-542555d8cf43 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:34.307705 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-5469efc1-b5a8-4d72-a076-542555d8cf43 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "POST /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282588 Sep 13 20:39:34.308311 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1396/2875] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 13 20:39:34 2022] POST /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:39:34.856503 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-d3a63573-10b3-49bc-bb3a-06a86587db18 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:34.857226 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-d3a63573-10b3-49bc-bb3a-06a86587db18 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:34.865625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3a63573-10b3-49bc-bb3a-06a86587db18 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:34.866220 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3a63573-10b3-49bc-bb3a-06a86587db18 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:34.866807 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3a63573-10b3-49bc-bb3a-06a86587db18 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:34.867661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3a63573-10b3-49bc-bb3a-06a86587db18 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:34.868218 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3a63573-10b3-49bc-bb3a-06a86587db18 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:34.868739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-d3a63573-10b3-49bc-bb3a-06a86587db18 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:35.009228 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-d3a63573-10b3-49bc-bb3a-06a86587db18 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:35.017549 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-d3a63573-10b3-49bc-bb3a-06a86587db18 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1267 microversion: 2.1 time: 0.167268 Sep 13 20:39:35.018023 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1480/2876] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:34 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:36.046918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9cb81b5b-e565-48d0-ac24-f17f10911cff tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:36.048061 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9cb81b5b-e565-48d0-ac24-f17f10911cff tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:36.058678 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9cb81b5b-e565-48d0-ac24-f17f10911cff tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:36.059156 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9cb81b5b-e565-48d0-ac24-f17f10911cff tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:36.059580 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9cb81b5b-e565-48d0-ac24-f17f10911cff tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:36.060252 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9cb81b5b-e565-48d0-ac24-f17f10911cff tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:36.060697 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9cb81b5b-e565-48d0-ac24-f17f10911cff tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:36.061109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9cb81b5b-e565-48d0-ac24-f17f10911cff tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:36.199165 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-9cb81b5b-e565-48d0-ac24-f17f10911cff tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:36.207198 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9cb81b5b-e565-48d0-ac24-f17f10911cff tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1267 microversion: 2.1 time: 0.168366 Sep 13 20:39:36.207762 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1397/2877] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:36 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:37.236354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-dafde13f-1c2a-4b1b-b896-96571565a7f8 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:37.237431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-dafde13f-1c2a-4b1b-b896-96571565a7f8 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:37.248353 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dafde13f-1c2a-4b1b-b896-96571565a7f8 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:37.249809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dafde13f-1c2a-4b1b-b896-96571565a7f8 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:37.249809 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dafde13f-1c2a-4b1b-b896-96571565a7f8 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:37.250868 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dafde13f-1c2a-4b1b-b896-96571565a7f8 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:37.251577 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dafde13f-1c2a-4b1b-b896-96571565a7f8 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:37.252316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-dafde13f-1c2a-4b1b-b896-96571565a7f8 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:37.392887 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-dafde13f-1c2a-4b1b-b896-96571565a7f8 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:37.400944 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-dafde13f-1c2a-4b1b-b896-96571565a7f8 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1267 microversion: 2.1 time: 0.171411 Sep 13 20:39:37.401511 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1481/2878] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:37 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:38.424731 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d8a5b833-a02a-4ef2-9abb-6824654f840f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:38.425297 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d8a5b833-a02a-4ef2-9abb-6824654f840f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:38.427817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell0:SELECT=2 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:39:38.433841 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8a5b833-a02a-4ef2-9abb-6824654f840f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:38.434342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8a5b833-a02a-4ef2-9abb-6824654f840f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:38.434786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8a5b833-a02a-4ef2-9abb-6824654f840f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:38.435486 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8a5b833-a02a-4ef2-9abb-6824654f840f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:38.435925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8a5b833-a02a-4ef2-9abb-6824654f840f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:38.436340 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d8a5b833-a02a-4ef2-9abb-6824654f840f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:38.582303 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d8a5b833-a02a-4ef2-9abb-6824654f840f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:38.591070 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d8a5b833-a02a-4ef2-9abb-6824654f840f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1267 microversion: 2.1 time: 0.170292 Sep 13 20:39:38.591654 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1398/2879] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:38 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:39.617637 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-2da9790e-bfd5-4112-9e61-29294063f672 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:39.618696 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-2da9790e-bfd5-4112-9e61-29294063f672 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:39.621800 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=2 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:39:39.623062 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell0:SELECT=6 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:39:39.633974 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2da9790e-bfd5-4112-9e61-29294063f672 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:39.634806 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2da9790e-bfd5-4112-9e61-29294063f672 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:39.635518 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2da9790e-bfd5-4112-9e61-29294063f672 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:39.636631 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2da9790e-bfd5-4112-9e61-29294063f672 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:39.637378 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2da9790e-bfd5-4112-9e61-29294063f672 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:39.638064 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-2da9790e-bfd5-4112-9e61-29294063f672 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:39.769958 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-2da9790e-bfd5-4112-9e61-29294063f672 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:39.777904 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-2da9790e-bfd5-4112-9e61-29294063f672 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1267 microversion: 2.1 time: 0.166837 Sep 13 20:39:39.778512 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1482/2880] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:39 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:40.119769 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-3d5f9717-5c0d-4406-8d98-438c881b1e17 req-0b688747-ecec-470a-8a35-922ef88e3515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b57cbd-c51a-4663-84b0-5312369c44fa", "name": "network-vif-plugged", "status": "completed", "tag": "d82b80f3-88d7-45e8-b2b2-e78f19b09601"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:39:40.130845 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-3d5f9717-5c0d-4406-8d98-438c881b1e17 req-0b688747-ecec-470a-8a35-922ef88e3515 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:40.131348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-3d5f9717-5c0d-4406-8d98-438c881b1e17 req-0b688747-ecec-470a-8a35-922ef88e3515 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:40.131941 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-3d5f9717-5c0d-4406-8d98-438c881b1e17 req-0b688747-ecec-470a-8a35-922ef88e3515 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:40.143306 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-3d5f9717-5c0d-4406-8d98-438c881b1e17 req-0b688747-ecec-470a-8a35-922ef88e3515 service nova] Creating event network-vif-plugged:d82b80f3-88d7-45e8-b2b2-e78f19b09601 for instance 96b57cbd-c51a-4663-84b0-5312369c44fa on hv-cinder-85427 Sep 13 20:39:40.148317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-3d5f9717-5c0d-4406-8d98-438c881b1e17 req-0b688747-ecec-470a-8a35-922ef88e3515 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032309 Sep 13 20:39:40.148935 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1399/2881] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:39:40.799967 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-89615fb9-72ed-452d-8f46-216bd5f1d861 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:40.800570 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-89615fb9-72ed-452d-8f46-216bd5f1d861 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:40.807121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-89615fb9-72ed-452d-8f46-216bd5f1d861 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:40.807568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-89615fb9-72ed-452d-8f46-216bd5f1d861 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:40.808002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-89615fb9-72ed-452d-8f46-216bd5f1d861 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:40.808680 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-89615fb9-72ed-452d-8f46-216bd5f1d861 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:40.809122 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-89615fb9-72ed-452d-8f46-216bd5f1d861 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:40.809533 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-89615fb9-72ed-452d-8f46-216bd5f1d861 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:40.938552 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-9f5ab6d0-e978-4e88-8ed1-7ce6c16da669 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:40.939134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-9f5ab6d0-e978-4e88-8ed1-7ce6c16da669 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:40.945366 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f5ab6d0-e978-4e88-8ed1-7ce6c16da669 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:40.945849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f5ab6d0-e978-4e88-8ed1-7ce6c16da669 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:40.946328 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f5ab6d0-e978-4e88-8ed1-7ce6c16da669 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:40.947036 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f5ab6d0-e978-4e88-8ed1-7ce6c16da669 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:40.947487 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f5ab6d0-e978-4e88-8ed1-7ce6c16da669 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:40.947912 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-9f5ab6d0-e978-4e88-8ed1-7ce6c16da669 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:40.957149 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-89615fb9-72ed-452d-8f46-216bd5f1d861 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:40.965108 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-89615fb9-72ed-452d-8f46-216bd5f1d861 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1267 microversion: 2.1 time: 0.168921 Sep 13 20:39:40.965745 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1483/2882] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:40 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:41.029152 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.objects.instance [None req-9f5ab6d0-e978-4e88-8ed1-7ce6c16da669 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lazy-loading 'services' on Instance uuid 4d71b7fb-359f-4164-8b61-1d068fe9d4ca {{(pid=120845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:39:41.105058 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-9f5ab6d0-e978-4e88-8ed1-7ce6c16da669 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/os-volume_attachments/d7af6428-16cf-4ac3-9f60-28c32d3ba39c" status: 202 len: 0 microversion: 2.1 time: 0.171147 Sep 13 20:39:41.108874 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1400/2883] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 13 20:39:40 2022] DELETE /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/os-volume_attachments/d7af6428-16cf-4ac3-9f60-28c32d3ba39c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 20:39:41.114159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-388128ac-8260-4bb0-a31b-21a8e2c8863e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:41.116410 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-388128ac-8260-4bb0-a31b-21a8e2c8863e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:41.122502 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-388128ac-8260-4bb0-a31b-21a8e2c8863e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:41.122990 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-388128ac-8260-4bb0-a31b-21a8e2c8863e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:41.123528 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-388128ac-8260-4bb0-a31b-21a8e2c8863e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:41.124190 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-388128ac-8260-4bb0-a31b-21a8e2c8863e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:41.124675 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-388128ac-8260-4bb0-a31b-21a8e2c8863e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:41.125146 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-388128ac-8260-4bb0-a31b-21a8e2c8863e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:41.155717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-388128ac-8260-4bb0-a31b-21a8e2c8863e tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Sep 13 20:39:41.156485 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1484/2884] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:39:41 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:39:41.994441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4ff0c5b4-e2e2-4d1a-a691-c6883cf653da tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:41.995605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4ff0c5b4-e2e2-4d1a-a691-c6883cf653da tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:42.003589 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ff0c5b4-e2e2-4d1a-a691-c6883cf653da tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:42.004079 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ff0c5b4-e2e2-4d1a-a691-c6883cf653da tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:42.004514 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ff0c5b4-e2e2-4d1a-a691-c6883cf653da tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:42.005199 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ff0c5b4-e2e2-4d1a-a691-c6883cf653da tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:42.005648 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ff0c5b4-e2e2-4d1a-a691-c6883cf653da tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:42.006073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4ff0c5b4-e2e2-4d1a-a691-c6883cf653da tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:42.144737 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-4ff0c5b4-e2e2-4d1a-a691-c6883cf653da tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:42.152998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4ff0c5b4-e2e2-4d1a-a691-c6883cf653da tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1454 microversion: 2.1 time: 0.166552 Sep 13 20:39:42.153544 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1401/2885] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:41 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:42.168494 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-db273dd4-ce5c-436e-a4f9-0cac8ed38646 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:42.170746 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-db273dd4-ce5c-436e-a4f9-0cac8ed38646 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:42.176260 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-245d1f4b-b3cf-42f8-97a2-8c8349859237 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:42.176882 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-245d1f4b-b3cf-42f8-97a2-8c8349859237 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:42.177412 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-db273dd4-ce5c-436e-a4f9-0cac8ed38646 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:42.178111 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-db273dd4-ce5c-436e-a4f9-0cac8ed38646 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:42.178709 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-db273dd4-ce5c-436e-a4f9-0cac8ed38646 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:42.179538 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-db273dd4-ce5c-436e-a4f9-0cac8ed38646 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:42.180119 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-db273dd4-ce5c-436e-a4f9-0cac8ed38646 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:42.180673 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-db273dd4-ce5c-436e-a4f9-0cac8ed38646 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:42.183087 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-245d1f4b-b3cf-42f8-97a2-8c8349859237 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:42.183582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-245d1f4b-b3cf-42f8-97a2-8c8349859237 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:42.184021 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-245d1f4b-b3cf-42f8-97a2-8c8349859237 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:42.184780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-245d1f4b-b3cf-42f8-97a2-8c8349859237 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:42.185459 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-245d1f4b-b3cf-42f8-97a2-8c8349859237 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:42.185849 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-245d1f4b-b3cf-42f8-97a2-8c8349859237 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:42.215894 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-db273dd4-ce5c-436e-a4f9-0cac8ed38646 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051336 Sep 13 20:39:42.216465 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1485/2886] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:39:42 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:39:42.322809 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-245d1f4b-b3cf-42f8-97a2-8c8349859237 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:42.330956 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-245d1f4b-b3cf-42f8-97a2-8c8349859237 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1454 microversion: 2.1 time: 0.158682 Sep 13 20:39:42.331540 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1402/2887] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:42 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:43.229001 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-bd634df7-9692-4db6-9e4c-8b3430cbe007 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:43.231257 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-bd634df7-9692-4db6-9e4c-8b3430cbe007 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:43.238931 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bd634df7-9692-4db6-9e4c-8b3430cbe007 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:43.239422 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bd634df7-9692-4db6-9e4c-8b3430cbe007 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:43.239850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bd634df7-9692-4db6-9e4c-8b3430cbe007 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:43.240562 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bd634df7-9692-4db6-9e4c-8b3430cbe007 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:43.241041 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bd634df7-9692-4db6-9e4c-8b3430cbe007 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:43.241462 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-bd634df7-9692-4db6-9e4c-8b3430cbe007 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:43.273829 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-bd634df7-9692-4db6-9e4c-8b3430cbe007 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048750 Sep 13 20:39:43.274318 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1486/2888] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 13 20:39:43 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 20:39:43.341099 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-99da4d27-f0bd-4f45-a61a-bd1fda47bdb1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:43.341719 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-99da4d27-f0bd-4f45-a61a-bd1fda47bdb1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:43.348321 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-99da4d27-f0bd-4f45-a61a-bd1fda47bdb1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:43.348797 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-99da4d27-f0bd-4f45-a61a-bd1fda47bdb1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:43.349234 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-99da4d27-f0bd-4f45-a61a-bd1fda47bdb1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:43.349920 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-99da4d27-f0bd-4f45-a61a-bd1fda47bdb1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:43.350338 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-99da4d27-f0bd-4f45-a61a-bd1fda47bdb1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:43.350791 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-99da4d27-f0bd-4f45-a61a-bd1fda47bdb1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:43.378153 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-99da4d27-f0bd-4f45-a61a-bd1fda47bdb1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Going to try to terminate instance {{(pid=120845) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:39:43.460445 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-99da4d27-f0bd-4f45-a61a-bd1fda47bdb1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 204 len: 0 microversion: 2.1 time: 0.122964 Sep 13 20:39:43.461174 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1403/2889] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:39:43 2022] DELETE /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:39:43.470391 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4da9c826-384b-410a-bf0b-df6528aaf3b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:43.470996 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-4da9c826-384b-410a-bf0b-df6528aaf3b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:43.476940 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4da9c826-384b-410a-bf0b-df6528aaf3b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:43.477593 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4da9c826-384b-410a-bf0b-df6528aaf3b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:43.478024 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4da9c826-384b-410a-bf0b-df6528aaf3b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:43.478841 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4da9c826-384b-410a-bf0b-df6528aaf3b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:43.479336 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4da9c826-384b-410a-bf0b-df6528aaf3b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:43.479793 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-4da9c826-384b-410a-bf0b-df6528aaf3b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:43.615282 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-4da9c826-384b-410a-bf0b-df6528aaf3b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:43.623263 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4da9c826-384b-410a-bf0b-df6528aaf3b1 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 200 len: 1683 microversion: 2.1 time: 0.156883 Sep 13 20:39:43.624121 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1487/2890] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:43 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:44.214772 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [req-4edee8b7-9819-4d48-9e5e-af3879b2feac req-379b6c54-1065-4e45-bba9-2ae207201bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b57cbd-c51a-4663-84b0-5312369c44fa", "tag": "d82b80f3-88d7-45e8-b2b2-e78f19b09601"}]} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:39:44.224458 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-4edee8b7-9819-4d48-9e5e-af3879b2feac req-379b6c54-1065-4e45-bba9-2ae207201bef service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:44.224930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-4edee8b7-9819-4d48-9e5e-af3879b2feac req-379b6c54-1065-4e45-bba9-2ae207201bef service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:44.225358 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [req-4edee8b7-9819-4d48-9e5e-af3879b2feac req-379b6c54-1065-4e45-bba9-2ae207201bef service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:44.238533 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.compute.server_external_events [req-4edee8b7-9819-4d48-9e5e-af3879b2feac req-379b6c54-1065-4e45-bba9-2ae207201bef service nova] Creating event network-changed:d82b80f3-88d7-45e8-b2b2-e78f19b09601 for instance 96b57cbd-c51a-4663-84b0-5312369c44fa on hv-cinder-85427 Sep 13 20:39:44.243390 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [req-4edee8b7-9819-4d48-9e5e-af3879b2feac req-379b6c54-1065-4e45-bba9-2ae207201bef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032728 Sep 13 20:39:44.243943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1404/2891] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:39:44.647529 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e72b1f4a-860c-4b57-99f0-76266c927793 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:44.648091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e72b1f4a-860c-4b57-99f0-76266c927793 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:44.654959 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e72b1f4a-860c-4b57-99f0-76266c927793 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:44.655420 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e72b1f4a-860c-4b57-99f0-76266c927793 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:44.655880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e72b1f4a-860c-4b57-99f0-76266c927793 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:44.656561 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e72b1f4a-860c-4b57-99f0-76266c927793 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:44.657009 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e72b1f4a-860c-4b57-99f0-76266c927793 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:44.657431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e72b1f4a-860c-4b57-99f0-76266c927793 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:44.796044 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-e72b1f4a-860c-4b57-99f0-76266c927793 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:44.805171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e72b1f4a-860c-4b57-99f0-76266c927793 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 200 len: 1683 microversion: 2.1 time: 0.161602 Sep 13 20:39:44.805760 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1488/2892] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:44 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:45.830296 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fae73461-8d93-471b-aa64-a261dd5723be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:45.830917 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fae73461-8d93-471b-aa64-a261dd5723be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:45.837688 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fae73461-8d93-471b-aa64-a261dd5723be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:45.838173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fae73461-8d93-471b-aa64-a261dd5723be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:45.838662 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fae73461-8d93-471b-aa64-a261dd5723be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:45.839384 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fae73461-8d93-471b-aa64-a261dd5723be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:45.839835 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fae73461-8d93-471b-aa64-a261dd5723be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:45.840250 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fae73461-8d93-471b-aa64-a261dd5723be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:45.913596 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-fae73461-8d93-471b-aa64-a261dd5723be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c42757a041b4831abd7a7ba66cbe933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0640c4e0584998a646e45565347687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:39:45.921919 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fae73461-8d93-471b-aa64-a261dd5723be tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 200 len: 1615 microversion: 2.1 time: 0.096736 Sep 13 20:39:45.922528 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1405/2893] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:45 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 1615 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:39:46.258908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-74fcf30e-9927-4a96-9f39-cba177fe9a6c req-30d47cf2-7395-4c7b-a53d-6a2f20688a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d71b7fb-359f-4164-8b61-1d068fe9d4ca", "name": "network-vif-deleted", "tag": "23ed9010-9aef-4684-a508-110d36fe6037"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:39:46.269991 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-74fcf30e-9927-4a96-9f39-cba177fe9a6c req-30d47cf2-7395-4c7b-a53d-6a2f20688a45 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:46.270784 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-74fcf30e-9927-4a96-9f39-cba177fe9a6c req-30d47cf2-7395-4c7b-a53d-6a2f20688a45 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:46.271441 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-74fcf30e-9927-4a96-9f39-cba177fe9a6c req-30d47cf2-7395-4c7b-a53d-6a2f20688a45 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:46.284946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-74fcf30e-9927-4a96-9f39-cba177fe9a6c req-30d47cf2-7395-4c7b-a53d-6a2f20688a45 service nova] Creating event network-vif-deleted:23ed9010-9aef-4684-a508-110d36fe6037 for instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca on hv-cinder-85427 Sep 13 20:39:46.292496 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-74fcf30e-9927-4a96-9f39-cba177fe9a6c req-30d47cf2-7395-4c7b-a53d-6a2f20688a45 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037548 Sep 13 20:39:46.293126 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1489/2894] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:39:46.945327 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-014f6733-56b3-41cd-991a-ec2c80f1856a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:46.945973 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-014f6733-56b3-41cd-991a-ec2c80f1856a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:46.953162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-014f6733-56b3-41cd-991a-ec2c80f1856a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:46.953652 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-014f6733-56b3-41cd-991a-ec2c80f1856a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:46.954787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-014f6733-56b3-41cd-991a-ec2c80f1856a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:46.955549 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-014f6733-56b3-41cd-991a-ec2c80f1856a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:46.955997 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-014f6733-56b3-41cd-991a-ec2c80f1856a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:46.956631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-014f6733-56b3-41cd-991a-ec2c80f1856a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:46.971030 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-014f6733-56b3-41cd-991a-ec2c80f1856a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-014f6733-56b3-41cd-991a-ec2c80f1856a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca HTTP/1.1 Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:39:46.972722 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:39:46.974086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:39:46.974086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:46.974086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:46.974086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:46.974086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:46.974086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:39:46.974086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:39:46.974086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:39:46.974086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:46.974086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:39:46.974086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:46.974086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '4d71b7fb-359f-4164-8b61-1d068fe9d4ca'} Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:46.975240 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:46.976720 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:46.977723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-014f6733-56b3-41cd-991a-ec2c80f1856a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 404 to user: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:46.977723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-014f6733-56b3-41cd-991a-ec2c80f1856a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 404 len: 111 microversion: 2.1 time: 0.032693 Sep 13 20:39:46.977723 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1406/2895] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:46 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:39:46.984240 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-39326841-139d-48d6-afb0-68756f023337 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '.version_select at 0x7f9849cf7f70>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:47.005801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-39326841-139d-48d6-afb0-68756f023337 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835439114" status: 202 len: 0 microversion: 2.1 time: 0.026130 Sep 13 20:39:47.006917 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1490/2896] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 13 20:39:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835439114 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:39:48.769411 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-591aea7f-fef1-49a4-a950-df7052703ebb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:48.769998 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-591aea7f-fef1-49a4-a950-df7052703ebb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:48.777066 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-591aea7f-fef1-49a4-a950-df7052703ebb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:48.777539 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-591aea7f-fef1-49a4-a950-df7052703ebb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:48.777977 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-591aea7f-fef1-49a4-a950-df7052703ebb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:48.778775 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-591aea7f-fef1-49a4-a950-df7052703ebb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:48.779229 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-591aea7f-fef1-49a4-a950-df7052703ebb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:48.779655 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-591aea7f-fef1-49a4-a950-df7052703ebb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:48.793474 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-591aea7f-fef1-49a4-a950-df7052703ebb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-591aea7f-fef1-49a4-a950-df7052703ebb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: DELETE /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca HTTP/1.1 Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:39:48.795073 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:39:48.796441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:39:48.796441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:48.796441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:48.796441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:48.796441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:48.796441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:39:48.796441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:39:48.796441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:39:48.796441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:48.796441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:39:48.796441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:48.796441 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '4d71b7fb-359f-4164-8b61-1d068fe9d4ca'} Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:48.797231 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:48.798668 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:48.800086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-591aea7f-fef1-49a4-a950-df7052703ebb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 404 to user: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:48.800086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-591aea7f-fef1-49a4-a950-df7052703ebb tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 404 len: 111 microversion: 2.1 time: 0.030984 Sep 13 20:39:48.800086 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1407/2897] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:39:48 2022] DELETE /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:39:48.805583 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b08ab4a0-6eb7-4f4e-9339-556bffb2e6c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:48.806308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b08ab4a0-6eb7-4f4e-9339-556bffb2e6c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 4d71b7fb-359f-4164-8b61-1d068fe9d4ca] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:48.815037 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b08ab4a0-6eb7-4f4e-9339-556bffb2e6c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:48.815506 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b08ab4a0-6eb7-4f4e-9339-556bffb2e6c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:48.815902 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b08ab4a0-6eb7-4f4e-9339-556bffb2e6c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:48.816575 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b08ab4a0-6eb7-4f4e-9339-556bffb2e6c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:48.817014 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b08ab4a0-6eb7-4f4e-9339-556bffb2e6c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:48.817424 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b08ab4a0-6eb7-4f4e-9339-556bffb2e6c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:48.830654 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-b08ab4a0-6eb7-4f4e-9339-556bffb2e6c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b08ab4a0-6eb7-4f4e-9339-556bffb2e6c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca HTTP/1.1 Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:39:48.832206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:39:48.833555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:39:48.833555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:48.833555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:48.833555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:48.833555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:48.833555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:39:48.833555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:39:48.833555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:39:48.833555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:48.833555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:39:48.833555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:48.833555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '4d71b7fb-359f-4164-8b61-1d068fe9d4ca'} Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:48.834401 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. Sep 13 20:39:48.835720 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:48.836914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b08ab4a0-6eb7-4f4e-9339-556bffb2e6c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 404 to user: Instance 4d71b7fb-359f-4164-8b61-1d068fe9d4ca could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:48.836914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b08ab4a0-6eb7-4f4e-9339-556bffb2e6c5 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca" status: 404 len: 111 microversion: 2.1 time: 0.032455 Sep 13 20:39:48.836914 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1491/2898] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:48 2022] GET /compute/v2.1/servers/4d71b7fb-359f-4164-8b61-1d068fe9d4ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:39:49.994564 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7bd1144b-c913-4a4e-a3a2-3f5d9464d24f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:49.995029 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-7bd1144b-c913-4a4e-a3a2-3f5d9464d24f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:50.001930 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7bd1144b-c913-4a4e-a3a2-3f5d9464d24f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:50.002471 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7bd1144b-c913-4a4e-a3a2-3f5d9464d24f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:50.003038 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7bd1144b-c913-4a4e-a3a2-3f5d9464d24f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:50.003819 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7bd1144b-c913-4a4e-a3a2-3f5d9464d24f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:50.004236 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7bd1144b-c913-4a4e-a3a2-3f5d9464d24f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:50.004656 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-7bd1144b-c913-4a4e-a3a2-3f5d9464d24f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:50.018233 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-7bd1144b-c913-4a4e-a3a2-3f5d9464d24f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7bd1144b-c913-4a4e-a3a2-3f5d9464d24f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: DELETE /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e HTTP/1.1 Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:39:50.019876 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:39:50.021262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:39:50.021262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:50.021262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:50.021262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:50.021262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:50.021262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:39:50.021262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:39:50.021262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:39:50.021262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:50.021262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:39:50.021262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:39:50.021262 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '01596cca-0fed-47d9-a54e-95d95b62a45e'} Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:50.022003 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:39:50.023518 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.024916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-7bd1144b-c913-4a4e-a3a2-3f5d9464d24f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 404 to user: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:50.024916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-7bd1144b-c913-4a4e-a3a2-3f5d9464d24f tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 404 len: 111 microversion: 2.1 time: 0.030787 Sep 13 20:39:50.024916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1408/2899] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:39:49 2022] DELETE /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:39:50.029909 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e06cd31e-3272-444c-8eb7-4c5905eacd24 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:50.030573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-e06cd31e-3272-444c-8eb7-4c5905eacd24 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: 01596cca-0fed-47d9-a54e-95d95b62a45e] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:50.037358 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e06cd31e-3272-444c-8eb7-4c5905eacd24 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:50.037843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e06cd31e-3272-444c-8eb7-4c5905eacd24 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:50.038277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e06cd31e-3272-444c-8eb7-4c5905eacd24 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:50.039004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e06cd31e-3272-444c-8eb7-4c5905eacd24 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:50.039454 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e06cd31e-3272-444c-8eb7-4c5905eacd24 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:50.039873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-e06cd31e-3272-444c-8eb7-4c5905eacd24 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:50.053232 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-e06cd31e-3272-444c-8eb7-4c5905eacd24 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e06cd31e-3272-444c-8eb7-4c5905eacd24 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e HTTP/1.1 Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:39:50.054821 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:39:50.056179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:39:50.056179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:50.056179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:50.056179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:50.056179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:50.056179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:39:50.056179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:39:50.056179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:39:50.056179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:50.056179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:39:50.056179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:39:50.056179 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '01596cca-0fed-47d9-a54e-95d95b62a45e'} Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:50.057058 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. Sep 13 20:39:50.058568 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.059873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-e06cd31e-3272-444c-8eb7-4c5905eacd24 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 404 to user: Instance 01596cca-0fed-47d9-a54e-95d95b62a45e could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:50.059873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-e06cd31e-3272-444c-8eb7-4c5905eacd24 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e" status: 404 len: 111 microversion: 2.1 time: 0.030195 Sep 13 20:39:50.059873 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1492/2900] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:50 2022] GET /compute/v2.1/servers/01596cca-0fed-47d9-a54e-95d95b62a45e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 20:39:50.065213 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2e13ea2c-f47f-441d-96f6-320b5785209a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:50.065836 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-2e13ea2c-f47f-441d-96f6-320b5785209a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:50.071875 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e13ea2c-f47f-441d-96f6-320b5785209a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:50.072352 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e13ea2c-f47f-441d-96f6-320b5785209a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:50.072793 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e13ea2c-f47f-441d-96f6-320b5785209a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:50.073476 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e13ea2c-f47f-441d-96f6-320b5785209a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:50.073925 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e13ea2c-f47f-441d-96f6-320b5785209a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:50.074349 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-2e13ea2c-f47f-441d-96f6-320b5785209a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:50.088192 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-2e13ea2c-f47f-441d-96f6-320b5785209a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2e13ea2c-f47f-441d-96f6-320b5785209a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: DELETE /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 HTTP/1.1 Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:39:50.089754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:39:50.091211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:39:50.091211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:50.091211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:50.091211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:50.091211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:50.091211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:39:50.091211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:39:50.091211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:39:50.091211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:50.091211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:39:50.091211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:39:50.091211 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': 'f473d0db-2df5-4cab-be22-87f507a90c42'} Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:50.091958 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:39:50.093322 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.094774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-2e13ea2c-f47f-441d-96f6-320b5785209a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 404 to user: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:50.094774 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-2e13ea2c-f47f-441d-96f6-320b5785209a tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 404 len: 111 microversion: 2.1 time: 0.030314 Sep 13 20:39:50.094986 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1409/2901] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:39:50 2022] DELETE /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:39:50.099846 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-457ce349-6493-4b38-aea9-63d2818ed52d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:50.100453 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-457ce349-6493-4b38-aea9-63d2818ed52d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: f473d0db-2df5-4cab-be22-87f507a90c42] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:50.106981 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-457ce349-6493-4b38-aea9-63d2818ed52d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:50.107460 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-457ce349-6493-4b38-aea9-63d2818ed52d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:50.107881 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-457ce349-6493-4b38-aea9-63d2818ed52d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:50.108557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-457ce349-6493-4b38-aea9-63d2818ed52d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:50.109004 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-457ce349-6493-4b38-aea9-63d2818ed52d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:50.109416 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-457ce349-6493-4b38-aea9-63d2818ed52d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:50.122692 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-457ce349-6493-4b38-aea9-63d2818ed52d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-457ce349-6493-4b38-aea9-63d2818ed52d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 HTTP/1.1 Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:39:50.124238 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:39:50.125655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:39:50.125655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:50.125655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:50.125655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:50.125655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:50.125655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:39:50.125655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:39:50.125655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:39:50.125655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:50.125655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:39:50.125655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:39:50.125655 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': 'f473d0db-2df5-4cab-be22-87f507a90c42'} Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:50.126582 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. Sep 13 20:39:50.127946 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:50.129316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-457ce349-6493-4b38-aea9-63d2818ed52d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 404 to user: Instance f473d0db-2df5-4cab-be22-87f507a90c42 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:50.129316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-457ce349-6493-4b38-aea9-63d2818ed52d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42" status: 404 len: 111 microversion: 2.1 time: 0.029757 Sep 13 20:39:50.129316 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1493/2902] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:50 2022] GET /compute/v2.1/servers/f473d0db-2df5-4cab-be22-87f507a90c42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:39:51.272265 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a6ae71c6-796b-4ec1-be70-1b7143ba549d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:51.272786 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a6ae71c6-796b-4ec1-be70-1b7143ba549d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:51.279684 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6ae71c6-796b-4ec1-be70-1b7143ba549d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:51.280162 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6ae71c6-796b-4ec1-be70-1b7143ba549d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:51.280599 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6ae71c6-796b-4ec1-be70-1b7143ba549d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:51.281291 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6ae71c6-796b-4ec1-be70-1b7143ba549d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:51.281744 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6ae71c6-796b-4ec1-be70-1b7143ba549d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:51.282168 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a6ae71c6-796b-4ec1-be70-1b7143ba549d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:51.286318 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:39:51.296799 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-a6ae71c6-796b-4ec1-be70-1b7143ba549d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a6ae71c6-796b-4ec1-be70-1b7143ba549d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: DELETE /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 HTTP/1.1 Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:39:51.298342 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:39:51.299916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:39:51.299916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:51.299916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:51.299916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:51.299916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:51.299916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:39:51.299916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:39:51.299916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:39:51.299916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:51.299916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:39:51.299916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:39:51.299916 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': 'e811c557-1b94-4700-aa3a-3fdceb873fb4'} Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:51.300851 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:39:51.302268 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:51.303817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a6ae71c6-796b-4ec1-be70-1b7143ba549d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 404 to user: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:51.303817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a6ae71c6-796b-4ec1-be70-1b7143ba549d tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 404 len: 111 microversion: 2.1 time: 0.031529 Sep 13 20:39:51.303817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1410/2903] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:39:51 2022] DELETE /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:39:51.308399 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-eee6dc16-be60-464b-87c3-272329acec51 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:51.308982 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-eee6dc16-be60-464b-87c3-272329acec51 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] [instance: e811c557-1b94-4700-aa3a-3fdceb873fb4] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:39:51.315869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eee6dc16-be60-464b-87c3-272329acec51 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:51.316339 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eee6dc16-be60-464b-87c3-272329acec51 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:51.316748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eee6dc16-be60-464b-87c3-272329acec51 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:51.317414 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eee6dc16-be60-464b-87c3-272329acec51 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:39:51.317850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eee6dc16-be60-464b-87c3-272329acec51 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:39:51.318354 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-eee6dc16-be60-464b-87c3-272329acec51 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:39:51.331662 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-eee6dc16-be60-464b-87c3-272329acec51 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] HTTP exception thrown: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-eee6dc16-be60-464b-87c3-272329acec51 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Request method failure captured: Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 HTTP/1.1 Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOmWQ_w4N-fUMNhfUZsFOzxq15Yxm8lA-cbmDl8Ru3P8yvX7maTMjFoySI6m9nOP0-8NzB_L-4--hT7OgFRUpOx0vpMZsEvPWhN0tlO7P86txjB5OVAp4CP74Kaip7QDHZSLlHWA0o2DIuVwqVe-KglY8u896A-LR_d90eEHN8ZEOfw Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:39:51.333159 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:39:51.334573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be0640c4e0584998a646e45565347687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be0640c4e0584998a646e45565347687", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be0640c4e0584998a646e45565347687"}]}] Sep 13 20:39:51.334573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:51.334573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: be0640c4e0584998a646e45565347687 Sep 13 20:39:51.334573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1899168870 Sep 13 20:39:51.334573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:51.334573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:39:51.334573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:39:51.334573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 6c42757a041b4831abd7a7ba66cbe933 Sep 13 20:39:51.334573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-AttachVolumeNegativeTest-1899168870-project Sep 13 20:39:51.334573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:39:51.334573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:39:51.334573 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': 'e811c557-1b94-4700-aa3a-3fdceb873fb4'} Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:51.335297 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. Sep 13 20:39:51.336400 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:51.337413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-eee6dc16-be60-464b-87c3-272329acec51 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] Returning 404 to user: Instance e811c557-1b94-4700-aa3a-3fdceb873fb4 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:51.337413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-eee6dc16-be60-464b-87c3-272329acec51 tempest-AttachVolumeNegativeTest-1899168870 tempest-AttachVolumeNegativeTest-1899168870-project] 10.222.0.52 "GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4" status: 404 len: 111 microversion: 2.1 time: 0.029999 Sep 13 20:39:51.337413 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1494/2904] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:39:51 2022] GET /compute/v2.1/servers/e811c557-1b94-4700-aa3a-3fdceb873fb4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:39:56.091501 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8032b433-277f-44c7-8a9c-7ac10b25d091 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Action: 'create', calling method: .version_select at 0x7f98465e00d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1986182008", "metadata": {"Type": "work"}}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8032b433-277f-44c7-8a9c-7ac10b25d091 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Request method failure captured: Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 122 Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOqbJN-scdEXU6QnxPWsLj68BHWS37mTamLGguOxWwAbZFZE3KNqk59ujDLyZSjd4HToF6UcBoKjFLnh3DlUHV0EFkiU4x_Im8Pa6aXOfiRX41vQeB-lDgOHo6A6x-um5zDJUgdlIUsgpB59O99cN50uM-OqQ_3bSioyQ6iiXk8i0Kg Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: a05f0392090f485a8927ee077c554610 Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:39:56.102953 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a05f0392090f485a8927ee077c554610"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a05f0392090f485a8927ee077c554610", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a05f0392090f485a8927ee077c554610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a05f0392090f485a8927ee077c554610"}]}] Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: a05f0392090f485a8927ee077c554610 Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-VolumesNegativeTest-1984595401-project Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 41600aac56ab4e9ba0edd529ab9042d3 Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-VolumesNegativeTest-1984595401-project Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1986182008", "metadata": {"Type": "work"}}} Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: Sep 13 20:39:56.104351 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1986182008', 'metadata': {'Type': 'work'}}}} Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise error Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:56.105193 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 20:39:56.106389 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 20:39:56.107447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 20:39:56.107447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.107447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8032b433-277f-44c7-8a9c-7ac10b25d091 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:56.107447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8032b433-277f-44c7-8a9c-7ac10b25d091 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.168754 Sep 13 20:39:56.107447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1411/2905] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Sep 13 20:39:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:39:56.114183 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4273328b-4aed-425f-bfbe-83e84771afaa tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Action: 'create', calling method: .version_select at 0x7f9849c9f820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1295571350", "metadata": {"Type": "work"}}} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4273328b-4aed-425f-bfbe-83e84771afaa tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Request method failure captured: Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 120 Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOqbJN-scdEXU6QnxPWsLj68BHWS37mTamLGguOxWwAbZFZE3KNqk59ujDLyZSjd4HToF6UcBoKjFLnh3DlUHV0EFkiU4x_Im8Pa6aXOfiRX41vQeB-lDgOHo6A6x-um5zDJUgdlIUsgpB59O99cN50uM-OqQ_3bSioyQ6iiXk8i0Kg Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: a05f0392090f485a8927ee077c554610 Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:39:56.118751 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a05f0392090f485a8927ee077c554610"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a05f0392090f485a8927ee077c554610", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a05f0392090f485a8927ee077c554610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a05f0392090f485a8927ee077c554610"}]}] Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: a05f0392090f485a8927ee077c554610 Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-VolumesNegativeTest-1984595401-project Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 41600aac56ab4e9ba0edd529ab9042d3 Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-VolumesNegativeTest-1984595401-project Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1295571350", "metadata": {"Type": "work"}}} Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: Sep 13 20:39:56.120096 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1295571350', 'metadata': {'Type': 'work'}}}} Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise error Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi '0' Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:56.121002 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 20:39:56.122674 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 20:39:56.124928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 20:39:56.124928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.124928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-4273328b-4aed-425f-bfbe-83e84771afaa tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:56.124928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-4273328b-4aed-425f-bfbe-83e84771afaa tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009868 Sep 13 20:39:56.124928 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1495/2906] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Sep 13 20:39:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:39:56.129826 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-21e576bd-6c32-4c39-a2ca-d87eda04cb15 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Action: 'create', calling method: .version_select at 0x7f9846672af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-268049955", "metadata": {"Type": "work"}}} {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-21e576bd-6c32-4c39-a2ca-d87eda04cb15 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Request method failure captured: Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 118 Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOqbJN-scdEXU6QnxPWsLj68BHWS37mTamLGguOxWwAbZFZE3KNqk59ujDLyZSjd4HToF6UcBoKjFLnh3DlUHV0EFkiU4x_Im8Pa6aXOfiRX41vQeB-lDgOHo6A6x-um5zDJUgdlIUsgpB59O99cN50uM-OqQ_3bSioyQ6iiXk8i0Kg Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: a05f0392090f485a8927ee077c554610 Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:39:56.134631 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a05f0392090f485a8927ee077c554610"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a05f0392090f485a8927ee077c554610", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a05f0392090f485a8927ee077c554610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a05f0392090f485a8927ee077c554610"}]}] Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: a05f0392090f485a8927ee077c554610 Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-VolumesNegativeTest-1984595401-project Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 41600aac56ab4e9ba0edd529ab9042d3 Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-VolumesNegativeTest-1984595401-project Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-268049955", "metadata": {"Type": "work"}}} Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: Sep 13 20:39:56.136503 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-268049955', 'metadata': {'Type': 'work'}}}} Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise error Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi '' Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:56.137690 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 20:39:56.140206 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 20:39:56.141918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 20:39:56.141918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.141918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-21e576bd-6c32-4c39-a2ca-d87eda04cb15 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:56.141918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-21e576bd-6c32-4c39-a2ca-d87eda04cb15 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010346 Sep 13 20:39:56.141918 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1412/2907] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Sep 13 20:39:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:39:56.146525 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8a6dc5d2-19a1-42d5-9aac-fb82b31e5418 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Calling method '.version_select at 0x7f9849d17f70>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:56.176717 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-8a6dc5d2-19a1-42d5-9aac-fb82b31e5418 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] HTTP exception thrown: Volume tempest-invalid-260004927 could not be found. Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8a6dc5d2-19a1-42d5-9aac-fb82b31e5418 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Request method failure captured: Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-260004927 HTTP/1.1 Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOqbJN-scdEXU6QnxPWsLj68BHWS37mTamLGguOxWwAbZFZE3KNqk59ujDLyZSjd4HToF6UcBoKjFLnh3DlUHV0EFkiU4x_Im8Pa6aXOfiRX41vQeB-lDgOHo6A6x-um5zDJUgdlIUsgpB59O99cN50uM-OqQ_3bSioyQ6iiXk8i0Kg Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: a05f0392090f485a8927ee077c554610 Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:39:56.178772 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a05f0392090f485a8927ee077c554610"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a05f0392090f485a8927ee077c554610", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a05f0392090f485a8927ee077c554610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a05f0392090f485a8927ee077c554610"}]}] Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: a05f0392090f485a8927ee077c554610 Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-VolumesNegativeTest-1984595401-project Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 41600aac56ab4e9ba0edd529ab9042d3 Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-VolumesNegativeTest-1984595401-project Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Volume tempest-invalid-260004927 could not be found. Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': 'tempest-invalid-260004927'} Sep 13 20:39:56.180104 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-260004927 could not be found. (HTTP 404) (Request-ID: req-d6f206da-9d6e-4ab2-b8c9-85a209585d41) Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.181125 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 20:39:56.182527 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-260004927 could not be found. Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:39:56.183739 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-260004927 could not be found. Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-260004927 could not be found. Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-8a6dc5d2-19a1-42d5-9aac-fb82b31e5418 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Returning 404 to user: Volume tempest-invalid-260004927 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-8a6dc5d2-19a1-42d5-9aac-fb82b31e5418 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-260004927" status: 404 len: 98 microversion: 2.1 time: 0.038443 Sep 13 20:39:56.184952 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1496/2908] 10.222.0.52 () {58 vars in 1215 bytes} [Tue Sep 13 20:39:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-260004927 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 20:39:56.190485 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-bc10a2bb-3345-42a8-8734-2a20dc9c6d18 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004219 Sep 13 20:39:56.190971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1413/2909] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Sep 13 20:39:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 20:39:56.199281 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-c5710454-2ec9-44d7-9880-6addfc7d08eb tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003686 Sep 13 20:39:56.199775 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1497/2910] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 13 20:39:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 13 20:39:56.207670 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-75164b67-4df3-4ed7-9e3b-3939be2e6ca4 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Calling method '.version_select at 0x7f9846592550>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:56.236369 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-75164b67-4df3-4ed7-9e3b-3939be2e6ca4 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] HTTP exception thrown: Volume e318d40a-d2ad-4bc3-93fc-2802d35846c4 could not be found. Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-75164b67-4df3-4ed7-9e3b-3939be2e6ca4 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Request method failure captured: Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: DELETE /compute/v2.1/os-volumes/e318d40a-d2ad-4bc3-93fc-2802d35846c4 HTTP/1.1 Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOqbJN-scdEXU6QnxPWsLj68BHWS37mTamLGguOxWwAbZFZE3KNqk59ujDLyZSjd4HToF6UcBoKjFLnh3DlUHV0EFkiU4x_Im8Pa6aXOfiRX41vQeB-lDgOHo6A6x-um5zDJUgdlIUsgpB59O99cN50uM-OqQ_3bSioyQ6iiXk8i0Kg Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: a05f0392090f485a8927ee077c554610 Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:39:56.238399 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a05f0392090f485a8927ee077c554610"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a05f0392090f485a8927ee077c554610", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a05f0392090f485a8927ee077c554610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a05f0392090f485a8927ee077c554610"}]}] Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: a05f0392090f485a8927ee077c554610 Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-VolumesNegativeTest-1984595401-project Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: 41600aac56ab4e9ba0edd529ab9042d3 Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-VolumesNegativeTest-1984595401-project Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Volume e318d40a-d2ad-4bc3-93fc-2802d35846c4 could not be found. Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': 'e318d40a-d2ad-4bc3-93fc-2802d35846c4'} Sep 13 20:39:56.239867 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e318d40a-d2ad-4bc3-93fc-2802d35846c4 could not be found. (HTTP 404) (Request-ID: req-4bbc4580-a086-4d67-92bd-38f74543e6af) Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.240736 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 20:39:56.242064 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e318d40a-d2ad-4bc3-93fc-2802d35846c4 could not be found. Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 20:39:56.243357 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e318d40a-d2ad-4bc3-93fc-2802d35846c4 could not be found. Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e318d40a-d2ad-4bc3-93fc-2802d35846c4 could not be found. Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-75164b67-4df3-4ed7-9e3b-3939be2e6ca4 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Returning 404 to user: Volume e318d40a-d2ad-4bc3-93fc-2802d35846c4 could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-75164b67-4df3-4ed7-9e3b-3939be2e6ca4 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/e318d40a-d2ad-4bc3-93fc-2802d35846c4" status: 404 len: 109 microversion: 2.1 time: 0.035548 Sep 13 20:39:56.244761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1414/2911] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 13 20:39:56 2022] DELETE /compute/v2.1/os-volumes/e318d40a-d2ad-4bc3-93fc-2802d35846c4 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:39:56.249163 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-effa46e8-fabe-41ca-aa47-31ba8b3cfc56 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Calling method '.version_select at 0x7f9849c9fb80>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:39:56.277306 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-effa46e8-fabe-41ca-aa47-31ba8b3cfc56 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] HTTP exception thrown: Volume a2c8b639-aaa2-4a8c-9d7b-d51cc8d9c012 could not be found. Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-effa46e8-fabe-41ca-aa47-31ba8b3cfc56 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Request method failure captured: Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/os-volumes/a2c8b639-aaa2-4a8c-9d7b-d51cc8d9c012 HTTP/1.1 Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOqbJN-scdEXU6QnxPWsLj68BHWS37mTamLGguOxWwAbZFZE3KNqk59ujDLyZSjd4HToF6UcBoKjFLnh3DlUHV0EFkiU4x_Im8Pa6aXOfiRX41vQeB-lDgOHo6A6x-um5zDJUgdlIUsgpB59O99cN50uM-OqQ_3bSioyQ6iiXk8i0Kg Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: a05f0392090f485a8927ee077c554610 Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:39:56.279277 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a05f0392090f485a8927ee077c554610"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a05f0392090f485a8927ee077c554610", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a05f0392090f485a8927ee077c554610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a05f0392090f485a8927ee077c554610"}]}] Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: a05f0392090f485a8927ee077c554610 Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-VolumesNegativeTest-1984595401 Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-VolumesNegativeTest-1984595401-project Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: 41600aac56ab4e9ba0edd529ab9042d3 Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-VolumesNegativeTest-1984595401-project Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Volume a2c8b639-aaa2-4a8c-9d7b-d51cc8d9c012 could not be found. Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': 'a2c8b639-aaa2-4a8c-9d7b-d51cc8d9c012'} Sep 13 20:39:56.280661 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2c8b639-aaa2-4a8c-9d7b-d51cc8d9c012 could not be found. (HTTP 404) (Request-ID: req-6bfb5742-cefb-401f-9ee8-f2845ff467e4) Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.281540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 20:39:56.282869 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2c8b639-aaa2-4a8c-9d7b-d51cc8d9c012 could not be found. Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 20:39:56.284308 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2c8b639-aaa2-4a8c-9d7b-d51cc8d9c012 could not be found. Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2c8b639-aaa2-4a8c-9d7b-d51cc8d9c012 could not be found. Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-effa46e8-fabe-41ca-aa47-31ba8b3cfc56 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] Returning 404 to user: Volume a2c8b639-aaa2-4a8c-9d7b-d51cc8d9c012 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-effa46e8-fabe-41ca-aa47-31ba8b3cfc56 tempest-VolumesNegativeTest-1984595401 tempest-VolumesNegativeTest-1984595401-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a2c8b639-aaa2-4a8c-9d7b-d51cc8d9c012" status: 404 len: 109 microversion: 2.1 time: 0.035330 Sep 13 20:39:56.285435 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1498/2912] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 13 20:39:56 2022] GET /compute/v2.1/os-volumes/a2c8b639-aaa2-4a8c-9d7b-d51cc8d9c012 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:41:23.922274 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG dbcounter [-] [120845] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:41:23.923582 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:41:23.923803 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:41:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa (ip 10.222.0.52) !!! Sep 13 20:41:23.925719 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:41:23.926540 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG dbcounter [-] [120844] Writing DB stats nova_cell1:SELECT=86 {{(pid=120844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:41:23.930780 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 20:41:23.930943 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Tue Sep 13 20:41:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa (ip 10.222.0.52) !!! Sep 13 20:41:23.935172 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-b36c43c1-7fb8-4a9e-a495-793c304bbb58 req-a14b1c00-e8f0-4b38-9785-03eee9f2005d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b57cbd-c51a-4663-84b0-5312369c44fa", "tag": "d82b80f3-88d7-45e8-b2b2-e78f19b09601"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:41:23.946908 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-b36c43c1-7fb8-4a9e-a495-793c304bbb58 req-a14b1c00-e8f0-4b38-9785-03eee9f2005d service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:23.947644 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-b36c43c1-7fb8-4a9e-a495-793c304bbb58 req-a14b1c00-e8f0-4b38-9785-03eee9f2005d service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:23.948273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-b36c43c1-7fb8-4a9e-a495-793c304bbb58 req-a14b1c00-e8f0-4b38-9785-03eee9f2005d service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:23.953909 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-fde3ef37-e360-49fc-89bf-81b7870a8a1f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:23.954461 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fde3ef37-e360-49fc-89bf-81b7870a8a1f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:41:23.960319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-b36c43c1-7fb8-4a9e-a495-793c304bbb58 req-a14b1c00-e8f0-4b38-9785-03eee9f2005d service nova] Creating event network-changed:d82b80f3-88d7-45e8-b2b2-e78f19b09601 for instance 96b57cbd-c51a-4663-84b0-5312369c44fa on hv-cinder-85427 Sep 13 20:41:23.961691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fde3ef37-e360-49fc-89bf-81b7870a8a1f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:23.962253 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fde3ef37-e360-49fc-89bf-81b7870a8a1f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:23.962812 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fde3ef37-e360-49fc-89bf-81b7870a8a1f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:23.963504 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fde3ef37-e360-49fc-89bf-81b7870a8a1f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:23.964817 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fde3ef37-e360-49fc-89bf-81b7870a8a1f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:23.965302 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-fde3ef37-e360-49fc-89bf-81b7870a8a1f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:23.966183 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-b36c43c1-7fb8-4a9e-a495-793c304bbb58 req-a14b1c00-e8f0-4b38-9785-03eee9f2005d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046549 Sep 13 20:41:23.966850 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1499/2913] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:41:23.993429 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-fde3ef37-e360-49fc-89bf-81b7870a8a1f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Going to try to terminate instance {{(pid=120845) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:41:24.081332 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-fde3ef37-e360-49fc-89bf-81b7870a8a1f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "DELETE /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 204 len: 0 microversion: 2.1 time: 0.164198 Sep 13 20:41:24.082348 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1415/2914] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:41:23 2022] DELETE /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:41:24.091348 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-5591e2d6-4729-4ea2-9749-bff38fa9e566 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:24.092039 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-5591e2d6-4729-4ea2-9749-bff38fa9e566 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:41:24.098660 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5591e2d6-4729-4ea2-9749-bff38fa9e566 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:24.099142 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5591e2d6-4729-4ea2-9749-bff38fa9e566 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:24.099569 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5591e2d6-4729-4ea2-9749-bff38fa9e566 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:24.100466 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5591e2d6-4729-4ea2-9749-bff38fa9e566 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:24.101093 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5591e2d6-4729-4ea2-9749-bff38fa9e566 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:24.101665 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-5591e2d6-4729-4ea2-9749-bff38fa9e566 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:24.359713 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-5591e2d6-4729-4ea2-9749-bff38fa9e566 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:41:24.368219 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-5591e2d6-4729-4ea2-9749-bff38fa9e566 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1579 microversion: 2.1 time: 0.281033 Sep 13 20:41:24.368849 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1500/2915] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:41:24 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1579 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:41:25.393492 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-1135f5b9-4b42-4803-95e2-4e77f8726a09 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:25.394140 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-1135f5b9-4b42-4803-95e2-4e77f8726a09 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:41:25.400400 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1135f5b9-4b42-4803-95e2-4e77f8726a09 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:25.400887 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1135f5b9-4b42-4803-95e2-4e77f8726a09 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:25.401292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1135f5b9-4b42-4803-95e2-4e77f8726a09 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:25.401978 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1135f5b9-4b42-4803-95e2-4e77f8726a09 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:25.402451 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1135f5b9-4b42-4803-95e2-4e77f8726a09 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:25.402872 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-1135f5b9-4b42-4803-95e2-4e77f8726a09 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:25.676275 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-1135f5b9-4b42-4803-95e2-4e77f8726a09 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:41:25.684946 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-1135f5b9-4b42-4803-95e2-4e77f8726a09 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1579 microversion: 2.1 time: 0.295544 Sep 13 20:41:25.685531 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1416/2916] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:41:25 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1579 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:41:26.392381 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-fa65c87e-8789-425a-883c-a8f9c61f0be1 req-9b2f4441-720c-4374-bd70-b042b1a593bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b57cbd-c51a-4663-84b0-5312369c44fa", "name": "network-vif-deleted", "tag": "d82b80f3-88d7-45e8-b2b2-e78f19b09601"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:41:26.403932 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-fa65c87e-8789-425a-883c-a8f9c61f0be1 req-9b2f4441-720c-4374-bd70-b042b1a593bd service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:26.405127 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-fa65c87e-8789-425a-883c-a8f9c61f0be1 req-9b2f4441-720c-4374-bd70-b042b1a593bd service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:26.405625 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-fa65c87e-8789-425a-883c-a8f9c61f0be1 req-9b2f4441-720c-4374-bd70-b042b1a593bd service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:26.417183 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-fa65c87e-8789-425a-883c-a8f9c61f0be1 req-9b2f4441-720c-4374-bd70-b042b1a593bd service nova] Creating event network-vif-deleted:d82b80f3-88d7-45e8-b2b2-e78f19b09601 for instance 96b57cbd-c51a-4663-84b0-5312369c44fa on hv-cinder-85427 Sep 13 20:41:26.422171 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-fa65c87e-8789-425a-883c-a8f9c61f0be1 req-9b2f4441-720c-4374-bd70-b042b1a593bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033518 Sep 13 20:41:26.422801 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1501/2917] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:41:26.709043 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:26.709634 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:41:26.716759 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:26.717415 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:26.718181 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:26.718878 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:26.719430 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:26.719760 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:26.756056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:26.756532 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:26.756983 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:26.757457 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.objects.instance [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lazy-loading 'fault' on Instance uuid 96b57cbd-c51a-4663-84b0-5312369c44fa {{(pid=120845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:41:26.803534 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:41:26.812094 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-d06a9750-85a0-4254-8073-27f8fb901889 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 200 len: 1231 microversion: 2.1 time: 0.106979 Sep 13 20:41:26.813158 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1417/2918] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:41:26 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:41:27.841421 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7622a03e-d12a-4ca5-819e-346cc38b9613 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:27.842431 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-7622a03e-d12a-4ca5-819e-346cc38b9613 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 96b57cbd-c51a-4663-84b0-5312369c44fa] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:41:27.850262 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7622a03e-d12a-4ca5-819e-346cc38b9613 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:27.850769 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7622a03e-d12a-4ca5-819e-346cc38b9613 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:27.851201 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7622a03e-d12a-4ca5-819e-346cc38b9613 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:27.851883 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7622a03e-d12a-4ca5-819e-346cc38b9613 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:27.852330 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7622a03e-d12a-4ca5-819e-346cc38b9613 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:27.852748 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-7622a03e-d12a-4ca5-819e-346cc38b9613 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:27.866194 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-7622a03e-d12a-4ca5-819e-346cc38b9613 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] HTTP exception thrown: Instance 96b57cbd-c51a-4663-84b0-5312369c44fa could not be found. Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7622a03e-d12a-4ca5-819e-346cc38b9613 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Request method failure captured: Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa HTTP/1.1 Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOlfurhb6C5h7VciDa1Wurp46NflGUT3i1Go58ec7QqHXXOJEfHj2rDNzUhT5qJoU1P-AwIp31uOunAUuqXB-PCBA3lgteqdV64tujqR_K_4wJru__NYwIPbg8MwIMYY7xH9iGRNfER3r8egKpWTsDXY5ZwcieuLHu_r5qgYqIBjYKg Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: 7878c5e6e1e143199681f42b5518cc1a Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-TestVolumeBootPattern-845022340 Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:41:27.867856 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:41:27.869319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7878c5e6e1e143199681f42b5518cc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7878c5e6e1e143199681f42b5518cc1a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7878c5e6e1e143199681f42b5518cc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7878c5e6e1e143199681f42b5518cc1a"}]}] Sep 13 20:41:27.869319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-TestVolumeBootPattern-845022340 Sep 13 20:41:27.869319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: 7878c5e6e1e143199681f42b5518cc1a Sep 13 20:41:27.869319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-TestVolumeBootPattern-845022340 Sep 13 20:41:27.869319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-TestVolumeBootPattern-845022340-project Sep 13 20:41:27.869319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:41:27.869319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:41:27.869319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: d20ba942c80848d7819aede8c0df1e7f Sep 13 20:41:27.869319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-TestVolumeBootPattern-845022340-project Sep 13 20:41:27.869319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:41:27.869319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 96b57cbd-c51a-4663-84b0-5312369c44fa could not be found. Sep 13 20:41:27.869319 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '96b57cbd-c51a-4663-84b0-5312369c44fa'} Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96b57cbd-c51a-4663-84b0-5312369c44fa could not be found. Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:41:27.870273 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96b57cbd-c51a-4663-84b0-5312369c44fa could not be found. Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96b57cbd-c51a-4663-84b0-5312369c44fa could not be found. Sep 13 20:41:27.871830 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:27.873180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-7622a03e-d12a-4ca5-819e-346cc38b9613 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Returning 404 to user: Instance 96b57cbd-c51a-4663-84b0-5312369c44fa could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:41:27.873180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-7622a03e-d12a-4ca5-819e-346cc38b9613 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa" status: 404 len: 111 microversion: 2.1 time: 0.035870 Sep 13 20:41:27.873180 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1502/2919] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:41:27 2022] GET /compute/v2.1/servers/96b57cbd-c51a-4663-84b0-5312369c44fa => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:41:31.003801 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-4fcfcacb-02dc-4a9f-80f9-e49addff40b2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:31.004380 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4fcfcacb-02dc-4a9f-80f9-e49addff40b2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:41:31.007362 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-fefa8caa-c632-4046-8d2e-2417ec3f05bb req-f2c524a4-0b9c-4815-897e-52b3f66d7e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619fedd9-8a78-45a6-ac95-7a35d24d2037", "tag": "3ce031f5-d2d6-4329-8e27-ece36fe16d49"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:41:31.011975 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4fcfcacb-02dc-4a9f-80f9-e49addff40b2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:31.012651 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4fcfcacb-02dc-4a9f-80f9-e49addff40b2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:31.013324 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4fcfcacb-02dc-4a9f-80f9-e49addff40b2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:31.014204 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4fcfcacb-02dc-4a9f-80f9-e49addff40b2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:31.014864 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4fcfcacb-02dc-4a9f-80f9-e49addff40b2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:31.015558 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-4fcfcacb-02dc-4a9f-80f9-e49addff40b2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:31.019949 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-fefa8caa-c632-4046-8d2e-2417ec3f05bb req-f2c524a4-0b9c-4815-897e-52b3f66d7e3d service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:31.021099 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-fefa8caa-c632-4046-8d2e-2417ec3f05bb req-f2c524a4-0b9c-4815-897e-52b3f66d7e3d service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:31.021517 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-fefa8caa-c632-4046-8d2e-2417ec3f05bb req-f2c524a4-0b9c-4815-897e-52b3f66d7e3d service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:31.033526 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-fefa8caa-c632-4046-8d2e-2417ec3f05bb req-f2c524a4-0b9c-4815-897e-52b3f66d7e3d service nova] Creating event network-changed:3ce031f5-d2d6-4329-8e27-ece36fe16d49 for instance 619fedd9-8a78-45a6-ac95-7a35d24d2037 on hv-cinder-85427 Sep 13 20:41:31.038731 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-fefa8caa-c632-4046-8d2e-2417ec3f05bb req-f2c524a4-0b9c-4815-897e-52b3f66d7e3d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035960 Sep 13 20:41:31.039324 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1503/2920] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:41:31.045092 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-4fcfcacb-02dc-4a9f-80f9-e49addff40b2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Going to try to terminate instance {{(pid=120845) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:41:31.134620 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-4fcfcacb-02dc-4a9f-80f9-e49addff40b2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "DELETE /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 204 len: 0 microversion: 2.1 time: 0.134282 Sep 13 20:41:31.135798 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1418/2921] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:41:30 2022] DELETE /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:41:31.144999 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-08a167e7-93f9-47df-bee9-0bf611996f2f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:31.145827 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-08a167e7-93f9-47df-bee9-0bf611996f2f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:41:31.152671 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08a167e7-93f9-47df-bee9-0bf611996f2f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:31.153157 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08a167e7-93f9-47df-bee9-0bf611996f2f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:31.153588 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08a167e7-93f9-47df-bee9-0bf611996f2f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:31.154415 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08a167e7-93f9-47df-bee9-0bf611996f2f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:31.154880 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08a167e7-93f9-47df-bee9-0bf611996f2f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:31.155301 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-08a167e7-93f9-47df-bee9-0bf611996f2f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:31.291165 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.policy [None req-08a167e7-93f9-47df-bee9-0bf611996f2f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120844) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:41:31.299323 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-08a167e7-93f9-47df-bee9-0bf611996f2f tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1578 microversion: 2.1 time: 0.158877 Sep 13 20:41:31.299930 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1504/2922] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:41:31 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:41:32.324605 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-e698014b-c576-495f-a631-ee20c4126ac9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:32.325346 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-e698014b-c576-495f-a631-ee20c4126ac9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:41:32.332056 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e698014b-c576-495f-a631-ee20c4126ac9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:32.332571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e698014b-c576-495f-a631-ee20c4126ac9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:32.332971 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e698014b-c576-495f-a631-ee20c4126ac9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:32.333777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e698014b-c576-495f-a631-ee20c4126ac9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:32.334447 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e698014b-c576-495f-a631-ee20c4126ac9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:32.334587 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-e698014b-c576-495f-a631-ee20c4126ac9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:32.546254 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-e698014b-c576-495f-a631-ee20c4126ac9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:41:32.554571 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-e698014b-c576-495f-a631-ee20c4126ac9 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1578 microversion: 2.1 time: 0.234487 Sep 13 20:41:32.555134 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1419/2923] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:41:32 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:41:33.257364 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [req-2c67d3f6-fc85-41da-9443-15cca0337f94 req-d3004fae-0bad-41d6-a9c6-c9b3bd16f003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619fedd9-8a78-45a6-ac95-7a35d24d2037", "name": "network-vif-deleted", "tag": "3ce031f5-d2d6-4329-8e27-ece36fe16d49"}]} {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:41:33.268703 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-2c67d3f6-fc85-41da-9443-15cca0337f94 req-d3004fae-0bad-41d6-a9c6-c9b3bd16f003 service nova] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:33.269185 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-2c67d3f6-fc85-41da-9443-15cca0337f94 req-d3004fae-0bad-41d6-a9c6-c9b3bd16f003 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:33.269613 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [req-2c67d3f6-fc85-41da-9443-15cca0337f94 req-d3004fae-0bad-41d6-a9c6-c9b3bd16f003 service nova] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:33.281773 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.compute.server_external_events [req-2c67d3f6-fc85-41da-9443-15cca0337f94 req-d3004fae-0bad-41d6-a9c6-c9b3bd16f003 service nova] Creating event network-vif-deleted:3ce031f5-d2d6-4329-8e27-ece36fe16d49 for instance 619fedd9-8a78-45a6-ac95-7a35d24d2037 on hv-cinder-85427 Sep 13 20:41:33.286843 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [req-2c67d3f6-fc85-41da-9443-15cca0337f94 req-d3004fae-0bad-41d6-a9c6-c9b3bd16f003 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033284 Sep 13 20:41:33.287434 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1505/2924] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 13 20:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:41:33.580173 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:33.580787 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:41:33.588037 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:33.588853 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:33.589292 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:33.589993 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:33.590444 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:33.591040 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:33.625028 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:33.625777 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:33.626214 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:33.626691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.objects.instance [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lazy-loading 'fault' on Instance uuid 619fedd9-8a78-45a6-ac95-7a35d24d2037 {{(pid=120845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:41:33.669691 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.policy [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20ba942c80848d7819aede8c0df1e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7878c5e6e1e143199681f42b5518cc1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120845) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:41:33.677761 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-a950114b-1b26-4ae0-95ba-2feef7c4bdb0 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 200 len: 1230 microversion: 2.1 time: 0.103190 Sep 13 20:41:33.678317 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1420/2925] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:41:33 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:41:34.707304 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b5e6a5ef-7383-4403-84fe-9aad3efa0b67 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:34.708439 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-b5e6a5ef-7383-4403-84fe-9aad3efa0b67 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 619fedd9-8a78-45a6-ac95-7a35d24d2037] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:41:34.716034 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b5e6a5ef-7383-4403-84fe-9aad3efa0b67 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:34.716510 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b5e6a5ef-7383-4403-84fe-9aad3efa0b67 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:34.716963 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b5e6a5ef-7383-4403-84fe-9aad3efa0b67 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:34.717645 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b5e6a5ef-7383-4403-84fe-9aad3efa0b67 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:34.718091 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b5e6a5ef-7383-4403-84fe-9aad3efa0b67 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:34.718555 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-b5e6a5ef-7383-4403-84fe-9aad3efa0b67 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:34.732129 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-b5e6a5ef-7383-4403-84fe-9aad3efa0b67 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] HTTP exception thrown: Instance 619fedd9-8a78-45a6-ac95-7a35d24d2037 could not be found. Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b5e6a5ef-7383-4403-84fe-9aad3efa0b67 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Request method failure captured: Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 HTTP/1.1 Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOlfurhb6C5h7VciDa1Wurp46NflGUT3i1Go58ec7QqHXXOJEfHj2rDNzUhT5qJoU1P-AwIp31uOunAUuqXB-PCBA3lgteqdV64tujqR_K_4wJru__NYwIPbg8MwIMYY7xH9iGRNfER3r8egKpWTsDXY5ZwcieuLHu_r5qgYqIBjYKg Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: 7878c5e6e1e143199681f42b5518cc1a Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-TestVolumeBootPattern-845022340 Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:41:34.733774 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:41:34.735206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7878c5e6e1e143199681f42b5518cc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7878c5e6e1e143199681f42b5518cc1a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7878c5e6e1e143199681f42b5518cc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7878c5e6e1e143199681f42b5518cc1a"}]}] Sep 13 20:41:34.735206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-TestVolumeBootPattern-845022340 Sep 13 20:41:34.735206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: 7878c5e6e1e143199681f42b5518cc1a Sep 13 20:41:34.735206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-TestVolumeBootPattern-845022340 Sep 13 20:41:34.735206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-TestVolumeBootPattern-845022340-project Sep 13 20:41:34.735206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:41:34.735206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:41:34.735206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: d20ba942c80848d7819aede8c0df1e7f Sep 13 20:41:34.735206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-TestVolumeBootPattern-845022340-project Sep 13 20:41:34.735206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:41:34.735206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 619fedd9-8a78-45a6-ac95-7a35d24d2037 could not be found. Sep 13 20:41:34.735206 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '619fedd9-8a78-45a6-ac95-7a35d24d2037'} Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619fedd9-8a78-45a6-ac95-7a35d24d2037 could not be found. Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:41:34.735929 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619fedd9-8a78-45a6-ac95-7a35d24d2037 could not be found. Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619fedd9-8a78-45a6-ac95-7a35d24d2037 could not be found. Sep 13 20:41:34.737310 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:34.738505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-b5e6a5ef-7383-4403-84fe-9aad3efa0b67 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Returning 404 to user: Instance 619fedd9-8a78-45a6-ac95-7a35d24d2037 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:41:34.738505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-b5e6a5ef-7383-4403-84fe-9aad3efa0b67 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037" status: 404 len: 111 microversion: 2.1 time: 0.036087 Sep 13 20:41:34.738505 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1506/2926] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:41:34 2022] GET /compute/v2.1/servers/619fedd9-8a78-45a6-ac95-7a35d24d2037 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:41:35.185363 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8e1b87d3-bc46-4b31-8916-d41be59ca248 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:35.185892 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.compute.api [None req-8e1b87d3-bc46-4b31-8916-d41be59ca248 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120845) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:41:35.192536 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e1b87d3-bc46-4b31-8916-d41be59ca248 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:35.193014 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e1b87d3-bc46-4b31-8916-d41be59ca248 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:35.193449 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e1b87d3-bc46-4b31-8916-d41be59ca248 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:35.194226 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e1b87d3-bc46-4b31-8916-d41be59ca248 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:35.194700 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e1b87d3-bc46-4b31-8916-d41be59ca248 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:35.195145 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG oslo_concurrency.lockutils [None req-8e1b87d3-bc46-4b31-8916-d41be59ca248 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:35.208391 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.wsgi [None req-8e1b87d3-bc46-4b31-8916-d41be59ca248 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] HTTP exception thrown: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8e1b87d3-bc46-4b31-8916-d41be59ca248 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Request method failure captured: Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: request: DELETE /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 HTTP/1.1 Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept: application/json Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Accept-Encoding: identity Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Connection: close Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Length: 0 Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Content-Type: application/json Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Host: 10.222.0.52 Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: Openstack-System-Scope: None Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: User-Agent: python-urllib3/1.26.12 Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Auth-Token: gAAAAABjIOlfurhb6C5h7VciDa1Wurp46NflGUT3i1Go58ec7QqHXXOJEfHj2rDNzUhT5qJoU1P-AwIp31uOunAUuqXB-PCBA3lgteqdV64tujqR_K_4wJru__NYwIPbg8MwIMYY7xH9iGRNfER3r8egKpWTsDXY5ZwcieuLHu_r5qgYqIBjYKg Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Id: None Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Domain-Name: None Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Identity-Status: Confirmed Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Is-Admin-Project: True Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Id: default Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Domain-Name: Default Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Id: 7878c5e6e1e143199681f42b5518cc1a Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Project-Name: tempest-TestVolumeBootPattern-845022340 Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Role: reader,member Sep 13 20:41:35.210109 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Roles: reader,member Sep 13 20:41:35.211616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7878c5e6e1e143199681f42b5518cc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7878c5e6e1e143199681f42b5518cc1a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7878c5e6e1e143199681f42b5518cc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7878c5e6e1e143199681f42b5518cc1a"}]}] Sep 13 20:41:35.211616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant: tempest-TestVolumeBootPattern-845022340 Sep 13 20:41:35.211616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Id: 7878c5e6e1e143199681f42b5518cc1a Sep 13 20:41:35.211616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-Tenant-Name: tempest-TestVolumeBootPattern-845022340 Sep 13 20:41:35.211616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User: tempest-TestVolumeBootPattern-845022340-project Sep 13 20:41:35.211616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Id: default Sep 13 20:41:35.211616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Domain-Name: Default Sep 13 20:41:35.211616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Id: d20ba942c80848d7819aede8c0df1e7f Sep 13 20:41:35.211616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: X-User-Name: tempest-TestVolumeBootPattern-845022340-project Sep 13 20:41:35.211616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: method: > Sep 13 20:41:35.211616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: exception: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:41:35.211616 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: action_args: {'id': '6fbe786d-befa-4ca2-a407-2f0236d91426'} Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:41:35.212438 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:41:35.213754 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: ERROR nova.api.openstack.wsgi Sep 13 20:41:35.215212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-8e1b87d3-bc46-4b31-8916-d41be59ca248 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Returning 404 to user: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. {{(pid=120845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:41:35.215212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-8e1b87d3-bc46-4b31-8916-d41be59ca248 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 404 len: 111 microversion: 2.1 time: 0.030560 Sep 13 20:41:35.215212 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1421/2927] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 13 20:41:35 2022] DELETE /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:41:35.220487 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9c7b776e-bf6d-409d-911b-3fd53772e3e2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '>' {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:35.221137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.compute.api [None req-9c7b776e-bf6d-409d-911b-3fd53772e3e2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] [instance: 6fbe786d-befa-4ca2-a407-2f0236d91426] Fetching instance by UUID {{(pid=120844) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:41:35.227628 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c7b776e-bf6d-409d-911b-3fd53772e3e2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:35.228128 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c7b776e-bf6d-409d-911b-3fd53772e3e2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:35.228557 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c7b776e-bf6d-409d-911b-3fd53772e3e2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:35.229251 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c7b776e-bf6d-409d-911b-3fd53772e3e2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Acquiring lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:41:35.229689 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c7b776e-bf6d-409d-911b-3fd53772e3e2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:41:35.230137 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG oslo_concurrency.lockutils [None req-9c7b776e-bf6d-409d-911b-3fd53772e3e2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Lock "fb4e4ec9-f74d-4e77-81ac-09cb87a6e8a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:41:35.243973 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.wsgi [None req-9c7b776e-bf6d-409d-911b-3fd53772e3e2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] HTTP exception thrown: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9c7b776e-bf6d-409d-911b-3fd53772e3e2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Request method failure captured: Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: request: GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 HTTP/1.1 Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept: application/json Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Accept-Encoding: identity Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Connection: close Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Length: 0 Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Content-Type: application/json Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Host: 10.222.0.52 Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: Openstack-System-Scope: None Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: User-Agent: python-urllib3/1.26.12 Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Auth-Token: gAAAAABjIOlfurhb6C5h7VciDa1Wurp46NflGUT3i1Go58ec7QqHXXOJEfHj2rDNzUhT5qJoU1P-AwIp31uOunAUuqXB-PCBA3lgteqdV64tujqR_K_4wJru__NYwIPbg8MwIMYY7xH9iGRNfER3r8egKpWTsDXY5ZwcieuLHu_r5qgYqIBjYKg Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Id: None Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Domain-Name: None Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Identity-Status: Confirmed Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Is-Admin-Project: True Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Id: default Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Domain-Name: Default Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Id: 7878c5e6e1e143199681f42b5518cc1a Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Project-Name: tempest-TestVolumeBootPattern-845022340 Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Role: reader,member Sep 13 20:41:35.245492 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Roles: reader,member Sep 13 20:41:35.247063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7878c5e6e1e143199681f42b5518cc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7878c5e6e1e143199681f42b5518cc1a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7878c5e6e1e143199681f42b5518cc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7878c5e6e1e143199681f42b5518cc1a"}]}] Sep 13 20:41:35.247063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant: tempest-TestVolumeBootPattern-845022340 Sep 13 20:41:35.247063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Id: 7878c5e6e1e143199681f42b5518cc1a Sep 13 20:41:35.247063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-Tenant-Name: tempest-TestVolumeBootPattern-845022340 Sep 13 20:41:35.247063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User: tempest-TestVolumeBootPattern-845022340-project Sep 13 20:41:35.247063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Id: default Sep 13 20:41:35.247063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Domain-Name: Default Sep 13 20:41:35.247063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Id: d20ba942c80848d7819aede8c0df1e7f Sep 13 20:41:35.247063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: X-User-Name: tempest-TestVolumeBootPattern-845022340-project Sep 13 20:41:35.247063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: method: > Sep 13 20:41:35.247063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: exception: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:41:35.247063 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: action_args: {'id': '6fbe786d-befa-4ca2-a407-2f0236d91426'} Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: {{(pid=120844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:41:35.247970 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. Sep 13 20:41:35.249427 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: ERROR nova.api.openstack.wsgi Sep 13 20:41:35.250781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: DEBUG nova.api.openstack.wsgi [None req-9c7b776e-bf6d-409d-911b-3fd53772e3e2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Returning 404 to user: Instance 6fbe786d-befa-4ca2-a407-2f0236d91426 could not be found. {{(pid=120844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:41:35.250781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: INFO nova.api.openstack.requestlog [None req-9c7b776e-bf6d-409d-911b-3fd53772e3e2 tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426" status: 404 len: 111 microversion: 2.1 time: 0.030422 Sep 13 20:41:35.250781 dv-cinder-854274-5-iscsi devstack@n-api.service[120844]: [pid: 120844|app: 0|req: 1507/2928] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 13 20:41:35 2022] GET /compute/v2.1/servers/6fbe786d-befa-4ca2-a407-2f0236d91426 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:41:36.564937 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: DEBUG nova.api.openstack.wsgi [None req-3f447ca2-0a1b-4e79-96f6-7e180111dd1a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] Calling method '.version_select at 0x7f9849d05700>' {{(pid=120845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:41:36.591734 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: INFO nova.api.openstack.requestlog [None req-3f447ca2-0a1b-4e79-96f6-7e180111dd1a tempest-TestVolumeBootPattern-845022340 tempest-TestVolumeBootPattern-845022340-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1825705146" status: 202 len: 0 microversion: 2.1 time: 0.030636 Sep 13 20:41:36.592329 dv-cinder-854274-5-iscsi devstack@n-api.service[120845]: [pid: 120845|app: 0|req: 1422/2929] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 13 20:41:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1825705146 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)